Scrape off as much of the carpet glue as you can with your concrete scraper. Get as much of the glue debris as you can and sweep up the remnants so you know how much glue remains.
Spray or pour on the carpet glue cleaning solution directly on the glue areas and allow to soak in for several hours. The cement will probably soak it in, so you want to spray on an additional amount after three hours.
Try scraping any remaining clue with your scraper; most of it will now be able to be removed. It may be someone gooey from the solution so has some paper towels and a trash can handy to put all the excess glue in.
Flush the areas that had the glue with fast running water as with a garden hose or even a bucket full with water. The idea is to get the gooey glue off the concrete quickly so that it does not begin to harden. Once you have all the excess up and the flooring it rinsed well, allow it to thoroughly dry.
Examine your flooring once it is completely dry. If there is still glue, you can sand off the remaining bit with your hand sander. This is only recommended if just a small amount of glue remains.