Scrape away as much of the glue as possible with a floor scraper. After scraping the entire floor, vacuum up the loosened glue.
Pour mastic or adhesive remover into a bucket. Read the label on the remover for specific instructions. Although most of these products do not need to be diluted with water, check the label just to be sure.
Apply the adhesive remover to any remaining glue spots using a mop. Let the solvent sit on the adhesive for a minimum of 30 minutes, or the manufacturer's recommended time.
Scrape the adhesive again with the floor scraper to remove the remaining spots. Once all the adhesive is removed, pick up the large chunks with the floor scraper and discard them in the trash. Clean the floor well with warm, soapy water to remove the residue.