After removing the vanity, and wall tiles I got back to work on the floor.  At first I was using my chisel (in the upper left) but after awhile I realized that the easiest way was to just hit the tiles dead on with the hammer, after a few hits they would break up and come off the mortar.   Actually ended up being much easier than I thought.