Read on for specific causes. Canker sores can develop anywhere on the tongue or mouth. They are open white or yellow areas with a surrounding red area. Causes include viruses, stress, or mouth injury.