Spicy foods and micro injuries from dental work are also known to leave them behind ... Saltwater rinses can keep the sore clean and combat inflammation, Dr. Kopelman adds. Benzocaine gel: A gel ...