When you are pregnant, you want to be sure the medication is safe for you and the fetus. For mild pain or fever, Tylenol is considered the preferred OTC pain reliever to take during pregnancy.