That's because some lip balms contain ingredients such as irritating fragrances or menthol, which can suck the moisture out of your lips. They might also have an insufficient amount of moisturizing humectants, which can further prolong the chapped lips cycle.