Toothpaste residue in facial hair – anyone else?

I keep finding toothpaste residue in my mustache after brushing. It’s drying and feels stiff. Has anyone else dealt with this? Did switching toothpaste or using a specific comb help?