Step5 Treat fever To treat baby's fever *Dress your baby in light, cotton clothing *Give lots of fluids. *Keep room cool. *Try a sponge bath. Put your child in a shallow bath of lukewarm water, and rub his/her body, one area at a time, with a lightly wrung cloth or sponge. Don't dry off; let the water evaporate from the skin. This may make baby feel more comfortable. Also you can add cool towels to forehead or back of baby to cool them down. *You also give them Tylenol or Motrin the correct dosage depending on age. This can also help make the fever come down faster.