Sponge bathe a newborn For the first week or so it's best to give your infant sponge baths with a warm, damp washcloth. Wash his face and hands frequently, and thoroughly clean his genital area after each diaper change. Bathing a baby in a bath tub After the umbilical cord stump dries up, falls off, and the area heals, you can start giving your newborn a tub bath every few days. It's easiest to use the kitchen sink or a small plastic baby tub filled with warm water instead of a standard tub. Although some parents bathe their babies every day, until a baby is crawling around and getting into m...