Yes, it is safe for babies to drink water. In fact, water is an important part of a baby's diet, and can help them stay hydrated and healthy.
Babies have different water needs than adults, and the amount of water they need can vary depending on their age,