The American Academy of Pediatrics says that babies shouldn't get fruit juice until they can handle a cup. If a baby sucks on a bottle of juice, the juice's natural sugars and acids can remain in the mouth for a long time and attack newly erupting teeth. For the same reason, you shouldn't put a baby to bed with a bottle of formula, milk, or anything else other than water.