The Athens Banner-Herald reports a man driving along Highway 72 in Carlton called 911 after he spotted the girl and put her in his vehicle Friday.
Madison County sheriff's officials say the girl's father, 37-year-old Timothy Pickens, approached while deputies were investigating and was arrested after a scuffle.
The girl's mother told authorities she and her husband left the house and their other children, ages 13, 9 and 5, were supposed to be watching the baby.
Authorities say charges could be filed against the girl's mother. It's unclear if Pickens has an attorney, and a number listed for him is out of service.