Your ancestor might really have believed they were born somewhere they were not. As a result, every record where they provided their place of birth might be incorrect.
My grandmother insisted she was born in Tioga, Hancock County, Illinois. She actually was born in nearby Wythe Township according to several contemporary records (discussed at length in an issue of Casefile Clues).
Grandma insisted she was born in Tioga and listed that on every document where she provided the place of birth.
This tip was well timed---Grandma would be 100 years old today!