As I think about this, perhaps it would make more sense with an example to illustrate what I mean...
Our perception of who God is tends to mirror to some degree our relationship with our own father. So, for example, if a girl has a father who is constantly finding fault with her, pointing out her failures, and then punishing them harshly without much room for mercy, such a child is more likely to be of the mindset that God is a harsh, judging God who punishes all wrong-doing. As this child matures, they might unconsciously believe in and then reject such a God. Why would they want to follow such a God, after all? Living in fear of failure all the time, etc.
If, however, a child is raised with a father who is loving a gracious, but never disciplines in any fashion, this child might grow to see God as an all loving God who ultimately has no real role in our lives. Such a "distant" God might not sit well, and again, they might turn away.
These are only two examples. Of course, there are a myriad of other unique situations that may paint a picture of God within a child that the child may or may not wish to believe in later. There is also the framework of the faith taught to them to begin with, which introduces complexities in this faith/father connection.