Interesting . .. I'd heard that the trip they took into Jerusalem when he was 12 was also related to the fact that it's at that age that boys with aspiritions to dedicate their lives to the church went to the priests and were "interviewed" essentially and the fact that Jesus was leaving with his parents was evidence that the religious leaders, all though they were astounded at his understanding of the Scriptures, rejected him to be a part of the temple priesthood.
One really doesn't know how much of these things can be taken as historically accurate. Scripture doesn't give any indication other than as he grew physically, he grew spiritually as well. I also find it interesting that there's no mention of Joseph after this. Some believe he died while Jesus was young but again, there's no Scriptural evidence supporting any of it.