oh wow.. i have no problem talking about money when the question comes from a place of curiosity, however when it comes from insecurity and makes you feel attacked, i would of felt very uncomfortable. He sounds like he is afraid to lose what he has, and is def having some insecurity issues. It seems like it is his issue and has nothing to do with you , with a bit of jealousy that you are not stressed also..
There is alot happening and i feel people are freaking out, he just aired his publically.... I def do not think you were being a baby, i would of done the same thing, change subject and avoided his questions, maybe speak in private about this issue, as to help him, not give him any of your info!