What's wrong with him?

I have been married to my husband for almoust 2 years now, we have been together for 3 years. When we were dating we told each other some stuff about our previous relationships. After the birth of our child he became somewhat distant. I always have to ask him for attention. I tried to talk to him about it, but he always said that he is tired and that we should talk later. I really feel lonely alot. I look great, I think, lost almoust all baby weight, I am a good mom, wife...I dont know, I just cant think about a reason why would he be so cold with me. I talked to him yesterday and he said that he has made an appointment with psychologist to tak about it, as he cant tell me. I was shocked. He fianlly said that after 2 (!) years of our marriage he is having problems dealing with my past, that I was married and all this stuff (it wasnt alot) that I told him. He is not sure if he ever will be able to deal with it. Is this just some stupid excuse and he is just fallen out of love with me?