Men and women- who is wrong?

I am 31 and I was dating a 35 yr. old man. We were friends for 2 to 3 mth before we started dating. he was nice and made time for me at first. We are busy people and I try to make plans ahead of time so I can see the person I am involved with 3 or 4x a week. I asked him on Tues. when he planned on seeing me the rest of the week and if he planned on seeing me on Sat.. He got a little irritated and said he had to go he would discuss the next day. I told him i was only asking bc we are both busy but i would like to see him often. He said I drive to your fu-king house and dont get home till 10 or 11, I dont get hardly any sleep bc I come see you. i was upset. i tried to explain to him why i was hurt. he said i had 2 mins.to talk and then he had to go. I told him that I was hurt and felt like I get in his way. I told him I didnt want to ever see him again. he said i shouldnt of said that bc it hurt him. i think i had a right bc he was very rude to me, am i wrong or is he a jerk