I don't think my bunny likes me.?

So we got a 4 mo old bunny a couple weeks ago. The first night I had him I held him all snuggled up for over an hour. Now he doesn't let me hold him at all. He roams the living room and runs and hops around. But he wont come to me and when I get ahold of him I try and hold him close to get him used to it and he makes noises and literally jumps out of my hands. He also does that really loud t noise a lot which I read means he's upset or mad?? He has a roomy cage and he is seriously spoiled. I have a hanging trough filled with hay for him, a food dish always full, treats to nibble on as well as the hanging thing with things to nibble and chew on. he also has toys all over that he doesn't seem to even know are there. Or care. I have a little dog (9lbs) and a cat that he loves. From the first night he runs to them and jumps and hops all over them and even goes nose to nose with my cat-super cute. But all the things on line about the t and grunting make me feel like maybe he's angry? But yet he does the flying 'binkey' hops and runs everywhere. I don't get it. Am I doing something wrong?