How do I get my husband's new kitten to not bond with me over him?

We just got a new kitten(about 6 weeks old) because my husband has wanted one for the past two years. I am allergic to cats (not too bad) so we agreed that it would be his kitten. Unfortunately though when we're sitting on the couch the kitten forever chooses me over my husband. I dont hold the kitten excessively I haven't fed it, I havent played with it, or anything. The only thing I've done is keep it from getting behind the fridge and other places it could get hurt. I've been ignoring it the best I can and tried to let him bond with it, but its choosing me. Make it stop! Kitten rejection will not be good for my husbands psyche.