You should be able to invite him if you check the settings from the in-game menu, just make sure you're playing an xbox live game. Go to your friends list if you press the guide button.
Haphazardly Gaming Domain
Join
Now
gaming.haphazardly@gmail.com