Just make sure the kitty has toys and scratch post to self-entertain while you're away, and that sounds like a great situation for a cat. Cats like when people give them space, in my experience. If you had a big social life I would say no, but it sounds like you're in a position to give plenty of attention when not at work. Gofor it! I think you'll be quite happy.

And as for the allergies, sounds like you're in the clear. About half the people I know with an allergy can't even be in the same room without having a reaction. Many others would also have a reaction from being brushed on by kitty.