If the XD felt the best, then that's the one you should get. Shooting comfort is key, because it will make you want to practice with it more and it'll be easier for you to handle in case of emergency. I've not shot an XD, but I've held one and it was a very comfortable firearm.

That said, I'm not sure where all the Glock hate is coming from in this thread. I can understand not liking the Glock because of ergonomics or features, but Glock's reliability & build quality rarely comes into question. I've put about 2000 rounds through my Glock 22 without a SINGLE failure, and my roomate's put around 4000 rounds through his without a SINGLE failure. Yet the one guy I know with an H&K USP had to send it back to the factory after about 50 rounds because the firing pin broke.

The only time I've heard people complaining about Glocks feeding is when they try shooting reloaded ammo, something about the feed ramp means Glocks don't like it. I don't reload, so it's not an issue for me, but shooting factory ammo I've heard of very, very few issues.

Glock Torture Test