The fact that you're asking "it will seem weird" will make it seem weird.

"Hey, you wanna go get coffee some time?" works great. No, walk away. Yes, ask for number.