Get a bunch of big rats and have them eat the mice. That's what I'd do, anyway.
You're gonna have to get some cats afterwards to eat the big rats, and then you're gonna be stuck with a cat infestation.
Eventually you're gonna have dinosaurs roaming around your apartment as you move up the food chain, but life's not perfect Jae, life's not perfect.