I've had two (likely field mice) in my current place, where I've been for 2 years. My cat is competent at the 'beat them into stunned submission' part of the equation, but not at the killing them part.

I keep old tupperware around just in case, scoop them up, and let them go outside with stern injunctions to tell all their mousie friends that a cat lives there. It seems to work.