Well done for taking that little mouse in!

I can't abide people who abandon animals like that. But luckily for Mr Mouse you passed by and now he's looked after.

Your cat is probably just struggling to adjust. This mouse was likely a pet from a shop.