Yep. Reach for your brickie's toolbox. Get out the plugging chisel. Sharpen it just like when it was brand spankers. Get chiselling on one side only of the "shell". Use a block hammer for solid, fewer blows. This will almost always distort the bearing, and cock the opposing side out, where it can be grabbed, pried, punched as needed to finish.
Regards, Adam.