This is what a by-election is for. Someone is removed/resigns from office, or dies in office, surely you just run a by-election?

At least this is what we do in Australia for our house of reps (there’s a different system for the senate since electorates are state-wide).