There might be a downside to being too punctilious about updating voter rolls: human error and scrubbing valid voters. Given the rarity of voter impersonation and dead people casting ballots, it might actually be better to be too lax rather than too strict.
This would be my experience and conclusion.
And by God if it happens again I will chain myself to the stainless steel in the elementary school cafeteria.