I wouldn't consider holding back either on a Perm with plenty , but for the areas that now have near empty warrens or zero rabbit's then I think its a great idea.
If the numbers recover its straight back to business.
The biggest loss is lamping through the summer nights,a pregnant or suckling Doe shot, kills several winter rabbit's. Not a great loss on a healthy warren but where there's few, a different matter.