Governors defend easing COVID-19 restrictions