Inequality is deepening the economic impact of COVID-19 on American workers, U.S. central bank chairman said.