The president doubled down on his decision not to invite two Democratic governors to a bipartisan event in Washington.