Devin Nunes attended a breakfast with Flynn and Turkish foreign minister just before the inauguration