The president is now "less inclined" to sit down for an interview with the special counsel team, sources told ABC News.