The comedian argued that the president's inflammatory remarks makes it more challenging for him to convince liberals to interact with conservatives more.