US President Donald Trump would find it "difficult" to pardon his former friend Sean 'Diddy' Combs because the rapper was "very hostile" towards him.