Olly Alexander has hit back at criticism of his concerts after revealing he had received backlash for not being "family friendly".