"Duck Dynasty's" ratings have taken a turn for the worse in the weeks following the Phil Robertson interview controversy.
