Captain, the reason for Rudy's fall is because of his extra baggage from his affair and his buddy the police chief whom he recommended to be Homeland Sec.  Also his social value was never liked by his fellow conservative Republicans.