SNL kicked off its 51st season this weekend with 4.4 million total viewers, a 24% decline from last year’s season premiere.