Once untouchable, Albanese ends the year under siege