Labor impetus surged after Dutton dumped work from home