Liberals are quietly withdrawing support from Sussan Ley, hoping she’ll quit