There's 1 big factor that could tank the Warriors' playoff standing