Wealthy Australians are worried we might realise how rigged the system is in their favour