Tourist centre branded 'unfortunate luxury' as bid to close it gathers momentum