My mansion-lined suburb’s a little bit posh – but we also have a notorious underbelly