Manly is the other popular choice and you can reach it by ferry from Circular Quay.
Ironically, some of the best places to eat, see and stay are also at the cheaper end. I told him and he showed me where they were, giving me four different colours and styles to deep blue. https://Sites.google.com/view/health--products-1/home