We owe City Hall and more prominent buildings to a ‘townie’ who’d long since left for West Coast