For 200 years this distinctive 135-room red brick building was Japan's only window to the outside world, but now it stands in what is one of the country's most international cities.