The building was designed by the Japanese architect Ichiro Nomura and constructed by the Group of Takaishi in 1915. The style of the building is modeled after the Greek Doric-style architecture popular during the Renaissance Period. The sublime vaulted roof ceiling in the middle of the building is almost 30 meters high, making it the visual focus of the building which is a load-bearing reinforced concrete structure and the primary construction materials were imported from Japan including black marble from Akasaka and white cypsum from Mito. The wood of the locally grown Taiwan Hinoki tree was used for carpentry work and the outer wall was finished in pebble-washed terrazzo. The completion of the building was an unprecedented accomplishment at that time in terms of structural technology and building materials. Its majestic appearance and exquisite craftsmanship have been rare in Taiwan over the past eight decades.

The European-style building features several classical elements of Western architecture. The plan shows an I-shape building facing Kuanchien Road on the north and the 228 Memorial Park on the south. The museum is amid the park greenery. The design of the building protects it from too much sunshine in hot weather, reflecting the architect's considerations regarding urban development and the climate of the city.

The main entrance and the lobby are located in the middle of the building, and exhibition halls are found in the two wings, a simple yet powerful layout.

The outer look of the building is modeled on Greek architecture, with an entrance and stairs similar to those of an ancient Greek temple. Other features include Doric ornamentation, elegantly decorated walls and the sublime Roman vaulted roof ceiling, creating a sacred imperial atmosphere.

The lobby is the essence of the entire building. It is surrounded by 32 Corinthian embellishments, decorated lavishly with carvings of acanthus leaves. Standing at the center of the lobby and looking up, you see a vaulted roof ceiling and a stained glass window. In addition to serving the purpose of decoration, the window allows natural sunlight to flow through freely. On sunny days, the glittering colors shine through the room , creating an elegant and splendid atmosphere.

During the colonial years, two bronze statues of Kodama Gentaro and Goto Shinpei stood in the alcoves on both sides of the lobby. Since the Japanese authorities meant to make the museum a memorial hall to the pair, even the stairs were decorated with their family symbols.