Pittsburgh PA: The Pennsylvania Railroad Station in Pittsburgh. The Union Station was constructed between 1898 and 1903. In 1912, the name of this train station was changed to Penn Station to match all the other stations in the state that served the passengers of the Pennsylvania Railroad.