Structures can be upgraded by tapping on the Structure, then selecting Upgrade. Upgrading Structures requires Coins and Crystals. You can also use Diamonds to unlock more queue slots on Structures!