Definition of "Vertically" :

adverb: in a vertical direction

"A gallery quite often is added to make use of space vertically as well as horizontally."