Definition of "Horizontally" :

adverb: in a horizontal direction

"A gallery quite often is added to make use of space vertically as well as horizontally."