TP, over the top or under the bottom.  Geez guys this one was easy to solve.  Mount the rack up and down like it is supposed to be and just pull it off whichever side it is sticking out from.  Similar to a free standing paper towel holder.