The rules don't specifically prohibit it.
ICORE Rule Book
"Any shooter whose firearm breaks the 180 during the course of fire will face disqualification. The 180 is an imaginary line separating up range from downrange. This line moves with the shooter throughout any course of fire."
However, many clubs just won't allow it by their own club rules.
Moreover, for a stage which requires you to move perpendicular to the backstop, while the muzzle of the gun in the cross-draw holster is pointed toward the spectators, I don't see how you draw from that holster without exposing the muzzle to the wrong side of the 180.
I guess you could do some sort of half-pirouette and then draw and fire.
I probably wouldn't let you do that on general principles.
Its a game.
Get a proper game holster, and just play the game - safely, and without antagonizing the S.O.