It looks like you were right the Z80 was backwards and how it still worked I have no clue. I reversed it and it still works like a charm. Here is a short video I took of it.
The PCB would still boot up and play, because this processor is only for the sound. When the Z80 was in backwards, you probably got a "Sound Board Interface Error" meassage displayed at boot up.
-Mark