Well I did one of those hindsight 20/20 searches, and lo and behold, there's a bunch of threads on this. I guess I didn't search as well as I could have; my error. However, as I did read the other threads, I saw they were absent pictures. Since this seems to be a common question, I figured I might as well post as I fix this and host the pics myself. That way, when this inevitably comes up again, people can read this and have some photos to refer to.
So, I pulled the board out of my makeshift T&F and took the top (sound?) pcb off. If looking at the main (bottom) pcb with the serial cable on your left, the battery is a coin battery (3V) soldered to the pcb at the top in the middle of the board (it's pretty easy to spot). I flipped the pcb over, desoldered it (my first time after a little practice on a junk pcb), and popped the battery off. Photos can be seen below. Since I don't have a Batteries Plus near me, and don't want to try to solder terminals on the battery, I'm going to go the battery holder route. That way, replacement will be easier the next time I or someone else has to do it. Went to Radio Shack and they didn't have any so when I find some (I grabbed some off eBay, but I'll see if I can find them local too), I'll post as I try to attach the holder and new battery.
First picture is a closeup of what it looks like, second picture is its orientation on the board. I posted bigger versions hosted by the message board as the second a third pictures attached.