Well, it's sleep mode, not completely off, so of course it'll use battery. Just like your computer does when in standby.|
That said, even when off, the battery will lose charge on its own in time. No way around it.
Also, the PSV is pretty frugal when it comes to battery use in sleep mode. It won't last a month, but using it every couple of days you won't even notice the loss of charge.