Once you do it the first time, you'll feel really stupid for not knowing how but, if you're like me, it'll give you fits until you figure it out. Here's how to change the batteries.
Turn the cups outward and slide a finger under the lip of the cushion. Just pull firmly. There's no locking mechanism or anything else holding it down.