Yep. Either you block all of Google Talk, or none of it. You cannot block specific buddies via your router.
If Google Talk supports blocking individual buddies, that's your best bet -- but your router is indifferent (or, rather, can't even tell) about one buddy from another. All your router knows is the network traffic to/from Google Talk -- not actually what the content of that traffic is.