Yes, that's correct. The client can oly suggest to the server about what it wants, but the server always has the freedom to prohibit anything it doesn't like.
In fact, to make use of X11 forwarding, the sshd server must allow that.
On the client side, setting ForwardX11=yes only means that...