The dns server addresses are set by your isp. look on their website under support. These are usually automatically picked up from the airport, but it is possible that Windows is not automatically getting this info as it should.
Very broadly speaking, DNS enables easy internet use.
To answer your question, you can find your airports address using Network, in system preferences on your mac.