Go to your Default Gateway Address using a browser. By default the user interface of your router is 192.168.1.1 unless it has been modified in the past. You can check your Default Gateway Address by opening up a command prompt window and by typing "ipconfig" and hit enter.
You can then modify the settings once you gain access to your router's user interface. Everything from that point on is pretty much self explanatory.