I was connecting to my machines using the mstsc /v:servername /admin to connect to the machines as they are virtual machines and this connects you to the console just as if you'd walked up to a physical computer to login.
To stop the problems with OneNote do the following:
- Open up Remote Desktop (mstsc.exe for the command line)
- Type the name or IP of your server in the box
- Click 'options' to expand the window
- Uncheck the printers selection
- Click connect and login to the server; disconnect
Now when you run mstsc /v:servername /admin it will use the settings you just set. OneNote shouldn't open up when connecting to RDP after this is complete.

