There's been a handful of contestant running Windows 10. We don't presently support running on Windows natively so the road will be bumpy. We went ahead and tried a few routes forward,
1. Ubuntu for Windows: It appears Ubuntu for Windows does not officially support graphical applications. There are unofficial methods that are unreliable and have very poor performance (e.x. 4 steps/sec).
2. If you're familiar with docker and are ok with being limited to using https://github.com/facebookresearch/visdom for visualizing observations (details on starter_kit/README.md) you can try this Dockerfile: https://gist.github.com/JVillella/701a9d25aba6cf537b19c7cb4f6aba02
3. (recommended) System install of Ubuntu 16.04/18.04 on your machine (e.x. a partition)