So I tried several years ago with vSphere esxi and later with Hyper-V RemoteFX and got it working in both cases but didn't get a suitable setup I was happy with.
So I've just ordered some kit to try again, this time with Hyper-V DDA and a Grid k520 I got off ebay along with upgrading my workstation to an X399 build.
Anyone here have any idea, what I am talking about!?