Why dont you stick your GPU in the Xeon server and run some tests? See if it is worth while moving your gaming over.