Question about HP ProDesk 4 Tower G1i

but I don't see a VGA port on the picture of the back of the PC, even though it is listed in the description.... that's the problem

The easiest way to do this would be directly via the DisplayPort and HDMI outputs, provided your monitors support this.