Is there some basis for thinking that? AFAICT your eyes/brain seem to overlook the physical location of the screen and are tricked into variably focusing based on simulated depth.
It's not just focal distance, but also accommodation and general eye coordination. (Today's) VR screws up your visual neurological systems and studies show this:
Sorry, I meant to also mention convergence, which is the movement of the two eyes together to focus on near objects because of line-of-sight. This is perhaps the bigger problem.
The issue isn't (only) the focal distance. The difference is that your desk monitors don't encapsulate your entire eye cavities and cause pupil dilation, pumping blue light directly onto your retinas, which has been suspected to accelerate macular degeneration, night-blindness, and dry eye, as well as cause poor sleep.
