Are there differences in testing on Windows w/ Selenium vs testing with Docker?

Like the question says, I need to know if there is a major difference. Traditionally, we test our web application using several windows VMs running Chrome, Firefox, Edge, etc. These VMs however, are memory and cpu hungry and are harder to maintain for us then using linux machines. This worries our lead developers though, because the testing VMs are setup similar to our customers machines.

My thought is, if the browsers themselves arent different between linux and windows, then wouldnt I be able to do our testing in docker containers on linux? This would be fairly easy to maintain and setup.

So are there any key differences that I should understand? (Outside of the basics like "the OS's are different obviously)