How do programming languages (like Java or any other language) get tested?

Do programming languages such as Java, C, C++... get tested before handed to people to use them? If they are tested, does anyone have any idea how would a programming language get tested?

If we look at a programming language there is an infinite number of combinations in which we can use anything in it, so I am thinking it's impossible for all the combinations to get tested. Yet, we don't find bugs in these programming languages very often. So how is this testing done?

Thanks in advance.