Automated Java Testing for a Dummy

This is embarrassing, but I have an open-source java project that I am supposed to give a report on for school. Is there a tool I can use which will automatically run against this program and spit out how many faults were detected so I can put it in my report?

Sorry, I don't know anything about testing but it is necessary for my report. Also, I use eclipse and mac.

Thank you!