jeudi 18 mai 2017

Test framework for Spark Application validations

I am looking for your suggestions/help in testing framework for one of our Spark application. We have a spark application which processes the input data from HDFS and pushes the processed output data to HDFS. We are planning to automate the process of testing this spark application.

I would appreciate any suggestions on how to automate the testing or whether any framework available for testing spark applications/jobs.

-Sri

Aucun commentaire:

Enregistrer un commentaire