arjunashok opened a new pull request, #51: URL: https://github.com/apache/cassandra-analytics/pull/51
… job stats ### Changes - Utilized spark listeners to publish job/task stats on job completion for reader and writer. - Unified implementation of job end stats published for reader and writer - Publishes task runtime stats - Adds spark `jobGroup` based UUID to reader, similar to existing implementation in writer. This is used as the `jobId` to uniquely identify and potentially merge multiple stats published from the same job. ## Testing - Validated stats logged from unit tests and in-jvm-dtest integration tests for reader/writer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
