Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15355 @koeninger you can download the unit test logs from https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.6/1756/artifact/ I saw the offsets of the first batch (pat1 0 16 16) was wrong in the unit test logs: ``` 16/10/05 20:42:46.313 streaming-start INFO JobGenerator: Started JobGenerator at 1475725367000 ms 16/10/05 20:42:46.313 streaming-start INFO JobScheduler: Started JobScheduler 16/10/05 20:42:46.313 pool-1-thread-1-ScalaTest-running-DirectKafkaStreamSuite INFO StreamingContext: StreamingContext started 16/10/05 20:42:47.015 JobGenerator INFO JobScheduler: Added jobs for time 1475725367000 ms 16/10/05 20:42:47.016 JobScheduler INFO JobScheduler: Starting job streaming job 1475725367000 ms.0 from job set of time 1475725367000 ms 16/10/05 20:42:47.017 streaming-job-executor-0 INFO DirectKafkaStreamSuite: pat2 0 3 16 16/10/05 20:42:47.017 streaming-job-executor-0 INFO DirectKafkaStreamSuite: pat1 0 16 16 ``` Seems the `earliest` config does not work.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org