[
https://issues.apache.org/jira/browse/SPARK-13655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-13655.
----------------------------------
Resolution: Fixed
Assignee: Josh Rosen
Fix Version/s: 2.0.0
> Fix WithAggregationKinesisBackedBlockRDDSuite
> ---------------------------------------------
>
> Key: SPARK-13655
> URL: https://issues.apache.org/jira/browse/SPARK-13655
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 2.0.0
> Reporter: Dongjoon Hyun
> Assignee: Josh Rosen
> Fix For: 2.0.0
>
>
> `WithAggregationKinesisBackedBlockRDDSuite` test consistently hangs and fails
> due to timeout. Currently, this is observed in
> [PR-11481|https://github.com/apache/spark/pull/11481] and
> [PR-11438|https://github.com/apache/spark/pull/11438]. Inevitably, those PR
> removes their changes on Kinesis module to skip Kinesis test.
> {code:title=SparkPullRequestBuilder-52389|borderStyle=solid}
> [info] WithAggregationKinesisBackedBlockRDDSuite:
> Using endpoint URL https://kinesis.us-west-2.amazonaws.com for creating
> Kinesis streams for tests.
> [2016-03-03 02:11:56.990918] [0x00007fabfb82f700] [info]
> [kinesis_producer.cc:79] Created pipeline for stream
> "KinesisTestUtils-7296082419112679238"
> [2016-03-03 02:11:56.991038] [0x00007fabfb82f700] [info] [shard_map.cc:83]
> Updating shard map for stream "KinesisTestUtils-7296082419112679238"
> [2016-03-03 02:11:57.230083] [0x00007fabfa42d700] [info] [shard_map.cc:163]
> Successfully updated shard map for stream
> "KinesisTestUtils-7296082419112679238" found 2 shards
> [info] - Basic reading from Kinesis (2 seconds, 116 milliseconds)
> [info] - Read data available in both block manager and Kinesis (65
> milliseconds)
> Attempting to post to Github...
> > Post successful.
> Build step 'Execute shell' marked build as failure
> Archiving artifacts
> Recording test results
> Test FAILed.
> Refer to this link for build results (access rights to CI server needed):
> https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/52389/
> Test FAILed.
> Finished: FAILURE
> {code}
> {code:title=NewSparkPullRequestBuilder-2608|borderStyle=solid}
> [info] WithAggregationKinesisBackedBlockRDDSuite:
> [2016-03-03 10:28:05.512018] [0x00007f0fe5705700] [info]
> [kinesis_producer.cc:79] Created pipeline for stream
> "KinesisTestUtils-1569968002408612511"
> [2016-03-03 10:28:05.512313] [0x00007f0fe5705700] [info] [shard_map.cc:83]
> Updating shard map for stream "KinesisTestUtils-1569968002408612511"
> [2016-03-03 10:28:05.739267] [0x00007f0fe4303700] [info] [shard_map.cc:163]
> Successfully updated shard map for stream
> "KinesisTestUtils-1569968002408612511" found 2 shards
> [info] - Basic reading from Kinesis (1 second, 504 milliseconds)
> [info] - Read data available in both block manager and Kinesis (37
> milliseconds)
> Build timed out (after 180 minutes). Marking the build as failed.
> Build was aborted
> Archiving artifacts
> Recording test results
> Finished: FAILURE
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
