[
https://issues.apache.org/jira/browse/BAHIR-128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282960#comment-16282960
]
ASF GitHub Bot commented on BAHIR-128:
--------------------------------------
GitHub user emlaver opened a pull request:
https://github.com/apache/bahir/pull/57
[BAHIR-128][WIP] fix failing sql-cloudant test
_What_
Fix test that's failing sporadically in sql-cloudant's
`CloudantChangesDFSuite`.
_How_
- Call stop in receiver when _changes feed completes
- Improve performance and decrease testing time by setting batch size to 8
seconds
- Use getResource to load json files path
See [BAHIR-128](https://issues.apache.org/jira/browse/BAHIR-128)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/emlaver/bahir
128-fix-failing-sql-cloudant-test
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/bahir/pull/57.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #57
----
commit cab516bbf42a5a40d7fa4f7d1813772ecd39105c
Author: Esteban Laver <[email protected]>
Date: 2017-09-08T14:33:26Z
- Call stop in receiver when _changes feed completes
- Improved performance and decrease testing time by setting batch size to 8
seconds
- Use getResource to load json files path
----
> Test failing sporadically in sql-cloudant's CloudantChangesDFSuite
> ------------------------------------------------------------------
>
> Key: BAHIR-128
> URL: https://issues.apache.org/jira/browse/BAHIR-128
> Project: Bahir
> Issue Type: Bug
> Reporter: Esteban Laver
> Assignee: Esteban Laver
> Priority: Minor
>
> This failure happened during pre-release testing for Bahir RC 2.2.0:
> CloudantChangesDFSuite:
> - load and save data from Cloudant database *** FAILED ***
> 0 did not equal 1967 (CloudantChangesDFSuite.scala:49)
> Partial stack trace:
> {code:java}
> Exception in thread "Cloudant Receiver" org.apache.spark.SparkException:
> Cannot add data as BlockGenerator has not been started or has been stopped
> at
> org.apache.spark.streaming.receiver.BlockGenerator.addData(BlockGenerator.scala:173)
> at
> org.apache.spark.streaming.receiver.ReceiverSupervisorImpl.pushSingle(ReceiverSupervisorImpl.scala:120)
> at org.apache.spark.streaming.receiver.Receiver.store(Receiver.scala:119)
> at
> org.apache.bahir.cloudant.internal.ChangesReceiver$$anonfun$org$apache$bahir$cloudant$internal$ChangesReceiver$$receive$1$$anonfun$apply$1.apply(ChangesReceiver.scala:82)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
