[
https://issues.apache.org/jira/browse/BAHIR-154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310217#comment-16310217
]
ASF GitHub Bot commented on BAHIR-154:
--------------------------------------
GitHub user emlaver opened a pull request:
https://github.com/apache/bahir/pull/61
[BAHIR-154] Refactor sql-cloudant to use Cloudant's java-cloudant features
_What_
Refactor sql-cloudant to use Cloudant's` java-cloudant` features
_How_
- Use java-cloudant’s executeRequest for HTTP requests against _all_docs
endpoint
- Added HTTP 429 backoff with default settings
- Simplified caught exception and message for schema size
- Replaced scala http library with okhttp library for changes receiver
- Updated streaming CloudantReceiver class to use improved
ChangesRowScanner method
- Replaced Play JSON with GSON library
- Updated save operation to use `java-cloudant` bulk API
- Use `_changes` feed filter option for Cloudant/CouchDB 2.x and greater
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/emlaver/bahir 154-java-cloudant-refactor
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/bahir/pull/61.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #61
----
commit 72bdc4d960fc85bf22db8fbd655b12346118998e
Author: Esteban Laver <emlaver@...>
Date: 2017-12-17T18:30:04Z
Initial commit for java-cloudant rebase
- Use java-cloudant’s executeRequest for HTTP requests against _all_docs
endpoint
- Added HTTP 429 backoff with default settings
- Use java-cloudant view builders to get total doc limit
- Simplified caught exception and message for schema size
commit eb4053fe013dec1f3538224dee692118200ed19c
Author: Esteban Laver <emlaver@...>
Date: 2017-12-09T04:55:01Z
Replaced scala http library with okhttp library for changes receiver
commit 5f20a3fd8d7e26a0c8c6ef9200d4386eeec31036
Author: Esteban Laver <emlaver@...>
Date: 2017-12-17T17:54:47Z
Updated streaming CloudantReceiver class to use improved ChangesRowScanner
method
commit 1dc43cc89bedfb241c41acd5961cf13d741fab86
Author: Esteban Laver <emlaver@...>
Date: 2017-12-17T18:37:14Z
Replaced all references of play json with GSON library
- Updated save operation to use java-cloudant’s bulk API
commit 6520385e45634d23650c72a0431fe14d55762104
Author: Esteban Laver <emlaver@...>
Date: 2017-12-19T17:02:26Z
Only use _changes feed filter option for Cloudant/CouchDB 2.x and greater
----
> Refactor sql-cloudant to use Cloudant's java-cloudant features
> --------------------------------------------------------------
>
> Key: BAHIR-154
> URL: https://issues.apache.org/jira/browse/BAHIR-154
> Project: Bahir
> Issue Type: Improvement
> Affects Versions: Spark-2.2.0
> Reporter: Esteban Laver
> Assignee: Esteban Laver
>
> Cloudant's java-cloudant library (which is currently used for testing)
> contains several features that sql-cloudant can benefit from:
> - HTTP 429 backoff
> - View builder API to potentially simplify loading for _all_docs/views
> - Improved exception handling when executing HTTP requests
> - Future support for IAM API key
> Would need to replace current scala HTTP library with OkHttp library, and
> also replace play-json with GSON library.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)