[ 
https://issues.apache.org/jira/browse/PHOENIX-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alex Araujo updated PHOENIX-3817:
---------------------------------
    Attachment: PHOENIX-3817.v2.patch

Tested v1 patch with HBase 1.3.1 clusters and security enabled. Found a few 
issues:
# HBASE-17448 made hbase-hadoop2-compat a client dependency, but the jar is not 
added as a dependency for MapReduce jobs. [~apurtell] committed a fix 
(HBASE-18184), but it has not been released. I created PHOENIX-3919 and 
attached a patch that will allow the jar to be added manually from Phoenix as a 
workaround
# Token auth needed to be explicitly setup for reading from a target cluster 
that has security enabled
# MultiTableRecordReader was swallowing SQLException when initializing. This 
was preventing fail fast behavior for MapReduce jobs when the client was not 
able to talk to the target cluster

Attaching v2 patch with the following:
- Rebased to pull in changes from PHOENIX-3744
- Fixed #2 and #3 above

We'll need to commit PHOENIX-3919 and add a workaround for #1 until HBASE-18184 
is released.

Would appreciate a review when you have some spare cycles [~jamestaylor].

> VerifyReplication using SQL
> ---------------------------
>
>                 Key: PHOENIX-3817
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3817
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: Alex Araujo
>            Assignee: Alex Araujo
>            Priority: Minor
>         Attachments: PHOENIX-3817.v1.patch, PHOENIX-3817.v2.patch
>
>
> Certain use cases may copy or replicate a subset of a table to a different 
> table or cluster. For example, application topologies may map data for 
> specific tenants to different peer clusters.
> It would be useful to have a Phoenix VerifyReplication tool that accepts an 
> SQL query, a target table, and an optional target cluster. The tool would 
> compare data returned by the query on the different tables and update various 
> result counters (similar to HBase's VerifyReplication).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to