[jira] [Created] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
chenglei created PHOENIX-5148: - Summary: Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan Key: PHOENIX-5148 URL: https://issues.apache.org/jira/browse/PHOENIX-5148

[jira] [Created] (PHOENIX-5149) Set minimum HBase 1.4 version to 1.4.3

2019-02-20 Thread Artem Ervits (JIRA)
Artem Ervits created PHOENIX-5149: - Summary: Set minimum HBase 1.4 version to 1.4.3 Key: PHOENIX-5149 URL: https://issues.apache.org/jira/browse/PHOENIX-5149 Project: Phoenix Issue Type: Task

[jira] [Updated] (PHOENIX-5149) Set minimum HBase 1.4 version to 1.4.3

2019-02-20 Thread Artem Ervits (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artem Ervits updated PHOENIX-5149: -- Attachment: PHOENIX-5149-4.x-HBase-1.4.patch PHOENIX-5149-4.14-HBase-1.4.patch

[jira] [Created] (PHOENIX-5150) Fix for warning build.plugins.plugin must be unique

2019-02-20 Thread Artem Ervits (JIRA)
Artem Ervits created PHOENIX-5150: - Summary: Fix for warning build.plugins.plugin must be unique Key: PHOENIX-5150 URL: https://issues.apache.org/jira/browse/PHOENIX-5150 Project: Phoenix Iss

[jira] [Updated] (PHOENIX-5150) Fix for warning build.plugins.plugin must be unique

2019-02-20 Thread Artem Ervits (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artem Ervits updated PHOENIX-5150: -- Attachment: PHOENIX-5150-4.x-HBase-1.4.patch > Fix for warning build.plugins.plugin must be u

[jira] [Created] (PHOENIX-5151) fix Spark RDD example

2019-02-20 Thread Artem Ervits (JIRA)
Artem Ervits created PHOENIX-5151: - Summary: fix Spark RDD example Key: PHOENIX-5151 URL: https://issues.apache.org/jira/browse/PHOENIX-5151 Project: Phoenix Issue Type: Task Affects Vers

[jira] [Updated] (PHOENIX-5151) fix Spark RDD example

2019-02-20 Thread Artem Ervits (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artem Ervits updated PHOENIX-5151: -- Attachment: PHOENIX-5151.patch > fix Spark RDD example > - > >

Re: Integration Testing Requirements

2019-02-20 Thread William Shen
Thanks Ankit. What is the difference between these hive tests (e.g., org.apache.phoenix.hive.HiveTezIT) and other tests that also use a mini cluster (org.apache.phoenix.end2end.MigrateSystemTablesToSystemNamespaceIT), which are passing? Specifically, what does it need from HADOOP_HOME? On Tue, F

[jira] [Created] (PHOENIX-5152) omid-server-configuration.yml is failing license audit

2019-02-20 Thread Artem Ervits (JIRA)
Artem Ervits created PHOENIX-5152: - Summary: omid-server-configuration.yml is failing license audit Key: PHOENIX-5152 URL: https://issues.apache.org/jira/browse/PHOENIX-5152 Project: Phoenix

[jira] [Updated] (PHOENIX-5152) omid-server-configuration.yml is failing license audit

2019-02-20 Thread Artem Ervits (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artem Ervits updated PHOENIX-5152: -- Attachment: PHOENIX-5152.patch > omid-server-configuration.yml is failing license audit > ---

Re: Integration Testing Requirements

2019-02-20 Thread William Shen
Funny. The specific IT passed locally for me. Seems more like a Jenkins setup to troubleshoot for us... Thanks for your help Ankit. On Wed, Feb 20, 2019 at 12:07 PM William Shen wrote: > Thanks Ankit. > > What is the difference between these hive tests > (e.g., org.apache.phoenix.hive.HiveTezIT)

Re: CDH 6.X road map

2019-02-20 Thread William Shen
Same here. Would love to help with adding more CDH versions, if someone can help guide us on how to best go about it based on the current cdh branches. On Tue, Feb 12, 2019 at 5:10 PM Mahdi Salarkia wrote: > Hi > Is there a plan to release a Hbase-2.0-CDH (Cloudera 6.X) compatible > version of P

[jira] [Updated] (PHOENIX-5150) Fix for warning build.plugins.plugin must be unique

2019-02-20 Thread Artem Ervits (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artem Ervits updated PHOENIX-5150: -- Affects Version/s: 5.1 4.15.0 5.0.0 > Fix for w

How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Xiaoxiao Wang
Hi, who may help We are running a Hadoop application that needs to use phoenix JDBC connection from the workers. The connection works, but when too many connection established at the same time, it throws RPC timeouts Error: java.io.IOException: org.apache.phoenix.exception.PhoenixIOException:

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread William Shen
Hi Xiaoxiao, Have you tried including hbase-site.xml in your conf on classpath? Will On Wed, Feb 20, 2019 at 2:50 PM Xiaoxiao Wang wrote: > Hi, who may help > > We are running a Hadoop application that needs to use phoenix JDBC > connection from the workers. > The connection works, but when to

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Xiaoxiao Wang
Yes I have tried this HADOOP_CLASSPATH=/etc/hbase/conf/ hadoop jar $test_jar On Wed, Feb 20, 2019 at 3:19 PM William Shen wrote: > Hi Xiaoxiao, > > Have you tried including hbase-site.xml in your conf on classpath? > > Will > > On Wed, Feb 20, 2019 at 2:50 PM Xiaoxiao Wang > wrote: > > > Hi, wh

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Pedro Boado
Hi, How many concurrent client connections are we talking about? You might be opening more connections than the RS can handle ( under these circumstances most of the client threads would end exhausting their retry count ) . I would bet that you've get a bottleneck in the RS keeping SYSTEM.CATALOG

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Xiaoxiao Wang
HI Pedro thanks for your help, I think we know that we need to set the classpath to the hadoop program, and what we tried was HADOOP_CLASSPATH=/etc/hbase/conf/hbase-site.xml hadoop jar $test_jar but it didn't work So we are wondering if anything we did wrong? On Wed, Feb 20, 2019 at 3:24 PM Pedro

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Pedro Boado
Your classpath variable should be pointing to the folder containing your hbase-site.xml and not directly to the file. But certain distributions tend to override that envvar inside hadoop-env.sh or hadoop.sh . Out of curiosity, have you written a map-reduce application and are you querying phoenix

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Xiaoxiao Wang
Pedro thanks for your info, yes, I have tried both HADOOP_CLASSPATH=/etc/hbase/conf/hbase-site.xml and HADOOP_CLASSPATH=/etc/hbase/conf/ (without file), and yes checked hadoop-env.sh as well to make sure it did HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/others And also for your second question, it is in

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Xiaoxiao Wang
A bit more information, I feel the classpath didn't get passed in correctly by doing conf = HBaseConfiguration.addHbaseResources(super.getConf()); and this conf also didn't pick up the expected properties On Wed, Feb 20, 2019 at 3:56 PM Xiaoxiao Wang wrote: > Pedro > > thanks for your info, y

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread William Shen
A bit of a long shot, but do you happen to have another hbase-site.xml bundled in your jar accidentally that might be overriding what is on the classpath? On Wed, Feb 20, 2019 at 3:58 PM Xiaoxiao Wang wrote: > A bit more information, I feel the classpath didn't get passed in correctly > by doing

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Pedro Boado
I don't think you need an HBaseConfiguration at all for passing the settings to Phoenix. hbase-site.xml is loaded by default if in classpath. Or, if needed, just do a HBaseConfiguration.create() so it loads default hbase file locations. Probably, that super.getConf() is the problem. In any case

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Xiaoxiao Wang
I'm trying out on the mapreduce application, I made it work on my toy application On Wed, Feb 20, 2019 at 4:09 PM William Shen wrote: > A bit of a long shot, but do you happen to have another hbase-site.xml > bundled in your jar accidentally that might be overriding what is on the > classpath? >

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread William Shen
Whatever is in super.getConf() should get overriden by hbase-site.xml because addHbaseResources because will layer on hbase-site.xml last. The question is which one got picked up... (maybe there is another one on the classpath, is that possible?) On Wed, Feb 20, 2019 at 4:10 PM Xiaoxiao Wang wrot

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Xiaoxiao Wang
i made this work on my toy application, getConf() is not an issue, and hbase conf can get the correct settings I'm trying out again on the real application On Wed, Feb 20, 2019 at 4:13 PM William Shen wrote: > Whatever is in super.getConf() should get overriden by hbase-site.xml > because addHb

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Xiaoxiao Wang
Since I've known that the configuration have been loaded up correctly through the classpath I have tested on the real application, however, it still timed out with the same default value from the mappers Error: java.io.IOException: org.apache.phoenix.exception.PhoenixIOException: Failed after att

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Xiaoxiao Wang
Pedro to answer your question, I have verified that the configuration file has loaded correctly from the classpath, I have 300+ mappers try to make connections to the db at the same time, and it still gives me the same error that timeout at after 6 ms On Wed, Feb 20, 2019 at 4:45 PM Xiaoxiao

Re: How Phoenix JDBC connection get hbase configuration

2019-02-20 Thread Xiaoxiao Wang
Thanks for all your help I think I have found out the issue that all over mappers have HADOOP_CLASSPATH overwritten in hadoop_env.sh :( On Wed, Feb 20, 2019 at 4:50 PM Xiaoxiao Wang wrote: > Pedro > > to answer your question, I have verified that the configuration file has > loaded correctly fr

[jira] [Created] (PHOENIX-5153) Fix release audit warnings

2019-02-20 Thread Artem Ervits (JIRA)
Artem Ervits created PHOENIX-5153: - Summary: Fix release audit warnings Key: PHOENIX-5153 URL: https://issues.apache.org/jira/browse/PHOENIX-5153 Project: Phoenix Issue Type: Task Affect

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

How to map phoenix field to hbase timestamp of column family?

2019-02-20 Thread 吴少
In some scenarios, one general Phoenix field need to be mapped to the timestamp of the HBase column family. If so ,I can read and write HBase's timestamp . Any one can help me?

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

[jira] [Updated] (PHOENIX-5153) Fix release audit warnings

2019-02-20 Thread Artem Ervits (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artem Ervits updated PHOENIX-5153: -- Attachment: PHOENIX-5153.patch > Fix release audit warnings > --- >

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

[jira] [Assigned] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei reassigned PHOENIX-5148: - Assignee: chenglei > Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScan

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Fix Version/s: 4.15.0 > Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p

[jira] [Updated] (PHOENIX-5148) Improve OrderPreservingTracker to optimize OrderBy/GroupBy for ClientScanPlan and ClientAggregatePlan

2019-02-20 Thread chenglei (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenglei updated PHOENIX-5148: -- Description: Given a table {code:java} create table test ( pk1 varchar not null , p