Re: Rolling hourly data

2018-11-27 Thread Monil Gandhi
Thanks much for the response. I don’t think Phoenix does roll ups or at least the version we are using. We are constrained by emr on aws which is on 4.14 Thomas - what I meant was I want to write a mr job or “update value” query for all of the sids and there are about 200k different values. It wou

Re: client does not have phoenix.schema.isNamespaceMappingEnabled

2018-11-27 Thread Josh Elser
To add a non-jar file to the classpath of a Java application, you must add the directory containing that file to the classpath. Thus, the following is wrong: HADOOP_CLASSPATH=/usr/hdp/3.0.1.0-187/hbase/lib/hbase-protocol.jar:/etc/hbase/3.0.1.0-187/0/hbase-site.xml And should be: HADOOP_CLASS

Re: JDBC Connection URL to Phoenix on Azure HDInsight

2018-11-27 Thread Josh Elser
Are you trying to use the thick driver (direct HBase connection) or the thin driver (via Phoenix Query Server)? You're providing examples of both. If the thick driver: by default, I believe that HDI configures a root znode of "/hbase" not "/hbase-unsecure" which would be a problem. You need to

Re: Heap Size Recommendation

2018-11-27 Thread Josh Elser
HBASE_HEAPSIZE is just an environment variable which sets the JVM heap size. Your question doesn't make any sense to me. On 11/16/18 8:44 AM, Azharuddin Shaikh wrote: Hi All, We want to improve the read performance of phoenix query for which we are trying to upgrade the HBASE_HEAPSIZE. Curr

client does not have phoenix.schema.isNamespaceMappingEnabled

2018-11-27 Thread M. Aaron Bossert
Folks, I have, I believe, followed all the directions for turning on namespace mapping as well as extra steps to (added classpath) required to use the mapreduce bulk load utility, but am still running into this error...I am running a Hortonworks cluster with both HDP v 3.0.1 and HDF components. He

JDBC Connection URL to Phoenix on Azure HDInsight

2018-11-27 Thread Raghavendra Channarayappa
Dear all, My current problem is fairly trivial, i guess, but I am currently stuck on this. The following was the JDBC connection string for Phoenix on EMR jdbc:phoenix:thin:url=http://ec2-12-345-678-90.ap-southeast-1.compute.amazonaws.com:8765;serialization=PROTOBUF;autocommit=true which worked

Re: JDBC Connection URL to Phoenix on Azure HDInsight

2018-11-27 Thread Raghavendra Channarayappa
+Samya Ghosh On Tue, Nov 27, 2018 at 6:24 PM Raghavendra Channarayappa < raghavendra.channaraya...@myntra.com> wrote: > Dear all, > > My current problem is fairly trivial, i guess, but I am currently stuck on > this. > > The following was the JDBC connection string for Phoenix on EMR > > jdbc:ph

Re: Rolling hourly data

2018-11-27 Thread Jonathan Leech
I would try writing the hourly values as 24 columns in a daily row, or as an array type. I’m not up to speed on the latest Phoenix features, but if it could update a daily sum on the fly that might be ok. If that doesn’t exist yet or isn’t performant, it could be done in an Hbase coprocessor.