hi All, I just realized that phoneix doesn't provide "group by" and "distinct" methods if we use phoenix map reduce. It seems below approach uses phoenix map reduce which is not suitable for this type of queries.
Now I wanted to run below query by any means. My table has more than 70 million records and I could not run it either using "sqlline.py" and also tried to run it using "squirl" as well as using simple phoenix jdbc connection from a java program. In all three I was getting connection timeout error. I tried to increase various timeouts in Hbase (hbase.rpc.timeout -> 3660000, I even checked my hbase file path using "./phoenix_utils.py | grep hbase_conf_path") but no luck. I am ok if my query takes more time but I wanted to run it successfully without any issue. HBase - 1.1.2.2.4.2.0-258 Phoenix - phoenix-4.4.0.2.4.2.0-258 Can any one provide any suggestion ? Regards, Parveen Jain ________________________________ From: Parveen Jain <parveenj...@live.com> Sent: Sunday, October 23, 2016 10:18 AM To: user@phoenix.apache.org Subject: PhoenixIOException: Table 'unionSchemaName.unionTableName' was not found While running this query from spark phoenix connector: select distinct(C_TXN.CUSTMR_ID) from CUS_TXN where (CUS_TXN.TXN_TYPE='xxxx') and (substr(CUS_TXN.ROW_KEY,0,8)>='20160101') group by CUS_TXN.CUSTMR_ID having sum(CUS_TXN.TXN_AMOUNT)>=300 union all select distinct(CUS_TXN.CUSTMR_ID) from CUS_TXN where (CUS_TXN.TXN_TYPE='yyyy') and (substr(CUS_TXN.ROW_KEY,0,8)>='20160101') group by CUS_TXN.CUSTMR_ID having sum(CUS_TXN.TXN_AMOUNT)>100 getting below exception: Getting some phoenix exception for below query: java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixIOException: Table 'unionSchemaName.unionTableName' was not found, got: hbase:namespace. at com.google.common.base.Throwables.propagate(Throwables.java:160) at org.apache.phoenix.mapreduce.PhoenixRecordReader.initialize(Phoen my code for fetching records is: PhoenixConfigurationUtil.setInputTableName(configuration , TABLE_NAME); PhoenixConfigurationUtil.setOutputTableName(configuration ,TABLE_NAME); PhoenixConfigurationUtil.setInputQuery(configuration, QueryToRun); PhoenixConfigurationUtil.setInputClass(configuration, DataRecord.class); configuration.setClass(JobContext.OUTPUT_FORMAT_CLASS_ATTR,PhoenixOutputFormat.class, OutputFormat.class); @SuppressWarnings("unchecked") JavaPairRDD<NullWritable, DataRecord> stocksRDD = jsc.newAPIHadoopRDD( configuration, PhoenixInputFormat.class, NullWritable.class, DataRecord.class); Regards, Parveen Jain Any pointer why this could be happening. Regards, Parveen Jain