Salting and time column

2015-09-29 Thread Sumit Nigam
Hello, I am planning on using to_number(current_time()) as my primary key along with salting enabled.  However, multiple transactions can be upserted at the same current_time(). Will salting still be able to prevent overwriting one row with another? Or do I need to postfix another column into th

Re: [ANNOUNCE] New Apache Phoenix committer - Jan Fernando

2015-09-29 Thread Jan Fernando
Thank you everyone! I am really excited to continue working on Phoenix! Thanks again, --Jan On Tue, Sep 29, 2015 at 4:38 PM, rajeshb...@apache.org < chrajeshbab...@gmail.com> wrote: > Congratulations Jan!!! > > Thanks, > Rajeshbabu. > On Sep 30, 2015 4:37 AM, "James Taylor" wrote: > >> Welcome,

Re: [ANNOUNCE] New Apache Phoenix committer - Jan Fernando

2015-09-29 Thread rajeshb...@apache.org
Congratulations Jan!!! Thanks, Rajeshbabu. On Sep 30, 2015 4:37 AM, "James Taylor" wrote: > Welcome, Jan. Great to have you onboard as a committer! > > James > > On Tuesday, September 29, 2015, Andrew Purtell > wrote: > >> Congratulations Jan, and welcome! >> >> >> On Tue, Sep 29, 2015 at 11:23

Re: [ANNOUNCE] New Apache Phoenix committer - Jan Fernando

2015-09-29 Thread James Taylor
Welcome, Jan. Great to have you onboard as a committer! James On Tuesday, September 29, 2015, Andrew Purtell wrote: > Congratulations Jan, and welcome! > > > On Tue, Sep 29, 2015 at 11:23 AM, Eli Levine > wrote: > > > On behalf of the Apache Phoenix project I am happy to welcome Jan > Fernando

Re: [ANNOUNCE] New Apache Phoenix committer - Jan Fernando

2015-09-29 Thread Andrew Purtell
Congratulations Jan, and welcome! On Tue, Sep 29, 2015 at 11:23 AM, Eli Levine wrote: > On behalf of the Apache Phoenix project I am happy to welcome Jan Fernando > as a committer. Jan has been an active user and contributor to Phoenix in > the last couple of years. Some of his major contributi

Re: integration Phoenix and Spark

2015-09-29 Thread Josh Mahonin
Make sure to double check your imports. Note the following from https://phoenix.apache.org/phoenix_spark.html import org.apache.spark.SparkContext import org.apache.spark.sql.SQLContext import org.apache.phoenix.spark._ There's also a sample repository here: https://github.com/jmahonin/spark-g

Re: Error with union all and a hint

2015-09-29 Thread Alicia Shu
Great. Thanks. Alicia From: Gašper Metelko mailto:gasper.mete...@salviol.com>> Reply-To: "user@phoenix.apache.org" mailto:user@phoenix.apache.org>> Date: Tuesday, September 29, 2015 at 2:50 AM To: "user@phoenix.apache.org" mailto:

Re: [ANNOUNCE] New Apache Phoenix committer - Jan Fernando

2015-09-29 Thread Cody Marcel
Sweet! Congrats Jan. On Tue, Sep 29, 2015 at 11:23 AM, Eli Levine wrote: > On behalf of the Apache Phoenix project I am happy to welcome Jan Fernando > as a committer. Jan has been an active user and contributor to Phoenix in > the last couple of years. Some of his major contributions are: > 1)

Re: [ANNOUNCE] New Apache Phoenix committer - Jan Fernando

2015-09-29 Thread Thomas D'Silva
Congrats Jan! On Tue, Sep 29, 2015 at 11:23 AM, Eli Levine wrote: > On behalf of the Apache Phoenix project I am happy to welcome Jan Fernando > as a committer. Jan has been an active user and contributor to Phoenix in > the last couple of years. Some of his major contributions are: > 1) Worked d

[ANNOUNCE] New Apache Phoenix committer - Jan Fernando

2015-09-29 Thread Eli Levine
On behalf of the Apache Phoenix project I am happy to welcome Jan Fernando as a committer. Jan has been an active user and contributor to Phoenix in the last couple of years. Some of his major contributions are: 1) Worked deeply in the sequence code including implementing Bulk Sequence Allocation:

RE: Error with union all and a hint

2015-09-29 Thread Gašper Metelko
I have created the jira PHOENIX-2295. Running the query without the hint, executes the statment with a full table scan: 0: jdbc:phoenix:localhost> explain SELECT col1, col2 FROM table1 WHERE col1='123'; +-

Re: integration Phoenix and Spark

2015-09-29 Thread Hardika Catur Sapta
/spark/Project Spark$ scala SavingPhoenix.scala /home/hduser/spark/Project Spark/SavingPhoenix.scala:1: error: object spark is not a member of package phoenix.org.apache import phoenix.org.apache.spark.SparkContext ^ /home/hduser/spark/Project Spark/SavingPhoenix.scala:4:

Re: integration Phoenix and Spark

2015-09-29 Thread Konstantinos Kougios
Hi, Just to add that, at least for hadoop-2.7.1 and phoenix 4.5.2-HBase-1.1, hadoop guava lib has to be patched to 14.0.1 (under hadoop/share/hadoop/common/lib) otherwise spark tasks might fail due to missing guava methods. Cheers On 29/09/15 10:17, Hardika Catur Sapta wrote: Spa

a good hbase config to work with phoenix and very large tables

2015-09-29 Thread Konstantinos Kougios
Hi, anyone wants to share a good config that will work for not-so-fast clusters (7200rpm disks) and very large tables? I got a cluster of 3x region servers on lxc-virtual boxes on a 16-core machine with 3x7200rpm disks. Each region server runs on a virtual box using one of the disks and with X

integration Phoenix and Spark

2015-09-29 Thread Hardika Catur Sapta
Spark setup 1. Ensure that all requisite Phoenix / HBase platform dependencies are available on the classpath for the Spark executors and drivers 2. One method is to add the phoenix-4.4.0-client.jar to ‘SPARK_CLASSPATH’ in spark-env.sh, or setting both ‘spark.executor. 3.

issue when creating index for a large table

2015-09-29 Thread Konstantinos Kougios
I got a table "words" which is 200GB on a not-so-fast cluster, 7200rpm disks. 0: jdbc:phoenix:nn.lan> create index IX_WORDS on words(word); 15/09/29 10:04:48 WARN client.AsyncProcess: #1, table=IX_WORDS, attempt=1/1 failed=80ops, last exception: null on d3.lan,16020,1443514600886, tracking sta

client.ScannerCallable: Ignore, probably already closed, Name: 3085, already closed?

2015-09-29 Thread Konstantinos Kougios
Hi, I am running a query that takes a long time, via sqlline.py, but I am repeatedly getting 15/09/29 08:54:27 WARN client.ScannerCallable: Ignore, probably already closed org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.hbase.UnknownScannerException: Name: 3085, already clos

Re: Error with union all and a hint

2015-09-29 Thread Alicia Shu
By default if there is an index defined for a table, the index will be used if the plan with the index is better. Please file a Jira for the NPE. Thanks, Alicia From: Gašper Metelko mailto:gasper.mete...@salviol.com>> Reply-To: "user@phoenix.apache.org" mailto:u

Phoenix vs. Kudu performance

2015-09-29 Thread ALEX K
interesting comparison of Impala/Kudu vs. Hbase/Phoenix (section 6.3): http://getkudu.io/kudu.pdf