Re: Re: Impala Java API

2017-08-03 Thread Silvius Rus
I'm not sure what you mean by "cached" data. Check out the docs. You can run these commands as JDBC statements. http://impala.apache.org/docs/build/html/topics/impala_refresh.html#refresh http://impala.apache.org/docs/build/html/topics/impala_invalidate_metadata.html#invalidate_metadata On Thu,

Impala Sorter just sort small partition?

2017-08-03 Thread 俊杰陈
Hi I'm looking Sorter.cc and found that Sorter::SortHelper just sort smaller partition. Is there anything I missed? -- Thanks & Best Regards

Re: Loading tpc-ds

2017-08-03 Thread Jim Apple
When I saw this, there was a "FATAL" in hive.log, so perhaps they are different. https://issues.apache.org/jira/browse/IMPALA-5663 https://jenkins.impala.io/job/ubuntu-14.04-from-scratch/1827/artifact/Impala/logs_static/logs/cluster/hive/hive.log/*view*/ On Thu, Aug 3, 2017 at 9:09 PM, Matthew J

Re: Loading tpc-ds

2017-08-03 Thread Matthew Jacobs
Just saw this error again. I filed IMPALA-5765. On Mon, Jul 31, 2017 at 8:05 PM, Tim Armstrong wrote: > It looks like the same error: > > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: > org.apache.hadoop.ipc.RemoteException(java.io.IOException): File > /test-warehouse/tpcds.store_s

Re: Re: Impala Java API

2017-08-03 Thread zhangwenyang
Hi, Silvius there are three level refresh: clear cache, increment update metadata, invalidate metadata, 1) the data get by jdbc, is the cached data or real data? 2) how to refresh the impala data source at the three level? Thanks zhangwenyang From: Silvius Rus Date: 2017-08-03 23:47 To: de

Re: problem about buildall.sh

2017-08-03 Thread Henry Robinson
Glad to hear it - and sorry about this annoying edge case. On 3 August 2017 at 04:14, yu feng wrote: > Great ! it is finish successfully after remove glog-0.3.4-p2 and pull to > the newest commit. Thanks all of you. > > 2017-08-03 13:30 GMT+08:00 Henry Robinson : > > > I think you're hitting the

Re: Impala Java API

2017-08-03 Thread Henry Robinson
I always forget about jdbc- that would be a much better option. On Thu, Aug 3, 2017 at 8:47 AM Silvius Rus wrote: > Can you use JDBC? > > Silvius > > > On Aug 2, 2017, at 9:24 PM, Henry Robinson wrote: > > > > Impala's clients all communicate with Impala via Apache Thrift, which is > a > > seri

Re: Impala Java API

2017-08-03 Thread Silvius Rus
Can you use JDBC? Silvius > On Aug 2, 2017, at 9:24 PM, Henry Robinson wrote: > > Impala's clients all communicate with Impala via Apache Thrift, which is a > serialization and RPC format that has bindings for multiple languages. In > fact, Impala generates Thrift stubs for Java when the fronte

Re: jenkins.impala.io outage

2017-08-03 Thread Michael Brown
Update: I've restarted a GVD for https://gerrit.cloudera.org/#/c/7573/ because it fixes a broken build blocker. I have to do things to get ready for my day now, but I'll check back in a few hours. On Thu, Aug 3, 2017 at 5:13 AM, Michael Brown wrote: > Hello, > > About 6 hours ago the Jenkins ser

Re: impala is not parallelized

2017-08-03 Thread Jeszy
Also check block size. On 3 August 2017 at 14:36, 孙清孟 wrote: > I find the difference between the two clusters, the replication of HDFS in > the Normal cluster is 3, another one is 1, > and shortcircuit is enable! > > Thanks. > > 2017-08-03 15:02 GMT+08:00 孙清孟 : > >> Hi Jeszy: >> Thanks for you

Re: impala is not parallelized

2017-08-03 Thread 孙清孟
I find the difference between the two clusters, the replication of HDFS in the Normal cluster is 3, another one is 1, and shortcircuit is enable! Thanks. 2017-08-03 15:02 GMT+08:00 孙清孟 : > Hi Jeszy: > Thanks for your reply. > > On another cluster with two instances, I do the same SQL, and th

jenkins.impala.io outage

2017-08-03 Thread Michael Brown
Hello, About 6 hours ago the Jenkins server on jenkins.impala.io ran out of heap space. I've restarted Jenkins again, and several of us will get together to see what happened. I think it will probably result in a larger instance size.

Re: problem about buildall.sh

2017-08-03 Thread yu feng
Great ! it is finish successfully after remove glog-0.3.4-p2 and pull to the newest commit. Thanks all of you. 2017-08-03 13:30 GMT+08:00 Henry Robinson : > I think you're hitting the problem where you're not picking up the most > recent version of gflags. IMPALA-5659 added .so building to gflags

Re: impala is not parallelized

2017-08-03 Thread 孙清孟
Hi Jeszy: Thanks for your reply. On another cluster with two instances, I do the same SQL, and the file size is smaller : F00:PLAN FRAGMENT [RANDOM] hosts=2 instances=2 WRITE TO HDFS [default.cdr_partition_par_false, OVERWRITE=true] | partitions=1 | mem-estimate=1.00GB mem-reservation=0B |