Re: Need inputs on configuring hive timeout + hive on spark : Job hasn't been submitted after 61s. Aborting it.

2017-02-18 Thread Ian Cook
Naresh, The properties hive.spark.job.monitor.timeout and hive.spark.client.server. connect.timeout in hive-site.xml control Hive on Spark timeouts. Details at https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Spark Ian Cook Cloudera On Thu, Feb

Write access to Hive wiki please

2016-09-21 Thread Ian Cook
Hello, Could I please have write access to the Hive wiki so that I can help with fixes? My Confluence username is *icook*. Thanks, Ian Cook Cloudera

Hive parallel orderby doc

2014-08-24 Thread Ian
Hive 0.12 has added Parallel Order by. Is there a doc or sample on how to use that?  Thanks.

RE: Hive on Windows w/Hadoop 2.2.0

2014-02-05 Thread Ian Jackson
wrote: HDP runs on Windows: http://hortonworks.com/products/hdp-windows/#install I don't know if it uses Cygwin or not but everything needed to run Hive on Windows should be in the install package. Eric From: Ian Jackson [mailto:ian_jack...@trilliumsoftware.commailto:ian_jack

Hive on Windows w/Hadoop 2.2.0

2014-02-04 Thread Ian Jackson
Reading the Wiki (cwiki.apache.org/confluence/display/Hive/GettingStarted), it states It does not work on Cygwin. Do further details exist or hints to make work on Windows?

Re: Partition performance

2013-04-11 Thread Ian
is only handling a small file.   It takes a lot of time before it actually submits the job. So maybe querying  the metastore for partition info takes time?   From: Ramki Palle ramki.pa...@gmail.com To: user@hive.apache.org; Ian liu...@yahoo.com Sent: Friday, April

Re: Partition performance

2013-04-05 Thread Ian
your points of view and experiences Thanks sanjay From: Ian liu...@yahoo.com Reply-To: user@hive.apache.org user@hive.apache.org, Ian liu...@yahoo.com Date: Thursday, April 4, 2013 4:01 PM To: user@hive.apache.org user@hive.apache.org Subject: Partition performance Hi, I created 3

Partition performance

2013-04-04 Thread Ian
Hi,   I created 3 years of hourly log files (totally 26280 files), and use External Table with partition to query. I tried two partition methods.   1). Log files are stored as /test1/2013/04/02/16/00_0 (A directory per hour). Use date and hour as partition keys. Add 3 years of directories to

External table for hourly log files

2013-03-28 Thread Ian
Hi,   We use Hive Insert Overwrite Directory to copy the hourly logs to hdfs. So there are lots of directories like these:     /my/logs/2013-03-08/01/00_0/my/logs/2013-03-08/02/00_0 /my/logs/2013-03-08/03/00_0     ...   Now we want to create external table to query the log

Re: External table for hourly log files

2013-03-28 Thread Ian
@hive.apache.org; Ian liu...@yahoo.com Sent: Thursday, March 28, 2013 10:41 AM Subject: Re: External table for hourly log files Hi  You may want to look at Dynamic partitions https://cwiki.apache.org/Hive/dynamicpartitions.html Thanks sanjay From: Ian liu...@yahoo.com Reply-To: user