Re: schedule data ingestion to hive table using ftp

Hi, > So, I want to schedule data ingestion to hive from ftp. I have to >schedule a job to check for files that are getting generated and when >they get generated, move it to hdfs. There is no ³best² way unfortunately. The options start with Apache Oozie, the bog standard solution. Then there¹s

Re: ApacheCON EU HBase Track Submissions

Get your submissions in, the deadline is imminent! On Thu, Jun 25, 2015 at 11:30 AM, Nick Dimiduk wrote: > Hello developers, users, speakers, > > As part of ApacheCON's inaugural "Apache: Big Data", I'm hoping to see a > "HBase: NoSQL + SQL" track come together. The idea is to showcase the > gro

RE: Hive indexing optimization

Thank you, I will do that. B Subject: Re: Hive indexing optimization From: jpullokka...@hortonworks.com To: user@hive.apache.org Date: Tue, 30 Jun 2015 18:46:50 + Index doesn’t seems to be kicking in this case. Please file a bug for this. Thanks John From: Bennie Leo Reply-To:

schedule data ingestion to hive table using ftp

Maybe this is not exactly a question for hive user group, however I do not know of any other better place. So, I want to schedule data ingestion to hive from ftp. I have to schedule a job to check for files that are getting generated and when they get generated, move it to hdfs. Can anyone sugges

alter table on multiple partitions

Hi, I have a table partitioned by a, b, c, d column. I want to alter concatenate this table. Is it possible to use wildcard in alter command to alter several partitions at a time? For ex. alter table TestHive partition (a=1, b=*, c=2, d=*) CONCATENATE; BR, Patcharee

Re: Hive indexing optimization

Index doesn’t seems to be kicking in this case. Please file a bug for this. Thanks John From: Bennie Leo mailto:tben...@hotmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Monday, June 29, 2015 at 5:25 PM To: "user@hive.apache.org

Re: fails to alter table concatenate

Move to user@hive. BCC’ed user@tez. — Hitesh On Jun 30, 2015, at 1:44 AM, patcharee wrote: > Hi, > > I am using hive 0.14 + tez 0.5. It fails to alter table concatenate > occasionally (see the exception below). It is strange that it fails from time > to time not predictable. However, it wor

Re: Can't access file in Distributed Cache in Hive 1.1.0

Hi Try "set hive.fetch.task.conversion=minimal;" in hive cli to get an MR job rather than a local fetch task. hth Gabriel Balan On 6/30/2015 5:22 AM, Zsolt Tóth wrote: Thank you for your answer. The plans are identical for Hive 1.0.0 and Hive 1.1.0. You're right, Hive-1.1.0 does not start a

Re: Show table in Spark

please check on spark userlist. I don't think its related to hive On Tue, Jun 30, 2015 at 4:42 PM, Vinod Kuamr wrote: > Hi Folks, > > Can anyone please let me know how to show content of dataframe in spark? > > when I using *dt.show()* ( here df is dataframe) I am getting following > result > >

Show table in Spark

Hi Folks, Can anyone please let me know how to show content of dataframe in spark? when I using dt.show() ( here df is dataframe) I am getting following result I am using Scala version 1.3.1 in windows 8 Thanks in advance,Vinod

Re: Can't access file in Distributed Cache in Hive 1.1.0

Thank you for your answer. The plans are identical for Hive 1.0.0 and Hive 1.1.0. You're right, Hive-1.1.0 does not start a MapReduce job for the query, while Hive-1.0.0 does. Should I file a JIRA for this issue? 2015-05-07 21:17 GMT+02:00 Jason Dere : > Is this on Hive CLI, or using HiveServer

Re: fails to alter table concatenate

Actually it works on mr. So the problem is from tez. thanks! BR, Patcharee On 30. juni 2015 10:23, Nitin Pawar wrote: can you try doing same by changing the query engine from tez to mr1? not sure if its hive bug or tez bug On Tue, Jun 30, 2015 at 1:46 PM, patcharee

Re: fails to alter table concatenate

can you try doing same by changing the query engine from tez to mr1? not sure if its hive bug or tez bug On Tue, Jun 30, 2015 at 1:46 PM, patcharee wrote: > Hi, > > I am using hive 0.14. It fails to alter table concatenate occasionally > (see the exception below). It is strange that it fails fro

fails to alter table concatenate

Hi, I am using hive 0.14. It fails to alter table concatenate occasionally (see the exception below). It is strange that it fails from time to time not predictable. Is there any suggestion/clue? hive> alter table 4dim partition(zone=2,z=15,year=2005,month=4) CONCATENATE; -