Re: unsubscribe

Yijing Bai, to unsubscribe please send a message to user-unsubscr...@hive.apache.org as described here: Mailing Lists . Thanks. -- Lefty On Mon, Aug 24, 2015 at 11:49 PM, Yijing Bai wrote: > > > -- > Yijing Bai > Sent with Airmail >

Re: Loading multiple file format in hive

If I write to staging area and then run job to convert this data to parquet , there wont be delay of this much time? mean to say this data wont be available to hive until it converts to parquet and write to hive location? On Tue, Aug 25, 2015 at 11:53 AM, Nitin Pawar wrote: > Is it possible f

Re: Loading multiple file format in hive

Is it possible for you to write the data into staging area and run a job on that and then convert ito paraquet table ? so you are looking to have two table .. one temp for holding data till 15mins and then your job loads this temp data to to your parquet backed table sorry for my misunderstanding

Re: Data Deleted on Hive External Table

Hi Peyman I created a new Hive external table with partition column name of 'yr' instead of 'year' pointing to the same base directory. if this is a case how come /user/hive/warehouse having the data? it should not right? On Tue, Aug 25, 2015 at 4:41 AM, Peyman Mohajerian wrote: > Hi Guys, > >

Re: Loading multiple file format in hive

Thanks Nitin for reply. I have data coming from RabbitMQ and i have spark streaming API which take this events and dump into HDFS. I cant really convert data events to some format like parquet/orc because I dont have schema here. Once I dump to HDFS i am writing one job which read this data and c

Re: Loading multiple file format in hive

file formats in a hive is a table level property. I am not sure why would you have data at 15mins interval to your actual table instead of a staging table and do the conversion or have the raw file in the format you want and load it directly into table On Tue, Aug 25, 2015 at 11:27 AM, Jeetendra G

Re: Loading multiple file format in hive

I tried searching how to set multiple format with multiple partitions , could not find much detail. Can please share some good material around this if you have any. On Mon, Aug 24, 2015 at 10:49 PM, Daniel Haviv < daniel.ha...@veracity-group.com> wrote: > Hi, > You can set a different file format

unsubscribe

--  Yijing Bai Sent with Airmail

Re: CBO - get cost of the plan

Ah okay. Thanks a lot! Now I can get non-default values after collecting table level stats. "CalciteOptimizedPlan" looks like this: HiveProject(a_day=[$4], a_product=[$5], b_alternate=[$2], total_sales=[+(+($6, $3), $9)]): rowcount = 6.112516920555744E9, cumulative cost = {3.8838122487221785E7 r

Re: Request write access to the Hive wiki

Done. Welcome to Hive! On Mon, Aug 24, 2015 at 7:09 PM, Jia, Ke A wrote: > Hi, > > I’d like to have write access to the Hive wiki. My Confluence username is > ke.a@intel.com with Full Name “Jia Ke”. Please help me deal with it. > Thank you! > > > > Regards, > > Jia Ke > > >

Request write access to the Hive wiki

Hi, I'd like to have write access to the Hive wiki. My Confluence username is ke.a@intel.com with Full Name "Jia Ke". Please help me deal with it. Thank you! Regards, Jia Ke

Request write access to the Hive wiki

Hi, I'd like to have write access to the Hive wiki. My Confluence username is jia.a...@intel.com with Full Name "Jia Ke". Please help me deal with it. Thank you! Regards, Jia Ke

Re: CBO - get cost of the plan

>From the text below it seems like you are not collecting table level stats. You can collect table level stats by following analyze table compute statistics; Thanks John On 8/24/15, 6:24 PM, "Raajay" wrote: >Hi John, > >I am on Hive-2.0.0. I forked of the Hive master branch 2 weeks back >(

Re: CBO - get cost of the plan

Hi John, I am on Hive-2.0.0. I forked of the Hive master branch 2 weeks back (commit id: 763cb02b5eafb0ecd3fd0eb512636a1b092df671). I actually have "analyze" before I execute the query. I left it out for brevity. Please find the entire query (sent to hive in a file) below. Without the analyze co

Re: CBO - get cost of the plan

In addition to col stats you also need table stats. From: John Pullokkaran mailto:jpullokka...@hortonworks.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Monday, August 24, 2015 at 5:23 PM To: "user@hive.apache.org

Re: CBO - get cost of the plan

Raajay, You don't have col stats hence it assumes 1 for row count. What version of Hive are you on? Thanks John From: Raajay mailto:raaja...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Monday, August 24, 2015 at 5:19 PM To: "

CBO - get cost of the plan

Hello, I am interested to get the cost of the query plans as calculated by the CBO. How can I get that information ? For example, consider a query with a three way join of the following form: Query = insert overwrite table output_tab select a_day, a_product, b_alternate, (a_sales + b_sales +

Data Deleted on Hive External Table

Hi Guys, I managed to delete some data in HDFS by dropping a partitioned external Hive table. One explanation is that data resided in the 'warehouse' directory of Hive and that had something to do with? An alternative explanation may that my 'drop table' statement didn't delete the data but my fol

Re: Using SPLIT with DOT(.) delimiter demonstrate funny behavior within a VIEW

Hi Vivek Thanks A few more experiments  The \\ , \\\ and all work correctly if used as following  split(reverse(split(reverse(floc),'/')[0]),'[\\.]')[0]   (need those square brackets) split(reverse(split(reverse(floc),'/')[0]),'\\\.')[0]  (does not need square brackets) split(reverse(split(r

Re: Using SPLIT with DOT(.) delimiter demonstrate funny behavior within a VIEW

Hi Sanjay, Try replacing the 4 backslashes with just 2. Usually works with 2 backslashes. Replace this *split(reverse(split(reverse(**floc**),'/')[0]),'.')[0]* as resid with *split(reverse(split(reverse(floc**),'/')[0]),'\\.')[0]* as resid Please have a look and let us know if that h

Regex in hive

Hi All I am a beginner in hive And I am using '^O' with rlike, but it doesn't seem to be workingI am using hive 1.2.0. Please help thanksrakesh

Using SPLIT with DOT(.) delimiter demonstrate funny behavior within a VIEW

Hi guys I am using Hive version = 0.13.1-cdh5.3.3 HIVE TABLE =  qnap_resume_file_location---DROP  TABLE IF EXISTS      qnap_resume_file_location;CREATE EXTERNAL TABLE qnap_resume_file_location ( floc STRING     ) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' 

Re: HiveServer2 & Kerberos

If that is the case it sounds like a bug… From: Jary Du mailto:jary...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Thursday, August 20, 2015 at 08:56 To: "user@hive.apache.org" mailto:user@hive.apache.

Re: Loading multiple file format in hive

Hi, You can set a different file format per partition. You can't mix files in the same directory (You could theoretically write some kind of custom SerDe). Daniel. On Mon, Aug 24, 2015 at 6:15 PM, Jeetendra G wrote: > Can anyone put some light on this please? > > On Mon, Aug 24, 2015 at 12:32

Re: Hive Concurrency support

Are you using a lock manager, and if so which one? I believe the ZooKeeper lock manager does not allow simultaneous writes. The lock manager that comes with the DbTxnManager does, but you can't use that without also using transactions. Alan. Suyog Parlikar

Re: Unsubscribe

To unsbuscribe send email to user-unsubscr...@hive.apache.org Alan. Nurdan Ahat August 24, 2015 at 6:38

Re: Unsubscribe

UnSubscribe On Sun, Aug 23, 2015 at 10:36 AM, Daniel Rijo wrote: > I sent an email to unsubscribe but nothing happened. > -- Mohit Garg 9717040694

Re: Loading multiple file format in hive

Can anyone put some light on this please? On Mon, Aug 24, 2015 at 12:32 PM, Jeetendra G wrote: > HI All, > > I have a directory where I have json formatted and parquet files in same > folder. can hive load these? > > I am getting Json data and storing in HDFS. later I am running job to > convert

Re: Hive Concurrency support

No table is not transactional On Aug 24, 2015 10:30 AM, "Elliot West" wrote: > Is the table configured to be transactional? > > > https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-TableProperties > > On Monday, 24 August 2015, Suyog Parlikar wrote: > >> Hello El

Re: Unsubscribe

I want to unsubscribe too. On 24 August 2015 at 15:38, Nurdan Ahat wrote: > >

Unsubscribe

Loading multiple file format in hive

HI All, I have a directory where I have json formatted and parquet files in same folder. can hive load these? I am getting Json data and storing in HDFS. later I am running job to convert JSon to Parquet(every 15 mins). so we will habe 15 mins Json data. Can i provide multiple serde in hive? re