RE: Hive output file 000000_0

2018-08-08 Thread Ryan Harris
AM To: user@hive.apache.org Subject: Re: Hive output file 00_0 Indeed, if your table is big, then you DO want to parallelise and setting the number of reducers to 1 is clearly not a good idea. From what you explained, I still don't understand what your

Re: Hive output file 000000_0

2018-08-08 Thread Furcy Pin
n the solution is simple, God is answering…" * > > > > *From:* Furcy Pin > *Sent:* 08 August 2018 PM 06:37 > *To:* user@hive.apache.org > *Subject:* Re: Hive output file 00_0 > > > > *EXTERNAL* > > It might sound silly, but isn't it what Hive

RE: Hive output file 000000_0

2018-08-08 Thread Sujeet Pardeshi
, Cybercity, Magarpatta, Hadapsar Pune, Maharashtra, 411 013 off: +91-20-30418810 [Description: untitled] "When the solution is simple, God is answering…" From: Furcy Pin Sent: 08 August 2018 PM 06:37 To: user@hive.apache.org Subject: Re: Hive output file 00_0 EXTERNAL It might s

Re: Hive output file 000000_0

2018-08-08 Thread Furcy Pin
TABLE ${SCHEMA_NM}.daily_summary; > > Regards, > Sujeet Singh Pardeshi > Software Specialist > SAS Research and Development (India) Pvt. Ltd. > Level 2A and Level 3, Cybercity, Magarpatta, Hadapsar Pune, Maharashtra, > 411 013 > off: +91-20-30418810 > > "W

RE: Hive output file 000000_0

2018-08-08 Thread Sujeet Pardeshi
g…"  -Original Message- From: Deepak Jaiswal Sent: 07 August 2018 PM 11:19 To: user@hive.apache.org Subject: Re: Hive output file 00_0 EXTERNAL Hi Sujeet, I am assuming that the table is bucketed? If so, then the name represents which bucket the file belongs to as Hive creates 1

Re: Hive output file 000000_0

2018-08-07 Thread Deepak Jaiswal
Hi Sujeet, I am assuming that the table is bucketed? If so, then the name represents which bucket the file belongs to as Hive creates 1 file per bucket for each operation. In this case, the file 03_0 belongs to bucket 3. To always have files named 00_0, the table must be unbucketed. I ho