sorry hit send too soon .. I mean without creating intermediate tables, in hive you can process the file directly
On Wed, Jul 30, 2014 at 3:06 PM, Nitin Pawar <nitinpawar...@gmail.com> wrote: > With hive, without creating a table with full data, you can do > intermediate processing like select only few columns and write into another > table, > > If this is something one time then you can take a look at awk or cut > commands in linux and generate those files only. > > > On Wed, Jul 30, 2014 at 2:49 PM, CHEBARO Abdallah < > abdallah.cheb...@murex.com> wrote: > >> I am only using Hive and hadoop, nothing more. >> >> >> >> *From:* Devopam Mittra [mailto:devo...@gmail.com] >> *Sent:* Wednesday, July 30, 2014 12:15 PM >> >> *To:* user@hive.apache.org >> *Subject:* Re: SELECT specific data >> >> >> >> Are you using any tool to load data ? If yes, then the ETL tool will >> provide you such options. >> >> If not, then please explore unix file processing/external table route. >> >> >> >> On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah < >> abdallah.cheb...@murex.com> wrote: >> >> Hello, >> >> >> >> Thank you for your reply. >> >> >> >> Consider we have data divided into 5 columns (col1, col2, col3, col4, >> col5). >> >> So I can’t load directly col1, col3 and col5? >> >> If I can’t do it directly, can you provide me with an alternate solution? >> >> >> >> Thank you. >> >> >> >> *From:* Nitin Pawar [mailto:nitinpawar...@gmail.com] >> *Sent:* Wednesday, July 30, 2014 11:37 AM >> *To:* user@hive.apache.org >> *Subject:* Re: SELECT specific data >> >> >> >> you mean just by writing query then I think no. >> >> >> >> But if you want to read only first 3 columns of the data then it would >> work with just a single table and load data into >> >> >> >> On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah < >> abdallah.cheb...@murex.com> wrote: >> >> Hello, >> >> >> >> I am interested in selecting specific data from a source and loading it >> to a table. For example, if I have 5 columns in my dataset, I want to load >> 3 columns of it. Is it possible to do it without create a second table? >> >> >> >> Thank you >> >> ******************************* >> >> This e-mail contains information for the intended recipient only. It may >> contain proprietary material or confidential information. If you are not >> the intended recipient you are not authorised to distribute, copy or use >> this e-mail or any attachment to it. Murex cannot guarantee that it is >> virus free and accepts no responsibility for any loss or damage arising >> from its use. If you have received this e-mail in error please notify >> immediately the sender and delete the original email received, any >> attachments and all copies from your system. >> >> >> >> >> >> -- >> Nitin Pawar >> >> ******************************* >> >> This e-mail contains information for the intended recipient only. It may >> contain proprietary material or confidential information. If you are not >> the intended recipient you are not authorised to distribute, copy or use >> this e-mail or any attachment to it. Murex cannot guarantee that it is >> virus free and accepts no responsibility for any loss or damage arising >> from its use. If you have received this e-mail in error please notify >> immediately the sender and delete the original email received, any >> attachments and all copies from your system. >> >> >> >> >> >> -- >> Devopam Mittra >> Life and Relations are not binary >> >> ******************************* >> >> This e-mail contains information for the intended recipient only. It may >> contain proprietary material or confidential information. If you are not >> the intended recipient you are not authorised to distribute, copy or use >> this e-mail or any attachment to it. Murex cannot guarantee that it is >> virus free and accepts no responsibility for any loss or damage arising >> from its use. If you have received this e-mail in error please notify >> immediately the sender and delete the original email received, any >> attachments and all copies from your system. >> > > > > -- > Nitin Pawar > -- Nitin Pawar
