Please check another mail i sent right after that. my bad had hit send button too soon without reading the mail.
I will rephrase In hive to process the data, you will need the table created and data loaded to the table. You can not process a file without loading it into a table. If you want to do that and do not want to create a temporary table in hive with full columns from file then options available to you are 1) simple unix tools like awk or sed or cut 2) write a pig script 3) write your own mapreduce code On Wed, Jul 30, 2014 at 3:09 PM, CHEBARO Abdallah < abdallah.cheb...@murex.com> wrote: > “With hive, without creating a table with full data, you can do > intermediate processing like select only few columns and write into another > table”. How can I do this process? > > > > Thank you alot! > > > > *From:* Nitin Pawar [mailto:nitinpawar...@gmail.com] > *Sent:* Wednesday, July 30, 2014 12:37 PM > > *To:* user@hive.apache.org > *Subject:* Re: SELECT specific data > > > > sorry hit send too soon .. > > I mean without creating intermediate tables, in hive you can process the > file directly > > > > On Wed, Jul 30, 2014 at 3:06 PM, Nitin Pawar <nitinpawar...@gmail.com> > wrote: > > With hive, without creating a table with full data, you can do > intermediate processing like select only few columns and write into another > table, > > > > If this is something one time then you can take a look at awk or cut > commands in linux and generate those files only. > > > > On Wed, Jul 30, 2014 at 2:49 PM, CHEBARO Abdallah < > abdallah.cheb...@murex.com> wrote: > > I am only using Hive and hadoop, nothing more. > > > > *From:* Devopam Mittra [mailto:devo...@gmail.com] > *Sent:* Wednesday, July 30, 2014 12:15 PM > > > *To:* user@hive.apache.org > *Subject:* Re: SELECT specific data > > > > Are you using any tool to load data ? If yes, then the ETL tool will > provide you such options. > > If not, then please explore unix file processing/external table route. > > > > On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah < > abdallah.cheb...@murex.com> wrote: > > Hello, > > > > Thank you for your reply. > > > > Consider we have data divided into 5 columns (col1, col2, col3, col4, > col5). > > So I can’t load directly col1, col3 and col5? > > If I can’t do it directly, can you provide me with an alternate solution? > > > > Thank you. > > > > *From:* Nitin Pawar [mailto:nitinpawar...@gmail.com] > *Sent:* Wednesday, July 30, 2014 11:37 AM > *To:* user@hive.apache.org > *Subject:* Re: SELECT specific data > > > > you mean just by writing query then I think no. > > > > But if you want to read only first 3 columns of the data then it would > work with just a single table and load data into > > > > On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah < > abdallah.cheb...@murex.com> wrote: > > Hello, > > > > I am interested in selecting specific data from a source and loading it to > a table. For example, if I have 5 columns in my dataset, I want to load 3 > columns of it. Is it possible to do it without create a second table? > > > > Thank you > > ******************************* > > This e-mail contains information for the intended recipient only. It may > contain proprietary material or confidential information. If you are not > the intended recipient you are not authorised to distribute, copy or use > this e-mail or any attachment to it. Murex cannot guarantee that it is > virus free and accepts no responsibility for any loss or damage arising > from its use. If you have received this e-mail in error please notify > immediately the sender and delete the original email received, any > attachments and all copies from your system. > > > > > > -- > Nitin Pawar > > ******************************* > > This e-mail contains information for the intended recipient only. It may > contain proprietary material or confidential information. If you are not > the intended recipient you are not authorised to distribute, copy or use > this e-mail or any attachment to it. Murex cannot guarantee that it is > virus free and accepts no responsibility for any loss or damage arising > from its use. If you have received this e-mail in error please notify > immediately the sender and delete the original email received, any > attachments and all copies from your system. > > > > > > -- > Devopam Mittra > Life and Relations are not binary > > ******************************* > > This e-mail contains information for the intended recipient only. It may > contain proprietary material or confidential information. If you are not > the intended recipient you are not authorised to distribute, copy or use > this e-mail or any attachment to it. Murex cannot guarantee that it is > virus free and accepts no responsibility for any loss or damage arising > from its use. If you have received this e-mail in error please notify > immediately the sender and delete the original email received, any > attachments and all copies from your system. > > > > > > -- > Nitin Pawar > > > > > > -- > Nitin Pawar > > ******************************* > > This e-mail contains information for the intended recipient only. It may > contain proprietary material or confidential information. If you are not > the intended recipient you are not authorised to distribute, copy or use > this e-mail or any attachment to it. Murex cannot guarantee that it is > virus free and accepts no responsibility for any loss or damage arising > from its use. If you have received this e-mail in error please notify > immediately the sender and delete the original email received, any > attachments and all copies from your system. > -- Nitin Pawar
