“With hive, without creating a table with full data, you can do intermediate processing like select only few columns and write into another table”. How can I do this process?
Thank you alot! From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Wednesday, July 30, 2014 12:37 PM To: user@hive.apache.org Subject: Re: SELECT specific data sorry hit send too soon .. I mean without creating intermediate tables, in hive you can process the file directly On Wed, Jul 30, 2014 at 3:06 PM, Nitin Pawar <nitinpawar...@gmail.com<mailto:nitinpawar...@gmail.com>> wrote: With hive, without creating a table with full data, you can do intermediate processing like select only few columns and write into another table, If this is something one time then you can take a look at awk or cut commands in linux and generate those files only. On Wed, Jul 30, 2014 at 2:49 PM, CHEBARO Abdallah <abdallah.cheb...@murex.com<mailto:abdallah.cheb...@murex.com>> wrote: I am only using Hive and hadoop, nothing more. From: Devopam Mittra [mailto:devo...@gmail.com<mailto:devo...@gmail.com>] Sent: Wednesday, July 30, 2014 12:15 PM To: user@hive.apache.org<mailto:user@hive.apache.org> Subject: Re: SELECT specific data Are you using any tool to load data ? If yes, then the ETL tool will provide you such options. If not, then please explore unix file processing/external table route. On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah <abdallah.cheb...@murex.com<mailto:abdallah.cheb...@murex.com>> wrote: Hello, Thank you for your reply. Consider we have data divided into 5 columns (col1, col2, col3, col4, col5). So I can’t load directly col1, col3 and col5? If I can’t do it directly, can you provide me with an alternate solution? Thank you. From: Nitin Pawar [mailto:nitinpawar...@gmail.com<mailto:nitinpawar...@gmail.com>] Sent: Wednesday, July 30, 2014 11:37 AM To: user@hive.apache.org<mailto:user@hive.apache.org> Subject: Re: SELECT specific data you mean just by writing query then I think no. But if you want to read only first 3 columns of the data then it would work with just a single table and load data into On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <abdallah.cheb...@murex.com<mailto:abdallah.cheb...@murex.com>> wrote: Hello, I am interested in selecting specific data from a source and loading it to a table. For example, if I have 5 columns in my dataset, I want to load 3 columns of it. Is it possible to do it without create a second table? Thank you ******************************* This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system. -- Nitin Pawar ******************************* This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system. -- Devopam Mittra Life and Relations are not binary ******************************* This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system. -- Nitin Pawar -- Nitin Pawar ******************************* This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.