: Manisha Gayathri
Date: Fri, 27 Jul 2012 11:56:57
To:
Reply-To: user@hive.apache.org
Subject: Rename an output file in hive {was: Re: Possibility of defining the
Output directory programmatically}
Hi all,
Thanks alot for your help.
With your advice, could successfully pass the needed parameters and
Hi all,
Thanks alot for your help.
With your advice, could successfully pass the needed parameters and
generate the output file as required.
In my use case, the output file needed to be a .gz file. When I run my
query with the following commands, the file that gets generated is named as
*00_0
manisha,
set is variable key value pair, it does not execute any functions
if you want to use it like that then I would recomment write a shell
script which will generate all required things to a file and then
execute that file with hive -f option
On Mon, Jul 23, 2012 at 3:27 PM, Manisha Gayath
You misread what I said. I meant to say that at run time we compile list of
variables e.g.
SET a.b.c=some_thing;
SET x.y.z=other_thing;
then concatenate them with query to come up with a final script, which will
look like-
SET a.b.c=some_thing;
SET x.y.z=other_thing;
INSERT OVERWRITE LOCAL DIRE
Thanks Vinod.
I tried concatenating variables. But that is also not possible as I see.
set pqr = concat(foo,bar);
set file_name= home/user/Desktop
Then the file_name I am getting is *NOT* home/user/Desktop/foo_bar
But what I am getting is, /home/user/Desktop/concat(foo,bar)
On Mon, Jul 23, 20
We generate variables dynamically and then create a final script file by
concatenating variables (SET commands) and Hive queries. Then final script
is executed. Probably you can adopt something similar approach.
Thanks,
Vinod
2012/7/23 Manisha Gayathri
> Thanks again Vinod.
>
> Will try to find
Thanks again Vinod.
Will try to find a way to pass the directory URLs from outside then.
And it would be grateful if you can direct me to any guide or documentation
that describes how to pass values from outside of Hive.
Thanks
Manisha
On Mon, Jul 23, 2012 at 2:08 PM, Vinod Singh wrote:
> SET
SET commands are handled differently and UDFs can't be invoked there. IMO
you need to pass the directory location value from outside of Hive. That is
how we do.
Thanks,
Vinod
2012/7/23 Manisha Gayathri
> Hi Vinod,
>
> Thanks for the prompt reply.
> Understood your point and sorry for not provid
Hi Vinod,
Thanks for the prompt reply.
Understood your point and sorry for not providing the complete code segment
earlier.
I have the getFilePath function which should return a URL like this.
home/user/Desktop/logDir/logs/log_0_testServer_2012_07_22
The defined function works perfectly if I pu
The output path in this query is already parameterized-
*INSERT OVERWRITE LOCAL DIRECTORY 'file:///${hiveconf:file_name}'*
Though UDF is not going to be invoked here.
Thanks,
Vinod
2012/7/23 Manisha Gayathri
> Hi
>
> Is there any possibility of defining the output directory of a hive
> query
Hi
Is there any possibility of defining the output directory of a hive
query using a Hive UDF?
In my UDF, I am passing 2 parameters (as follows) and this generates a
file-system URL
*getFilePath( "0","testServer" );*
Can I use the above getFilePath( "0","testServer" ) value, as the Local
Directo
11 matches
Mail list logo
