RE: Converting rows into dynamic colums in Hive

John, What is R? -Original Message- From: ext John Meagher [mailto:john.meag...@gmail.com] Sent: Wednesday, August 08, 2012 4:34 PM To: user@hive.apache.org Subject: Re: Converting rows into dynamic colums in Hive I don't think having dynamic columns is possible in Hive. I've always ou

RE: Custom UserDefinedFunction in Hive

Actually as the custom UDF "yesterday()" mentioned below is NOT marked with the annotation @UDFType(deterministic = false), partition pruning should work in practice. The PartitionPruner has a logic around this annotation to check if a generic UDF is deterministic or not and would skip partitio

Increase max tablename length?

The default seems to be 128. Can it be increased? I haven't found a configuration parameter for that yet. Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "Luminous beings are we, n

Re: Converting rows into dynamic colums in Hive

I don't think having dynamic columns is possible in Hive. I've always output from Hive a structure like your query output and used R to convert it into a dynamic column structure. On Wed, Aug 8, 2012 at 3:56 PM, wrote: > Thanks Ashish, that gives an idea. > > But I am not sure about the outer

RE: Converting rows into dynamic colums in Hive

Thanks Ashish, that gives an idea. But I am not sure about the outer select loop, I have to know all the values in Beta column beforehand to do a max on each value. Is there a better way? Richin From: ext Ashish Thusoo [mailto:athu...@qubole.com] Sent: Tuesday, August 07, 2012 5:05 PM To: user@h

Status of HIVE-1434

Hi, I'm trying to integrate Hive in our Cassandra-Hadoop stack, but I'm finding it difficult to understand what's the right approach. As far as I see, there are 2 jira issues open (one in Hive, on in Cassandra) https://issues.apache.org/jira/browse/CASSANDRA-4131 https://issues.apache.org/jira/

Question about querying JSON data

I have a large amount of data JSON data that was generated using periods in the key names, e.g., {"category.field": "value"}. I know that's not the best way to do JSON but for better or worse, it's the data I have to deal with. I have tried using get_json_object, but I am concerned that it's JSON

Re: Hive and joins

Thanks Bejoy. What if those values a,b are not static and are housed in a table. Much like a type 2 dimension. Is the current solution still to put it in the where clause? Thanks, Ranjith From: Bejoy Ks [mailto:bejoy...@yahoo.com] Sent: Wednesday, August 08, 2012 06:55 AM To: user@hive.apache.o

Re: Hive and joins

Hi Ranjith BETWEEN a and b, you can implement as >=a , <=b . Since that is not equality you cannot use that in ON clause you need to move it to WHERE condition in your query.   Regards, Bejoy KS From: "Raghunath, Ranjith" To: "'user@hive.apache.org'" Sent

Re: Custom UserDefinedFunction in Hive

Hi Raihan UDFs are evaluated at run time when the query is executed. But it is hive parser during query parse time decides the boundary of data to be used for the query, ie data from which all partitions has to be processed.Because of this the entire table will be scanned for your query.   Re

RE: Special character replaced by '?'

Any comments/information on the below issue is highly appreciable J From: Balaraman, Anand [mailto:anand_balara...@syntelinc.com] Sent: 06 August 2012 18:25 To: user@hive.apache.org Subject: Special character replaced by '?' Hi I am facing an issue while viewing special characters (suc