Re: Regex and serde with hive

2011-12-22 Thread Loren Siebert
The input regexp does not look right to me. You are expecting a space between groups, but your example contains no spaces. And where do you handle the first/last quotes? Wouldn’t it look more like this: input.regex = “\([^\~]*)[\~]*([^\~]*)[\~]*([^\~]*)\ Rather than trying to tackle it all at

Re: Hive Web UI 404

2011-10-05 Thread Loren Siebert
Not sure if you are interested in alternative solutions to HWI, but you might want to check out Beeswax in Hue (https://ccp.cloudera.com/display/HUE/Beeswax). On Oct 5, 2011, at 9:10 AM, jcfol...@pureperfect.com wrote: Hi, Trying to get the Hive Web UI running, but it 404s. Everything seems

Re: urldecode hive column

2011-09-15 Thread Loren Siebert
You need to write a UDF, like this person did: http://search-hadoop.com/m/HFWE32CYs6x/v=plain On Sep 15, 2011, at 9:03 AM, Chalcy Raja wrote: Hi, I have a situation where I need to do urldecode on one particular column. Is there any hive built in function available? Thank you,

Re: Single Map task for Hive queries

2011-08-15 Thread Loren Siebert
Is your external file compressed with GZip or BZip? Those file formats aren’t splittable, so they get assigned to one mapper. On Aug 15, 2011, at 10:23 AM, Jon Bender wrote: Hello, I have external tables in Hive stored in a single flat text file. When I execute queries against it, all

Re: Single Map task for Hive queries

2011-08-15 Thread Loren Siebert
, at 10:47 AM, Jon Bender wrote: It's actually just an uncompressed UTF-8 text file. This was essentially the create table clause: CREATE EXTERNAL TABLE foo ROW FORMAT DELIMITED STORED AS TEXTFILE LOCATION '/data/foo' Using Hive 0.7. On Mon, Aug 15, 2011 at 10:37 AM, Loren Siebert lo

Re: Reducer Issue in New Setup

2011-08-11 Thread Loren Siebert
Can you run normal MR jobs, like the example Pi calculation? Sometimes a no-reducer problem stems from DNS issues— reducers use node names, not IP addresses, so you need to have each machine knows how to resolve the names of all the other machines in the cluster. If it's a new cluster, you may

Re: Export data with column names

2011-05-03 Thread Loren Siebert
Sorry, null pointer exception On May 3, 2011, at 12:23, Raghunath, Ranjith ranjith.raghuna...@usaa.com wrote: Thanks Loren. Pardon my ignorance but what is an NPE? Thank you, Ranjith N. Raghunath -Original Message- From: Loren Siebert [mailto:lo...@siebert.org] Sent

Re: Problem Hive table RegexSerDe and Hadoop MR

2011-04-05 Thread Loren Siebert
You need to tell Hive about the JAR. This is how I do it in hive-site.xml: property namehive.aux.jars.path/name valuefile:///usr/lib/hive/lib/hive-contrib-0.7.0-CDH3B4.jar/value descriptionThese JAR file are available to all users for all jobs/description /property On Apr 5, 2011, at