Greetings!
Lots of interest in the Utah area has spurred the creation the Utah Hadoop
User Group.
If you are in the area and want to join us please come. Subject matter will
include
*Hadoop: Solving your Big Data Woes*, Matt Davies, Tynt, Inc.
and
*Machine Learning With Big Data*, Richard
d)
>at
> sun.nio.ch.SocketChannelImpl.**finishConnect(**SocketChannelImpl.java:567)
>at org.apache.zookeeper.**ClientCnxn$SendThread.run(**ClientCnxn.java:
>
>
>
> On Monday 18 July 2011 11:06 PM, Matt Davies wrote:
>
>> Hello,
>>
>> Is there a wa
Hello,
Is there a way to specify the zookeeper quorum for a pig job writing out to
HBase using HBaseStorage? For instance,
jobA -> zkquorum 1
jobB -> zkquorum 2
I know that it reads from the hbase configuration files on disk, but I'd
like the equivalent of setting
conf.set("hbase.zookeeper.quor
w you would do that. I
> was under the impression the fastest way to do it would be to ship and cache
> the binary database instead of calling from the HDFS.
>
> -Ross
>
> - Original Message -
> From: "Matt Davies"
> To: user@pig.apache.org, "Ros
We wrote a snazzy UDF that does 1 initialization per mapper and does all the
necessary conversions. Quite efficient and fast.
The trick to maintainability is to have your UDF initialize the
locations.csv from HDFS and not to include the csv file within your jar.
That way you can easily update the
I've seen this before when some data was a null, and I wasn't checking for
it. Have you tried stepping through the pig script by
1. pig -r .. (generates script with any variables replaced)
2. copy / paste lines into a grunt shell
This will tell you (most of the time) where the problem lies in
off-list, let's
> see if we can get it to work.
>
> D
>
> On Tue, Feb 15, 2011 at 2:45 PM, Matt Davies wrote:
>
> > Dmitriy,
> >
> > I saw the patch posted to PIG-1680 from last night. Thanks! We have been
> > trying to apply it, and find that the
Dmitriy,
I saw the patch posted to PIG-1680 from last night. Thanks! We have been
trying to apply it, and find that the patch can't match some of the hunks.
Are you patching against trunk or a certain version?
Thanks!
-Matt
On Mon, Feb 14, 2011 at 4:14 PM, Matt Davies wrote:
>
either null records or records with null
> fields. What happens if you FILTER out any null values you might have.
> Does the problem persist?
>
> --jacob
> @thedatachef
>
> On Mon, 2011-02-14 at 14:57 -0700, Matt Davies wrote:
> > Hey All,
> >
> > Running int
ce i get some ivy uglyness out of the way.
>
> D
>
> On Mon, Feb 14, 2011 at 1:57 PM, Matt Davies wrote:
>
> > Hey All,
> >
> > Running into a problem storing data from a pig script storing results
> into
> > HBase.
> >
> > We are getting th
Hey All,
Running into a problem storing data from a pig script storing results into
HBase.
We are getting the following error:
java.lang.NullPointerException
at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:126)
at
org.apache
me, me me. you rock. thanks!
- Original Message -
From: "Dave Wellman"
To: user@pig.apache.org
Sent: Wednesday, October 20, 2010 8:58:09 AM
Subject: JUnit & Pig Script
All,
I have a solution for writing unit test in Java to test pig scripts including
stats and output if anyone is inter
12 matches
Mail list logo
