Further details about Apache Pig join

2014-10-22 Thread Sameer Tilak
Hi ,I have simplified the problem further and here are the details: in1.txt: nullnull<=6.9nullnull<7.0 in2.txt:null null <=6.9null not-null <=6.9null null <7.0not-null null <7.0 in1 = LOAD 'in1.txt' AS (f1:chararray, f2:chararray, f3:chararray);DUMP in1;I see the following: Not sur

A question about Pig join

2014-10-22 Thread Sameer Tilak
Hi All,I have the following problem: This is a statement in my Pig script. cust_joined = JOIN cust_filtered BY (LOW, HIGH, NORMAL), cust_conversion BY (Low, High, Normal); When Datatypes are chararray for all these fields. So null should be interpreted as 'null', right? cust_filtered includes the

Re: Scala DSL for Pig

2014-10-22 Thread Matt Bossenbroek
Check out PigPen (a Clojure version of what you're doing): https://github.com/Netflix/PigPen And if you really want to use Scala, also check out Scalding: https://github.com/twitter/scalding -Matt On Saturday, October 18, 2014 at 4:07 PM, Russell Jurney wrote: > I don't have any feedback e

RE: Pig-Eclipse update

2014-10-22 Thread Steve Bernstein
Awesome, thanks! __ Steve Bernstein VP/Analytics 408.499.0961 MOBILE deem.com -Original Message- From: Eyal Allweil [mailto:eyal_allw...@yahoo.com.INVALID] Sent: Wednesday, October 22, 2014 7:08 AM To: user@pig.apache.org Subject: Pig-Eclipse update Hi all, If you'

Pig-Eclipse update

2014-10-22 Thread Eyal Allweil
Hi all, If you're using the "pig-eclipse" tool, I've recently started maintaining it and put out a new version. If you're not familiar with it, it's just a lightweight Eclipse plugin that does syntax highlighting for Pig. I mostly just updated the syntax highlighting to 0.11, but I also added a