Re: Want to contribute

2013-05-01 Thread Naidu MS
Hi i have two questions regarding hdfs and jps utility I am new to Hadoop and started leraning hadoop from the past week 1.when ever i start start-all.sh and jps in console it showing the processes started *naidu@naidu:~/work/hadoop-1.0.4/bin$ jps* *22283 NameNode* *23516 TaskTracker* *26711

[jira] [Updated] (PIG-3097) HiveColumnarLoader doesn't correctly load partitioned Hive table

2013-05-01 Thread Marcin Czech (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcin Czech updated PIG-3097: -- Labels: patch (was: ) Affects Version/s: 0.10.1 Status: Patch Available

[jira] [Updated] (PIG-3097) HiveColumnarLoader doesn't correctly load partitioned Hive table

2013-05-01 Thread Marcin Czech (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcin Czech updated PIG-3097: -- Attachment: PIG-3097.patch HiveColumnarLoader doesn't correctly load partitioned Hive table

[jira] [Created] (PIG-3305) Infinite loop when input path contains empty partition directory

2013-05-01 Thread Marcin Czech (JIRA)
Marcin Czech created PIG-3305: - Summary: Infinite loop when input path contains empty partition directory Key: PIG-3305 URL: https://issues.apache.org/jira/browse/PIG-3305 Project: Pig Issue

[jira] [Updated] (PIG-3305) Infinite loop when input path contains empty partition directory

2013-05-01 Thread Marcin Czech (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcin Czech updated PIG-3305: -- Attachment: PIG-3305.patch Infinite loop when input path contains empty partition directory

[jira] [Commented] (PIG-3303) add hadoop h2 artifact to publications in ivy.xml

2013-05-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13646710#comment-13646710 ] Rohini Palaniswamy commented on PIG-3303: - +1 add hadoop h2

[jira] [Commented] (PIG-3285) Jobs using HBaseStorage fail to ship dependency jars

2013-05-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13646715#comment-13646715 ] Rohini Palaniswamy commented on PIG-3285: - Actually I got a little confused with the

[jira] [Updated] (PIG-3303) add hadoop h2 artifact to publications in ivy.xml

2013-05-01 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-3303: - Assignee: Julien Le Dem add hadoop h2 artifact to publications in ivy.xml

[jira] [Created] (PIG-3306) Publish h2 artifact to maven

2013-05-01 Thread Bill Graham (JIRA)
Bill Graham created PIG-3306: Summary: Publish h2 artifact to maven Key: PIG-3306 URL: https://issues.apache.org/jira/browse/PIG-3306 Project: Pig Issue Type: Bug Reporter: Bill

[jira] [Commented] (PIG-3303) add hadoop h2 artifact to publications in ivy.xml

2013-05-01 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13646720#comment-13646720 ] Bill Graham commented on PIG-3303: -- +1 Created PIG-3306 for publishing the h2 artifact to

[jira] [Commented] (PIG-3306) Publish h2 artifact to maven

2013-05-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13646784#comment-13646784 ] Rohini Palaniswamy commented on PIG-3306: - Isn't it already published?

[jira] [Commented] (PIG-3306) Publish h2 artifact to maven

2013-05-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13646796#comment-13646796 ] Rohini Palaniswamy commented on PIG-3306: - Is this jira for ivy-publish-local ?

[jira] [Resolved] (PIG-3303) add hadoop h2 artifact to publications in ivy.xml

2013-05-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved PIG-3303. Resolution: Fixed Fix Version/s: 0.12 Merged in trunk add hadoop h2

[jira] [Resolved] (PIG-3306) Publish h2 artifact to maven

2013-05-01 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham resolved PIG-3306. -- Resolution: Not A Problem Yup [~rohini] you're right we already do that. I should have known, I've

[jira] [Created] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-01 Thread Julien Le Dem (JIRA)
Julien Le Dem created PIG-3307: -- Summary: Refactor physical operators to remove methods parameters that are always null Key: PIG-3307 URL: https://issues.apache.org/jira/browse/PIG-3307 Project: Pig

[jira] [Updated] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3307: --- Attachment: PIG-3307_0.patch PIG-3307_0.patch contains the initial refactoring

[jira] [Updated] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3307: --- Description: The physical operators are sometimes overly complex. I'm trying to cleanup some

[jira] [Commented] (PIG-3285) Jobs using HBaseStorage fail to ship dependency jars

2013-05-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13646998#comment-13646998 ] Daniel Dai commented on PIG-3285: - Agree with Rohini, that should be a simple fix to add

Re: Want to contribute

2013-05-01 Thread Daniel Dai
Hi, Naidu, Those are Hadoop question and you should send to u...@hadoop.apache.org. A quick answer to double hadoop namenode -format question is, once you do that, you lose the metadata, you would have trouble getting hdfs files back. Thanks, Daniel On Wed, May 1, 2013 at 12:25 AM, Naidu MS

[jira] [Commented] (PIG-2586) A better plan/data flow visualizer

2013-05-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13647006#comment-13647006 ] Daniel Dai commented on PIG-2586: - Thanks, I will take a look. A better

[jira] [Commented] (PIG-3097) HiveColumnarLoader doesn't correctly load partitioned Hive table

2013-05-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13647027#comment-13647027 ] Daniel Dai commented on PIG-3097: - The patch applies to trunk and all piggybank tests pass.

[jira] [Resolved] (PIG-3304) XMLLoader in piggybank does not work with inline closed tags

2013-05-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3304. - Resolution: Fixed Fix Version/s: 0.12 Assignee: Ahmed Eldawy Hadoop Flags: Reviewed

[jira] [Commented] (PIG-3305) Infinite loop when input path contains empty partition directory

2013-05-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13647134#comment-13647134 ] Daniel Dai commented on PIG-3305: - [~maczech]Can you make a patch for trunk?

[jira] [Commented] (PIG-3286) TestPigContext.testImportList fails in trunk

2013-05-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13647138#comment-13647138 ] Daniel Dai commented on PIG-3286: - +1 TestPigContext.testImportList fails

A major addition to Pig. Working with spatial data

2013-05-01 Thread Ahmed Eldawy
Hi all, First, sorry for the long email. I wanted to put all my thoughts here and get your feedback. I'm proposing a major addition to Pig that will greatly increase its functionality and user base. It is simply to add spatial support to the language and the framework. I've already started

[jira] [Updated] (PIG-2970) Nested foreach getting incorrect schema when having unrelated inner query

2013-05-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2970: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

Re: A major addition to Pig. Working with spatial data

2013-05-01 Thread Alan Gates
Passing on the technical details for a moment, I see a licensing issue. JTS is licensed under LGPL. Apache projects cannot contain or ship [L]GPL. Apache does not meet the requirements of GPL and thus we cannot repackage their code. If you wanted to go forward using that class this would

[jira] Subscription: PIG patch available

2013-05-01 Thread jira
Issue Subscription Filter: PIG patch available (29 issues) Subscriber: pigdaily Key Summary PIG-3297Avro files with stringType set to String cannot be read by the AvroStorage LoadFunc https://issues.apache.org/jira/browse/PIG-3297 PIG-3295Casting from

Re: A major addition to Pig. Working with spatial data

2013-05-01 Thread Ahmed Eldawy
Thanks for your response. I was never good at differentiating all those open source licenses. I mean what is the point making open source licenses if it blocks me from using a library in an open source project. Any way, I'm not going into debate here. Just one question, if we use JTS as a library

[jira] [Updated] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3307: --- Attachment: PIG-3307_1.patch PIG-3307_1.patch introduces some more refactoring

[jira] [Commented] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-01 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13647174#comment-13647174 ] Julien Le Dem commented on PIG-3307: It looks like we can get rid of the parameter that

Physical operators refactoring

2013-05-01 Thread Julien Le Dem
Just a heads up that I'm looking into this and that it is potentially a giant patch: https://issues.apache.org/jira/browse/PIG-3307 Feedback appreciated. Julien

Re: Want to contribute

2013-05-01 Thread Naidu MS
Thanks Daniel. I am new to this group. Regards, Naidu On Thu, May 2, 2013 at 3:45 AM, Daniel Dai da...@hortonworks.com wrote: Hi, Naidu, Those are Hadoop question and you should send to u...@hadoop.apache.org. A quick answer to double hadoop namenode -format question is, once you do that,

[jira] [Updated] (PIG-3286) TestPigContext.testImportList fails in trunk

2013-05-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3286: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you