Re: Revisit Pig Philosophy?

2009-09-18 Thread Milind A Bhandarkar
It's Friday evening, so I have some time to discuss philosophy ;-) Before we discuss any question about revisiting pig philosophy, the first question that needs to be answered is "what is pig" ? (this corresponds to the Hindu philosophy's basic argument, that any deep personal philosophical

Re: Revisit Pig Philosophy?

2009-09-18 Thread Jeff Hammerbacher
Hey, > 2. Local mode and other parallel frameworks > > > Pigs Live Anywhere > > Pig is intended to be a language for parallel data processing. It is not > tied to one particular parallel framework. It has been implemented first > on hadoop, but we do not intend that to be only on hadoop. > > > A

[jira] Commented: (PIG-968) findContainingJar fails when there's a + in the path

2009-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757596#action_12757596 ] Hadoop QA commented on PIG-968: --- -1 overall. Here are the results of testing the latest attachm

[jira] Commented: (PIG-752) local mode doesn't read bzip2 and gzip compressed data files

2009-09-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757595#action_12757595 ] Jeff Zhang commented on PIG-752: Alan, What does this message mean ? > local mode doesn't

[jira] Commented: (PIG-948) [Usability] Relating pig script with MR jobs

2009-09-18 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757587#action_12757587 ] Pradeep Kamath commented on PIG-948: In my opinion, pig should only print the jobid. Users

[jira] Updated: (PIG-942) Maps are not implicitly casted

2009-09-18 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-942: --- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patc

[jira] Commented: (PIG-942) Maps are not implicitly casted

2009-09-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757568#action_12757568 ] Daniel Dai commented on PIG-942: +1 > Maps are not implicitly casted > --

[jira] Updated: (PIG-513) PERFORMANCE: optimize some of the code in DefaultTuple

2009-09-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-513: --- Resolution: Fixed Fix Version/s: 0.6.0 Status: Resolved (was: Patch Available) Patch checked

[jira] Created: (PIG-969) Default constructor of UDF gets called for UDF with parameterised constructor , if the udf has a getArgToFuncMapping function defined

2009-09-18 Thread Thejas M Nair (JIRA)
Default constructor of UDF gets called for UDF with parameterised constructor , if the udf has a getArgToFuncMapping function defined - Key: PIG-969

[jira] Updated: (PIG-968) findContainingJar fails when there's a + in the path

2009-09-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/PIG-968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated PIG-968: Attachment: pig-968.txt > findContainingJar fails when there's a + in the path > -

[jira] Updated: (PIG-968) findContainingJar fails when there's a + in the path

2009-09-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/PIG-968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated PIG-968: Status: Patch Available (was: Open) > findContainingJar fails when there's a + in the path >

[jira] Created: (PIG-968) findContainingJar fails when there's a + in the path

2009-09-18 Thread Todd Lipcon (JIRA)
findContainingJar fails when there's a + in the path Key: PIG-968 URL: https://issues.apache.org/jira/browse/PIG-968 Project: Pig Issue Type: Bug Components: impl Affects Ver

Revisit Pig Philosophy?

2009-09-18 Thread Santhosh Srinivasan
Pig Developers, I looked at the Pig philosophy page as it serves as a guideline for accepting changes to Pig. Is it time to revisit the overall philosophy? Reference: http://hadoop.apache.org/pig/philosophy.html Some items of interest: 1. SQL semantics and Pig With the recent addition of SQL

[jira] Updated: (PIG-651) PERFORMANCE: Use specialized POForEachNoFlatten for cases where the foreach has no flattens

2009-09-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-651: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) > PERFORMANCE: Use specialized POForEachN

[jira] Created: (PIG-967) Proposal for adding a metadata interface to Pig

2009-09-18 Thread Alan Gates (JIRA)
Proposal for adding a metadata interface to Pig --- Key: PIG-967 URL: https://issues.apache.org/jira/browse/PIG-967 Project: Pig Issue Type: Improvement Components: impl Repor

[jira] Commented: (PIG-942) Maps are not implicitly casted

2009-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757395#action_12757395 ] Hadoop QA commented on PIG-942: --- +1 overall. Here are the results of testing the latest attachm

[jira] Created: (PIG-966) Proposed rework for LoadFunc, StoreFunc, and Slice/r interfaces

2009-09-18 Thread Alan Gates (JIRA)
Proposed rework for LoadFunc, StoreFunc, and Slice/r interfaces --- Key: PIG-966 URL: https://issues.apache.org/jira/browse/PIG-966 Project: Pig Issue Type: Improvement Co

[jira] Commented: (PIG-948) [Usability] Relating pig script with MR jobs

2009-09-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757330#action_12757330 ] Daniel Dai commented on PIG-948: If Hadoop expose it, then there is no problem to include. But

[jira] Commented: (PIG-948) [Usability] Relating pig script with MR jobs

2009-09-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757310#action_12757310 ] Dmitriy V. Ryaboy commented on PIG-948: --- I don't see a problem with url construction in

[jira] Commented: (PIG-592) schema inferred incorrectly

2009-09-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757306#action_12757306 ] Alan Gates commented on PIG-592: +1, patch looks good. Let's get this in, as it's an annoying

[jira] Commented: (PIG-651) PERFORMANCE: Use specialized POForEachNoFlatten for cases where the foreach has no flattens

2009-09-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757305#action_12757305 ] Olga Natkovich commented on PIG-651: I agree that there is not enough gain > PERFORMANCE:

[jira] Updated: (PIG-593) RegExLoader stops an non-matching line

2009-09-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-593: --- Resolution: Duplicate Status: Resolved (was: Patch Available) Looks like this issue has already been ad

[jira] Updated: (PIG-682) Fix the ssh tunneling code

2009-09-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-682: --- Status: Open (was: Patch Available) Moving to open until the patch is changed per the comments by Santhosh and

[jira] Commented: (PIG-651) PERFORMANCE: Use specialized POForEachNoFlatten for cases where the foreach has no flattens

2009-09-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757297#action_12757297 ] Alan Gates commented on PIG-651: Is it worth adding this complexity to the code for a 2% speed

[jira] Updated: (PIG-752) local mode doesn't read bzip2 and gzip compressed data files

2009-09-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-752: --- Status: Open (was: Patch Available) When I try to apply this patch I get: {code} patching file src/org/apache/

[jira] Updated: (PIG-777) Code refactoring: Create optimization out of store/load post processing code

2009-09-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-777: --- Status: Open (was: Patch Available) Moving from patch available to open since the contributed patch has been c

[jira] Updated: (PIG-948) [Usability] Relating pig script with MR jobs

2009-09-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-948: --- Status: Open (was: Patch Available) Marking this as open again rather than patch available until issues with jo

[jira] Updated: (PIG-951) Reset parallelism to 1 for indexing job in MergeJoin

2009-09-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-951: --- Resolution: Fixed Fix Version/s: 0.6.0 Status: Resolved (was: Patch Available) Patch checked

[jira] Updated: (PIG-942) Maps are not implicitly casted

2009-09-18 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-942: --- Fix Version/s: 0.6.0 Assignee: Pradeep Kamath Status: Patch Available (was: Open) >

[jira] Updated: (PIG-942) Maps are not implicitly casted

2009-09-18 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-942: --- Attachment: PIG-942.patch Attached patch which addresses the issue by introducing implicit cast to Map i

[jira] Commented: (PIG-965) PERFORMANCE: optimize common case in matches (PORegex)

2009-09-18 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757242#action_12757242 ] Thejas M Nair commented on PIG-965: --- The 'common' use case to which these optimization apply

[jira] Commented: (PIG-964) Handling null in skewed join

2009-09-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757237#action_12757237 ] Olga Natkovich commented on PIG-964: patch committed to the trunk > Handling null in ske

RE: [VOTE] Release Pig 0.4.0 (candidate 1)

2009-09-18 Thread Olga Natkovich
Yes, I need to roll another version. I resolved the ant test issue but there is one more with unit tests in piggybank that I am still looking into. Olga -Original Message- From: Nigel Daley [mailto:nda...@yahoo-inc.com] Sent: Thursday, September 17, 2009 10:56 PM To: pig-dev@hadoop.apach