[jira] [Commented] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176061#comment-14176061 ] David Dreyfus commented on PIG-3979: Daniel, Will you be waiting on me to resolve the Te

[jira] [Commented] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14175345#comment-14175345 ] David Dreyfus commented on PIG-3979: For counting spilled bytes, I rely on the counters.

[jira] [Commented] (PIG-4012) java.lang.IllegalArgumentException: Comparison method violates its general contract! SpillableMemoryManager

[ https://issues.apache.org/jira/browse/PIG-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14175322#comment-14175322 ] David Dreyfus commented on PIG-4012: The issue has nothing to do with unstable sorting o

[jira] [Commented] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173884#comment-14173884 ] David Dreyfus commented on PIG-3979: Hi Rohini, 1) Debug messages can always be enabled.

[jira] [Commented] (PIG-4012) java.lang.IllegalArgumentException: Comparison method violates its general contract! SpillableMemoryManager

[ https://issues.apache.org/jira/browse/PIG-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173857#comment-14173857 ] David Dreyfus commented on PIG-4012: I don't recall if the job fails or not. I don't thi

[jira] [Commented] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14168695#comment-14168695 ] David Dreyfus commented on PIG-3979: Comment at line 279: The second tier should at leas

[jira] [Commented] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14168449#comment-14168449 ] David Dreyfus commented on PIG-3979: Regarding Philip (flip) Kromer's death spiral, do y

[jira] [Commented] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161277#comment-14161277 ] David Dreyfus commented on PIG-3979: The SpillableMemoryManager.java.patch addresses bot

[jira] [Commented] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156611#comment-14156611 ] David Dreyfus commented on PIG-3979: Hi Daniel, Do I need to do anything at this time wi

[jira] [Created] (PIG-4185) ivy\lib\Pig\junit-4.11.jar; invalid CEN header

David Dreyfus created PIG-4185: -- Summary: ivy\lib\Pig\junit-4.11.jar; invalid CEN header Key: PIG-4185 URL: https://issues.apache.org/jira/browse/PIG-4185 Project: Pig Issue Type: Bug

[jira] [Resolved] (PIG-4012) java.lang.IllegalArgumentException: Comparison method violates its general contract! SpillableMemoryManager

[ https://issues.apache.org/jira/browse/PIG-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus resolved PIG-4012. Resolution: Fixed Fix Version/s: 0.13.0 Assignee: David Dreyfus Combined this issue w

[jira] [Commented] (PIG-4012) java.lang.IllegalArgumentException: Comparison method violates its general contract! SpillableMemoryManager

[ https://issues.apache.org/jira/browse/PIG-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032398#comment-14032398 ] David Dreyfus commented on PIG-4012: Addressed this issue in PIG-3979. > java.lang.Ille

[jira] [Updated] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus updated PIG-3979: --- Attachment: (was: POPartialAgg.java) > group all performance, garbage collection, and incremental a

[jira] [Updated] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus updated PIG-3979: --- Attachment: SpillableMemoryManager.java.patch POPartialAgg.java.patch Updates to attach

[jira] [Created] (PIG-4012) java.lang.IllegalArgumentException: Comparison method violates its general contract! SpillableMemoryManager

David Dreyfus created PIG-4012: -- Summary: java.lang.IllegalArgumentException: Comparison method violates its general contract! SpillableMemoryManager Key: PIG-4012 URL: https://issues.apache.org/jira/browse/PIG-4012

[jira] [Commented] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14029973#comment-14029973 ] David Dreyfus commented on PIG-3979: Hi Philip, Like yourself, I entered the murky worl

[jira] [Commented] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14015833#comment-14015833 ] David Dreyfus commented on PIG-3979: I do not know what is implied by making me the assi

[jira] [Commented] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14015830#comment-14015830 ] David Dreyfus commented on PIG-3979: The changes can go into 0.13.0 or 0.13.1. Before th

[jira] [Updated] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus updated PIG-3979: --- Attachment: PIG-3979-v1.patch Attached patch file as requested. Again, if you approve the approach take

[jira] [Updated] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus updated PIG-3979: --- Attachment: POPartialAgg.java Here is my version of the modified file. I'm sure there are better ways t

[jira] [Created] (PIG-3979) group all performance, garbage collection, and incremental aggregation

David Dreyfus created PIG-3979: -- Summary: group all performance, garbage collection, and incremental aggregation Key: PIG-3979 URL: https://issues.apache.org/jira/browse/PIG-3979 Project: Pig I

[jira] [Updated] (PIG-3979) group all performance, garbage collection, and incremental aggregation

[ https://issues.apache.org/jira/browse/PIG-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus updated PIG-3979: --- Patch Info: (was: Patch Available) > group all performance, garbage collection, and incremental aggre

[jira] [Commented] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13968764#comment-13968764 ] David Dreyfus commented on PIG-3807: Yes. Close the 3807 and open a new one case. No exc

[jira] [Commented] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13968695#comment-13968695 ] David Dreyfus commented on PIG-3807: GruntParser.processDump() doesn't close any files o

[jira] [Commented] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13968299#comment-13968299 ] David Dreyfus commented on PIG-3807: It works as expected on Linux after a better build

[jira] [Commented] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13968253#comment-13968253 ] David Dreyfus commented on PIG-3807: 1) Yes, I built the trunk. 2) After rebuilding the

[jira] [Commented] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13967592#comment-13967592 ] David Dreyfus commented on PIG-3807: I run the script that I posted originally. I test r

[jira] [Updated] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus updated PIG-3807: --- Description: The following script fails: d1 = load 'test_data.txt' USING PigStorage() AS (f1: int, f2:

[jira] [Updated] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus updated PIG-3807: --- Affects Version/s: 0.13.0 > Pig creates wrong schema after dereferencing nested tuple fields with sorts

[jira] [Reopened] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus reopened PIG-3807: When I test using pig 0.13.0 the problem remains. Can someone double-check that the problem has been reso

[jira] [Commented] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941045#comment-13941045 ] David Dreyfus commented on PIG-3807: Hi Daniel, How can I locate jar files with these pa

[jira] [Resolved] (PIG-3808) PigStorage with '-schema' generates Unhandled internal error.

[ https://issues.apache.org/jira/browse/PIG-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus resolved PIG-3808. Resolution: Not A Problem > PigStorage with '-schema' generates Unhandled internal error. >

[jira] [Commented] (PIG-3808) PigStorage with '-schema' generates Unhandled internal error.

[ https://issues.apache.org/jira/browse/PIG-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13931316#comment-13931316 ] David Dreyfus commented on PIG-3808: Addition problem was a Maven repository corruption

[jira] [Commented] (PIG-3808) PigStorage with '-schema' generates Unhandled internal error.

[ https://issues.apache.org/jira/browse/PIG-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13931276#comment-13931276 ] David Dreyfus commented on PIG-3808: Thank you for helping. I don't know which jackson j

[jira] [Created] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

David Dreyfus created PIG-3807: -- Summary: Pig creates wrong schema after dereferencing nested tuple fields with sorts Key: PIG-3807 URL: https://issues.apache.org/jira/browse/PIG-3807 Project: Pig

[jira] [Updated] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus updated PIG-3807: --- Description: The following script fails: d1 = load 'test_data.txt' USING PigStorage() AS (f1: int, f2:

[jira] [Created] (PIG-3808) PigStorage with '-schema' generates Unhandled internal error.

David Dreyfus created PIG-3808: -- Summary: PigStorage with '-schema' generates Unhandled internal error. Key: PIG-3808 URL: https://issues.apache.org/jira/browse/PIG-3808 Project: Pig Issue Typ

[jira] [Updated] (PIG-3808) PigStorage with '-schema' generates Unhandled internal error.

[ https://issues.apache.org/jira/browse/PIG-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus updated PIG-3808: --- Attachment: test_data.txt > PigStorage with '-schema' generates Unhandled internal error. > --

[jira] [Updated] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Dreyfus updated PIG-3807: --- Attachment: test_data.txt Test data used in script. Same as PIG-2767 > Pig creates wrong schema after