[jira] [Updated] (PIG-4021) Fix TestHBaseStorage failure after auto local mode change (PIG-3463)

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4021: Attachment: PIG-4021-1.patch The test only fail on Hadoop 1. The test runs with local mode before PIG-3463,

[jira] [Updated] (PIG-4005) depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when hbaseversion is 95

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4005: Attachment: PIG-4005-1.patch Attach patch. Also change default hbaseversion to 95 since it has been out for

[jira] [Updated] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-18 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4025: Description: Method positioning on stack strace in IBM jdk is different which makes these tests fail . we can

[jira] [Created] (PIG-4024) TestPigStreamingUDF and TestPigStreaming fail on IBM JDK.

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4024: --- Summary: TestPigStreamingUDF and TestPigStreaming fail on IBM JDK. Key: PIG-4024 URL: https://issues.apache.org/jira/browse/PIG-4024 Project: Pig Issue Type: Improveme

[jira] [Created] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4025: --- Summary: TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK Key: PIG-4025 URL: https://issues.apache.org/jira/browse/PIG

[jira] [Created] (PIG-4023) BigDec/Int sort is broken

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4023: --- Summary: BigDec/Int sort is broken Key: PIG-4023 URL: https://issues.apache.org/jira/browse/PIG-4023 Project: Pig Issue Type: Bug Affects Versions: 0.12.0

[jira] [Commented] (PIG-4023) BigDec/Int sort is broken

2014-06-18 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036854#comment-14036854 ] Anup Ahire commented on PIG-4023: - I can provide a patch > BigDec/Int sort is broken >

[jira] [Created] (PIG-4022) Fix tez e2e test SkewedJoin_6

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4022: --- Summary: Fix tez e2e test SkewedJoin_6 Key: PIG-4022 URL: https://issues.apache.org/jira/browse/PIG-4022 Project: Pig Issue Type: Bug Components: tez

[jira] [Assigned] (PIG-4005) depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when hbaseversion is 95

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-4005: --- Assignee: Daniel Dai > depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when > hbasever

[jira] Subscription: PIG patch available

2014-06-18 Thread jira
Issue Subscription Filter: PIG patch available (16 issues) Subscriber: pigdaily Key Summary PIG-4018Schema validation fails with UNION ONSCHEMA https://issues.apache.org/jira/browse/PIG-4018 PIG-4008Pig code change to enable Tez Local mode https://issues.a

[jira] [Updated] (PIG-3972) java.lang.IndexOutOfBoundsException when flatten meets an empty row

2014-06-18 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mona Chitnis updated PIG-3972: -- Affects Version/s: 0.13.0 0.12.0 > java.lang.IndexOutOfBoundsException when flatte

[jira] [Assigned] (PIG-3972) java.lang.IndexOutOfBoundsException when flatten meets an empty row

2014-06-18 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mona Chitnis reassigned PIG-3972: - Assignee: Mona Chitnis > java.lang.IndexOutOfBoundsException when flatten meets an empty row >

[jira] [Commented] (PIG-4021) Fix TestHBaseStorage failure after auto local mode change (PIG-3463)

2014-06-18 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036714#comment-14036714 ] Aniket Mokashi commented on PIG-4021: - I do not know why it should not. I may have also

[jira] [Commented] (PIG-3000) Optimize nested foreach

2014-06-18 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036599#comment-14036599 ] Mona Chitnis commented on PIG-3000: --- thanks for taking a peek Daniel. I will rebase my pat

[jira] [Created] (PIG-4021) Fix TestHBaseStorage failure after auto local mode change (PIG-3463)

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4021: --- Summary: Fix TestHBaseStorage failure after auto local mode change (PIG-3463) Key: PIG-4021 URL: https://issues.apache.org/jira/browse/PIG-4021 Project: Pig Issue Typ

Trevni file format

2014-06-18 Thread Rohini Palaniswamy
Does Trevni as file format has some traction and used by anyone in production? Linkedin possibly? Since Cloudera is now supporting Parquet was wondering what is the state of Trevni. If Trevni is being deprecated in favor of Parquet we should deprecate our TrevniStorage as well sometime. Regards,

[jira] [Resolved] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4020. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review! > Fix t

[jira] [Commented] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036348#comment-14036348 ] Rohini Palaniswamy commented on PIG-4020: - +1 > Fix tez e2e tests MapPartialAgg_[2-

[jira] [Commented] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036346#comment-14036346 ] Daniel Dai commented on PIG-4020: - In short, processInput() in MR will not result endOfAllIn

[jira] [Commented] (PIG-4002) Disable combiner when map-side aggregation is used

2014-06-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036302#comment-14036302 ] Cheolsoo Park commented on PIG-4002: Thank you for the patch. I agree with the idea that

[jira] [Commented] (PIG-4001) POPartialAgg aggregates too aggressively when multiple values aggregated

2014-06-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036254#comment-14036254 ] Cheolsoo Park commented on PIG-4001: +1. Will commit this later today. > POPartialAgg a

[jira] [Commented] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036208#comment-14036208 ] Rohini Palaniswamy commented on PIG-4020: - Can you explain the failure root cause an

[jira] [Resolved] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4019. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Alan for review! > Compila

[jira] [Commented] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036154#comment-14036154 ] Alan Gates commented on PIG-4019: - +1 > Compilation broken after TEZ-1169 > ---

[jira] [Resolved] (PIG-4015) Provide a way to disable auto-parallism in tez

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4015. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review! > Provi

[jira] [Updated] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4020: Attachment: PIG-4020-1.patch > Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7] > --

[jira] [Created] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4020: --- Summary: Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7] Key: PIG-4020 URL: https://issues.apache.org/jira/browse/PIG-4020 Project: Pig Issue Type:

[jira] [Updated] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4019: Attachment: PIG-4019-1.patch > Compilation broken after TEZ-1169 > - > >

[jira] [Created] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4019: --- Summary: Compilation broken after TEZ-1169 Key: PIG-4019 URL: https://issues.apache.org/jira/browse/PIG-4019 Project: Pig Issue Type: Bug Components: tez

[jira] [Updated] (PIG-4006) Make the interval of DAGStatus report configurable

2014-06-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4006: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you Daniel

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Description: When relations with differing schemas are unioned (using UNION ONSCHEMA), schema vali

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Status: Patch Available (was: Open) > Schema validation fails with UNION ONSCHEMA > --

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Attachment: PIG-4018.patch This is an attempt at a patch. It moves UnionOnSchemaSetter above Impli

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Affects Version/s: 0.13.0 > Schema validation fails with UNION ONSCHEMA > -

[jira] [Created] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
Travis Woodruff created PIG-4018: Summary: Schema validation fails with UNION ONSCHEMA Key: PIG-4018 URL: https://issues.apache.org/jira/browse/PIG-4018 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-626) Statistics (records read by each mapper and reducer)

2014-06-18 Thread Maximus (JIRA)
[ https://issues.apache.org/jira/browse/PIG-626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximus updated PIG-626: Description: This uses the counters framework that hadoop has. Initially, I am just interested in finding out the num

[jira] [Updated] (PIG-626) Statistics (records read by each mapper and reducer)

2014-06-18 Thread Maximus (JIRA)
[ https://issues.apache.org/jira/browse/PIG-626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximus updated PIG-626: Description: This uses (lalala) the counters framework that hadoop has. Initially, I am just interested in finding ou