[jira] [Commented] (PIG-4458) Support UDFs in a FOREACH Before a Merge Join

[ https://issues.apache.org/jira/browse/PIG-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360700#comment-14360700 ] Daniel Dai commented on PIG-4458: - Yes, I know what your patch doing. The user now has the

[jira] [Commented] (PIG-4461) Use benchmarks for Windows Pig e2e tests

[ https://issues.apache.org/jira/browse/PIG-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360939#comment-14360939 ] Namit Maheshwari commented on PIG-4461: --- [~daijy] - Can you please review the attached

[jira] [Work started] (PIG-4461) Use benchmarks for Windows Pig e2e tests

[ https://issues.apache.org/jira/browse/PIG-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on PIG-4461 started by Namit Maheshwari. - Use benchmarks for Windows Pig e2e tests

[jira] [Updated] (PIG-4460) TestBuiltIn testValueListOutputSchemaComplexType and testValueSetOutputSchemaComplexType tests create bags whose inner schema is not a tuple

[ https://issues.apache.org/jira/browse/PIG-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Hsu updated PIG-4460: - Description: These are bugs in the tests added in PIG-4432/PIG-4445.

[jira] [Updated] (PIG-4460) TestBuiltIn testValueListOutputSchemaComplexType and testValueSetOutputSchemaComplexType tests create bags whose inner schema is not a tuple

[ https://issues.apache.org/jira/browse/PIG-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4460: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1 Patch

[jira] [Created] (PIG-4460) TestBuiltIn testValueListOutputSchemaComplexType and testValueSetOutputSchemaComplexType tests create bags whose inner schema is not a tuple

Anthony Hsu created PIG-4460: Summary: TestBuiltIn testValueListOutputSchemaComplexType and testValueSetOutputSchemaComplexType tests create bags whose inner schema is not a tuple Key: PIG-4460 URL:

[jira] [Updated] (PIG-4461) Use benchmarks for Windows Pig e2e tests

[ https://issues.apache.org/jira/browse/PIG-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Maheshwari updated PIG-4461: -- Attachment: PIG-4461.patch Use benchmarks for Windows Pig e2e tests

[jira] [Updated] (PIG-4460) TestBuiltIn testValueListOutputSchemaComplexType and testValueSetOutputSchemaComplexType tests create bags whose inner schema is not a tuple

[ https://issues.apache.org/jira/browse/PIG-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Hsu updated PIG-4460: - Attachment: PIG-4460.1.patch Uploaded patch. TestBuiltIn testValueListOutputSchemaComplexType and

[jira] [Updated] (PIG-4460) TestBuiltIn testValueListOutputSchemaComplexType and testValueSetOutputSchemaComplexType tests create bags whose inner schema is not a tuple

[ https://issues.apache.org/jira/browse/PIG-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Hsu updated PIG-4460: - Fix Version/s: 0.15.0 Affects Version/s: 0.15.0 Status: Patch Available (was: Open)

[jira] [Resolved] (PIG-4459) VALUESET/VALUELIST wraps an element in a tuple even if that element is a tuple

[ https://issues.apache.org/jira/browse/PIG-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Hsu resolved PIG-4459. -- Resolution: Not a Problem VALUESET/VALUELIST wraps an element in a tuple even if that element is a tuple

[jira] [Created] (PIG-4461) Use benchmarks for Windows Pig e2e tests

Namit Maheshwari created PIG-4461: - Summary: Use benchmarks for Windows Pig e2e tests Key: PIG-4461 URL: https://issues.apache.org/jira/browse/PIG-4461 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-4458) Support UDFs in a FOREACH Before a Merge Join

[ https://issues.apache.org/jira/browse/PIG-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360988#comment-14360988 ] William Watson commented on PIG-4458: - Okay cool, just making sure we're on the same

[jira] [Updated] (PIG-3716) Implement user defined comparators for order by in Tez

[ https://issues.apache.org/jira/browse/PIG-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3716: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) Implement user defined

[jira] [Updated] (PIG-4343) Tez auto parallelism fails at query compile time

[ https://issues.apache.org/jira/browse/PIG-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4343: Issue Type: Bug (was: Sub-task) Parent: (was: PIG-3446) Tez auto parallelism fails at query

[jira] [Updated] (PIG-4411) Support for speculative execution

[ https://issues.apache.org/jira/browse/PIG-4411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4411: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) Support for speculative

[jira] [Updated] (PIG-4148) Tez order-by is often skewed because FindQuantiles UDF is called with small number

[ https://issues.apache.org/jira/browse/PIG-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4148: Issue Type: Bug (was: Sub-task) Parent: (was: PIG-3446) Tez order-by is often skewed because

[jira] [Updated] (PIG-3994) Implement getting backend exception for Tez

[ https://issues.apache.org/jira/browse/PIG-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3994: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) Implement getting backend

[jira] [Updated] (PIG-4152) Enabling pig.exec.estimate.parallelism causes runtime exception in Tez

[ https://issues.apache.org/jira/browse/PIG-4152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4152: Issue Type: Bug (was: Sub-task) Parent: (was: PIG-3446) Enabling pig.exec.estimate.parallelism

[jira] [Updated] (PIG-4373) Implement Optimize the use of DistributedCache(PIG-2672) in Tez

[ https://issues.apache.org/jira/browse/PIG-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4373: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) Implement Optimize the use of

[jira] [Updated] (PIG-4315) MergeJoin followed by order by gives NPE in Tez

[ https://issues.apache.org/jira/browse/PIG-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4315: Issue Type: Bug (was: Sub-task) Parent: (was: PIG-3446) MergeJoin followed by order by gives

[jira] [Updated] (PIG-4458) Support UDFs in a FOREACH Before a Merge Join

[ https://issues.apache.org/jira/browse/PIG-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Watson updated PIG-4458: Attachment: remove_merge_join_udf_restriction.patch Added the new patch with a test for checking that

[jira] [Updated] (PIG-3751) Generating Splits in Tez should be configurable to AM or client

[ https://issues.apache.org/jira/browse/PIG-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3751: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) Generating Splits in Tez should

[jira] [Updated] (PIG-3659) Memory management for each vertex

[ https://issues.apache.org/jira/browse/PIG-3659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3659: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) Memory management for each

[jira] [Updated] (PIG-4072) secondary sort optimizer to support multiple predecessors

[ https://issues.apache.org/jira/browse/PIG-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4072: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) secondary sort optimizer to

[jira] [Updated] (PIG-3993) Implement illustrate in Tez

[ https://issues.apache.org/jira/browse/PIG-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3993: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) Implement illustrate in Tez

[jira] [Updated] (PIG-4343) Tez auto parallelism fails at query compile time

[ https://issues.apache.org/jira/browse/PIG-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4343: Component/s: tez Tez auto parallelism fails at query compile time

[jira] [Commented] (PIG-4458) Support UDFs in a FOREACH Before a Merge Join

[ https://issues.apache.org/jira/browse/PIG-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361073#comment-14361073 ] Daniel Dai commented on PIG-4458: - I thought there will be Data is not sorted on left side

[jira] [Updated] (PIG-3852) Remove SecurityHelper class for Tez and use Tez helpers instead

[ https://issues.apache.org/jira/browse/PIG-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3852: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) Remove SecurityHelper class for

[jira] [Updated] (PIG-3957) Refactor out resetting input key in TezDagBuilder

[ https://issues.apache.org/jira/browse/PIG-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3957: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) Refactor out resetting input

[jira] [Resolved] (PIG-3446) Umbrella jira for Pig on Tez

[ https://issues.apache.org/jira/browse/PIG-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3446. - Resolution: Fixed Fix Version/s: (was: 0.15.0) 0.14.0 Resolve this ticket

Review Request 32031: PIG-4193: Make collected group work with Spark

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32031/ --- Review request for pig, liyun zhang and Mohit Sabharwal. Bugs: PIG-4193

[jira] Subscription: PIG patch available

Issue Subscription Filter: PIG patch available (22 issues) Subscriber: pigdaily Key Summary PIG-4458Support UDFs in a FOREACH Before a Merge Join https://issues.apache.org/jira/browse/PIG-4458 PIG-4455Should use DependencyOrderWalker instead of DepthFirstWalker in

[jira] [Commented] (PIG-4193) Make collected group work with Spark

[ https://issues.apache.org/jira/browse/PIG-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360120#comment-14360120 ] Praveen Rachabattuni commented on PIG-4193: --- [~xuefuz] PIG-4193-2.patch was a

Re: Review Request 32031: PIG-4193: Make collected group work with Spark

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32031/ --- (Updated March 13, 2015, 10:42 a.m.) Review request for pig, liyun zhang and

[jira] [Updated] (PIG-4193) Make collected group work with Spark

[ https://issues.apache.org/jira/browse/PIG-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Praveen Rachabattuni updated PIG-4193: -- Attachment: PIG-4193-3.patch PIG-4193-2.patch was a malformed patch. Make collected

Re: Review Request 32031: PIG-4193: Make collected group work with Spark

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32031/#review76344 ---

[jira] [Commented] (PIG-4422) implement visitMergeJoin in SparkCompiler

[ https://issues.apache.org/jira/browse/PIG-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360219#comment-14360219 ] Praveen Rachabattuni commented on PIG-4422: --- Patch posted to rb. implement

[jira] [Updated] (PIG-4422) Implement visitMergeJoin in SparkCompiler

[ https://issues.apache.org/jira/browse/PIG-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Praveen Rachabattuni updated PIG-4422: -- Summary: Implement visitMergeJoin in SparkCompiler (was: implement visitMergeJoin in

[jira] [Updated] (PIG-4422) implement visitMergeJoin in SparkCompiler

[ https://issues.apache.org/jira/browse/PIG-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Praveen Rachabattuni updated PIG-4422: -- Status: Patch Available (was: Open) implement visitMergeJoin in SparkCompiler

Review Request 32036: PIG-4422: Implement visitMergeJoin in SparkCompiler

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32036/ --- Review request for pig, liyun zhang and Mohit Sabharwal. Bugs: PIG-4422

[jira] [Commented] (PIG-4459) VALUESET/VALUELIST wraps an element in a tuple even if that element is a tuple

[ https://issues.apache.org/jira/browse/PIG-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360581#comment-14360581 ] Daniel Dai commented on PIG-4459: - This should be the right behavior. Otherwise, the result

[jira] [Commented] (PIG-4458) Support UDFs in a FOREACH Before a Merge Join

[ https://issues.apache.org/jira/browse/PIG-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360600#comment-14360600 ] Daniel Dai commented on PIG-4458: - I am fine to relax the UDF check and let user control the

[jira] [Commented] (PIG-4458) Support UDFs in a FOREACH Before a Merge Join

[ https://issues.apache.org/jira/browse/PIG-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360607#comment-14360607 ] William Watson commented on PIG-4458: - Well, the user already controls the key order.