[jira] [Commented] (PIG-5161) Include all unit tests for spark branch

2017-03-08 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902081#comment-15902081 ] liyunzhang_intel commented on PIG-5161: --- [~daijy]: thanks, in latest build, all unit t

[jira] [Updated] (PIG-5133) Commit changes from last round of review on rb

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5133: -- Attachment: PIG-5133_5.patch [~szita] and [~nkollar]: help to review, thanks > Commit changes fro

[jira] [Commented] (PIG-5179) BigData_Streaming_1 is failing

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902681#comment-15902681 ] liyunzhang_intel commented on PIG-5179: --- [~nkollar]: the exception is because the inva

[jira] [Commented] (PIG-5178) Fix configuration for E2E spark mode

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902688#comment-15902688 ] liyunzhang_intel commented on PIG-5178: --- [~szita]: We needs at least 512M memory to r

[jira] [Commented] (PIG-5177) Scripting and StreamingPythonUDFs fail with Spark exec type

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904017#comment-15904017 ] liyunzhang_intel commented on PIG-5177: --- [~szita]: quick look at this patch, several

[jira] [Commented] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904213#comment-15904213 ] liyunzhang_intel commented on PIG-5167: --- [~rohini],[~xuefuz]: the order of the result

[jira] [Commented] (PIG-5133) Commit changes from last round of review on rb

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904218#comment-15904218 ] liyunzhang_intel commented on PIG-5133: --- [~xuefuz]: please help commit PIG_5133_5.patc

[jira] [Commented] (PIG-5133) Commit changes from last round of review on rb

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904234#comment-15904234 ] liyunzhang_intel commented on PIG-5133: --- [~xuefuz]: please wait, i need to repatch PIG

[jira] [Updated] (PIG-5133) Commit changes from last round of review on rb

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5133: -- Attachment: (was: PIG-5133_5.patch) > Commit changes from last round of review on rb > ---

[jira] [Updated] (PIG-5133) Commit changes from last round of review on rb

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5133: -- Attachment: PIG-5133_5.patch [~xuefuz]: i update PIG-5133_5.patch. please commit by following way:

[jira] [Commented] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904431#comment-15904431 ] liyunzhang_intel commented on PIG-5167: --- [~knoguchi]: thanks your suggestion! [~szita]

[jira] [Commented] (PIG-5178) Fix configuration for E2E spark mode

2017-03-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1590#comment-1590 ] liyunzhang_intel commented on PIG-5178: --- [~szita]:{quote} And we'll probably remove th

[jira] [Comment Edited] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-10 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904431#comment-15904431 ] liyunzhang_intel edited comment on PIG-5167 at 3/10/17 8:17 AM: --

[jira] [Commented] (PIG-5178) Fix configuration for E2E spark mode

2017-03-12 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906690#comment-15906690 ] liyunzhang_intel commented on PIG-5178: --- [~szita]: commit to branch, thanks for your w

[jira] [Commented] (PIG-5180) MergeSparseJoin fails with Spark exec type

2017-03-12 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906692#comment-15906692 ] liyunzhang_intel commented on PIG-5180: --- [~szita]: commit to spark branch, thanks! >

[jira] [Commented] (PIG-5179) BigData_Streaming_1 is failing

2017-03-12 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906695#comment-15906695 ] liyunzhang_intel commented on PIG-5179: --- [~nkollar]: LGTM except {code} long tipId

[jira] [Commented] (PIG-5177) Scripting and StreamingPythonUDFs fail with Spark exec type

2017-03-12 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906709#comment-15906709 ] liyunzhang_intel commented on PIG-5177: --- [~szita]: thanks for detail explanation. In m

[jira] [Commented] (PIG-5054) Initialize SchemaTupleBackend correctly in backend in spark mode if spark job has more than 1 stage

2017-03-12 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906714#comment-15906714 ] liyunzhang_intel commented on PIG-5054: --- [~szita]: commit to spark branch, before we i

[jira] [Commented] (PIG-5181) JobManagement_3 is failing with spark exec type

2017-03-12 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906850#comment-15906850 ] liyunzhang_intel commented on PIG-5181: --- [~nkollar]: Yes you can create a temp folder

[jira] [Commented] (PIG-5175) Upgrade jruby to 1.7.26

2017-03-13 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923025#comment-15923025 ] liyunzhang_intel commented on PIG-5175: --- [~nkollar]: ok > Upgrade jruby to 1.7.26 > -

[jira] [Commented] (PIG-5104) Union_15 e2e test failing on Spark

2017-03-14 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925037#comment-15925037 ] liyunzhang_intel commented on PIG-5104: --- [~xuefuz]: please help check in PIG-5104.zly.

[jira] [Commented] (PIG-5179) BigData_Streaming_1 is failing

2017-03-14 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925073#comment-15925073 ] liyunzhang_intel commented on PIG-5179: --- [~nkollar]: commit to spark branch, thanks!

[jira] [Updated] (PIG-5179) BigData_Streaming_1 is failing

2017-03-14 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5179: -- Resolution: Fixed Status: Resolved (was: Patch Available) > BigData_Streaming_1 is failin

[jira] [Commented] (PIG-5177) Scripting and StreamingPythonUDFs fail with Spark exec type

2017-03-14 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925105#comment-15925105 ] liyunzhang_intel commented on PIG-5177: --- {~szita]: LGTM Add more comment like "in spa

[jira] [Commented] (PIG-5181) JobManagement_3 is failing with spark exec type

2017-03-14 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925123#comment-15925123 ] liyunzhang_intel commented on PIG-5181: --- [~nkollar]: commit to spark branch, thanks!

[jira] [Updated] (PIG-5181) JobManagement_3 is failing with spark exec type

2017-03-14 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5181: -- Resolution: Fixed Status: Resolved (was: Patch Available) > JobManagement_3 is failing wi

[jira] [Created] (PIG-5189) Support spark.yarn.archive for spark branch

2017-03-15 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5189: - Summary: Support spark.yarn.archive for spark branch Key: PIG-5189 URL: https://issues.apache.org/jira/browse/PIG-5189 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-4858) Implement Skewed join for spark engine

2017-03-15 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927352#comment-15927352 ] liyunzhang_intel commented on PIG-4858: --- [~szita] and [~nkollar]: please help review.

[jira] [Resolved] (PIG-5133) Commit changes from last round of review on rb

2017-03-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-5133. --- Resolution: Fixed > Commit changes from last round of review on rb > ---

[jira] [Created] (PIG-5192) Remove schema tuple reference overhead for replicate join hashmap in POFRJoinSpark

2017-03-16 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5192: - Summary: Remove schema tuple reference overhead for replicate join hashmap in POFRJoinSpark Key: PIG-5192 URL: https://issues.apache.org/jira/browse/PIG-5192 Projec

[jira] [Commented] (PIG-5189) Support spark.yarn.archive for spark branch

2017-03-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929384#comment-15929384 ] liyunzhang_intel commented on PIG-5189: --- [~zjffdu]: you found other configuration ite

[jira] [Commented] (PIG-5189) Support spark.yarn.archive for spark branch

2017-03-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929461#comment-15929461 ] liyunzhang_intel commented on PIG-5189: --- [~zjffdu]: we need user to specify the SPAR

[jira] [Comment Edited] (PIG-5177) Scripting and StreamingPythonUDFs fail with Spark exec type

2017-03-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925105#comment-15925105 ] liyunzhang_intel edited comment on PIG-5177 at 3/17/17 6:47 AM: --

[jira] [Updated] (PIG-5177) Scripting and StreamingPythonUDFs fail with Spark exec type

2017-03-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5177: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Scripting and StreamingPython

[jira] [Commented] (PIG-5177) Scripting and StreamingPythonUDFs fail with Spark exec type

2017-03-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932095#comment-15932095 ] liyunzhang_intel commented on PIG-5177: --- [~szita]: commit to spark branch, thanks! >

[jira] [Commented] (PIG-5187) UdfDistributedCache_1 is failing with spark exec type

2017-03-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932098#comment-15932098 ] liyunzhang_intel commented on PIG-5187: --- [~nkollar]: LGTM, is PIG-5187_1.patch final p

[jira] [Commented] (PIG-5187) UdfDistributedCache_1 is failing with spark exec type

2017-03-20 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932309#comment-15932309 ] liyunzhang_intel commented on PIG-5187: --- [~nkollar]: repatch according to latest code

[jira] [Updated] (PIG-5187) UdfDistributedCache_1 is failing with spark exec type

2017-03-20 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5187: -- Resolution: Fixed Status: Resolved (was: Patch Available) [~nkollar]: commit to spark bra

[jira] [Assigned] (PIG-5195) Upgrade spark to 2.0

2017-03-23 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned PIG-5195: - Assignee: liyunzhang_intel > Upgrade spark to 2.0 > > >

[jira] [Created] (PIG-5195) Upgrade spark to 2.0

2017-03-23 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5195: - Summary: Upgrade spark to 2.0 Key: PIG-5195 URL: https://issues.apache.org/jira/browse/PIG-5195 Project: Pig Issue Type: Sub-task Reporter: liy

[jira] [Resolved] (PIG-5195) Upgrade spark to 2.0

2017-03-23 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-5195. --- Resolution: Fixed duplicated with PIG-5157 > Upgrade spark to 2.0 > > >

[jira] [Updated] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5167: -- Attachment: PIG-5167_2.patch [~nkolloar]: please help review PIG-5167_2.patch > Limit_4 is failin

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-03-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939939#comment-15939939 ] liyunzhang_intel commented on PIG-5157: --- [~zjffdu]: it is better to let user to choos

[jira] [Commented] (PIG-5176) Several ComputeSpec test cases fail

2017-03-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939943#comment-15939943 ] liyunzhang_intel commented on PIG-5176: --- [~nkollar]: base on latest(213c1bc) spark bra

[jira] [Comment Edited] (PIG-5176) Several ComputeSpec test cases fail

2017-03-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939943#comment-15939943 ] liyunzhang_intel edited comment on PIG-5176 at 3/24/17 8:15 AM: --

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-03-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940012#comment-15940012 ] liyunzhang_intel commented on PIG-5157: --- after discussion with [~nkollar], [~szita] ,[

[jira] [Commented] (PIG-5186) Support aggregate warnings with Spark engine

2017-03-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940017#comment-15940017 ] liyunzhang_intel commented on PIG-5186: --- [~szita]: create a review board to help revie

[jira] [Commented] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940413#comment-15940413 ] liyunzhang_intel commented on PIG-5167: --- [~nkollar]:yes,i made mistake in PIG-5167_2.p

[jira] [Commented] (PIG-5158) Several e2e tests are marked to run only in Tez or MR mode only

2017-03-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940461#comment-15940461 ] liyunzhang_intel commented on PIG-5158: --- [~nkollar]:LGTM one question the difference b

[jira] [Commented] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940590#comment-15940590 ] liyunzhang_intel commented on PIG-5167: --- [~nkollar]: commit to spark branch, thanks >

[jira] [Created] (PIG-5197) Replace IndexedKey with PigNullableWritable in spark branch

2017-03-25 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5197: - Summary: Replace IndexedKey with PigNullableWritable in spark branch Key: PIG-5197 URL: https://issues.apache.org/jira/browse/PIG-5197 Project: Pig Issue

[jira] [Updated] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-27 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5167: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Limit_4 is failing with spark

[jira] [Commented] (PIG-5194) HiveUDF fails with Spark exec type

2017-03-27 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944110#comment-15944110 ] liyunzhang_intel commented on PIG-5194: --- [~szita]: the modification for SparkLauncher.

[jira] [Commented] (PIG-4858) Implement Skewed join for spark engine

2017-03-27 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944359#comment-15944359 ] liyunzhang_intel commented on PIG-4858: --- [~kexianda]: as discussed with [~rohini], sk

[jira] [Commented] (PIG-5176) Several ComputeSpec test cases fail

2017-03-27 Thread liyunzhang_intel (JIRA)
[ https://issues-test.apache.org/jira/browse/PIG-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941280#comment-15941280 ] liyunzhang_intel commented on PIG-5176: --- [~nkollar]: based on 213c1bc, using fo

[jira] [Updated] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-27 Thread liyunzhang_intel (JIRA)
[ https://issues-test.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5167: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Limit_4 is failing with

[jira] [Created] (PIG-5197) Merge changes from review board to spark branch

2017-03-28 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5197: - Summary: Merge changes from review board to spark branch Key: PIG-5197 URL: https://issues-test.apache.org/jira/browse/PIG-5197 Project: Pig Issue Type: Su

[jira] [Updated] (PIG-5197) Merge changes from review board to spark branch

2017-03-28 Thread liyunzhang_intel (JIRA)
[ https://issues-test.apache.org/jira/browse/PIG-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5197: -- Attachment: PIG-5197.patch all tests pass except TestGrunt#testGruntUtf8 with PIG-5197.pat

[jira] [Updated] (PIG-5197) Merge changes from review board to spark branch

2017-03-28 Thread liyunzhang_intel (JIRA)
[ https://issues-test.apache.org/jira/browse/PIG-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5197: -- Attachment: PIG-5197.patch > Merge changes from review board to spark branch > --

[jira] [Updated] (PIG-5197) Merge changes from review board to spark branch

2017-03-28 Thread liyunzhang_intel (JIRA)
[ https://issues-test.apache.org/jira/browse/PIG-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5197: -- Attachment: (was: PIG-5197.patch) > Merge changes from review board to spark branch > ---

[jira] [Created] (PIG-5199) exclude jline in spark dependency

2017-03-28 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5199: - Summary: exclude jline in spark dependency Key: PIG-5199 URL: https://issues.apache.org/jira/browse/PIG-5199 Project: Pig Issue Type: Sub-task

[jira] [Updated] (PIG-5199) exclude jline in spark dependency

2017-03-28 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5199: -- Attachment: PIG-5199.patch [~nkollar] and [~szita]: PIG-5199.patch excludes jline dependency. help

[jira] [Assigned] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-28 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned PIG-5163: - Assignee: liyunzhang_intel (was: Nandor Kollar) > MultiQuery_Streaming_1 is failing with s

[jira] [Created] (PIG-5202) Create a TestSparkCompiler test class for spark branch

2017-03-28 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5202: - Summary: Create a TestSparkCompiler test class for spark branch Key: PIG-5202 URL: https://issues.apache.org/jira/browse/PIG-5202 Project: Pig Issue Type:

[jira] [Commented] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946683#comment-15946683 ] liyunzhang_intel commented on PIG-5163: --- [~nkollar]: it is a bug of POJoinGroupSpark#s

[jira] [Commented] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15947927#comment-15947927 ] liyunzhang_intel commented on PIG-5163: --- [~nkollar]: the understanding is right, the

[jira] [Commented] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15947933#comment-15947933 ] liyunzhang_intel commented on PIG-5163: --- [~nkollar]: the patch modify MapReduceLaunche

[jira] [Commented] (PIG-5203) Partitioner E2E test fails on spark

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15947969#comment-15947969 ] liyunzhang_intel commented on PIG-5203: --- [~szita]: 1 question about the patch {code}

[jira] [Assigned] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned PIG-5163: - Assignee: Nandor Kollar (was: liyunzhang_intel) > MultiQuery_Streaming_1 is failing with s

[jira] [Resolved] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-5163. --- Resolution: Fixed > MultiQuery_Streaming_1 is failing with spark exec type > ---

[jira] [Commented] (PIG-5200) Orc_1 and Orc_Pushdown_* tests fail on Spark

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15947984#comment-15947984 ] liyunzhang_intel commented on PIG-5200: --- [~szita]: can we try [spark.yarn.user.class

[jira] [Commented] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948262#comment-15948262 ] liyunzhang_intel commented on PIG-5163: --- [~nkollar]: you can try to modify the plan ac

[jira] [Commented] (PIG-5158) Several e2e tests are marked to run only in Tez or MR mode only

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948268#comment-15948268 ] liyunzhang_intel commented on PIG-5158: --- [~nkollar]: +1 for PIG-5158_4.patch, commit t

[jira] [Resolved] (PIG-5158) Several e2e tests are marked to run only in Tez or MR mode only

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-5158. --- Resolution: Fixed > Several e2e tests are marked to run only in Tez or MR mode only > --

[jira] [Commented] (PIG-5176) Several ComputeSpec test cases fail

2017-03-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948271#comment-15948271 ] liyunzhang_intel commented on PIG-5176: --- [~nkollar]: in my env without patch, all test

[jira] [Commented] (PIG-5197) Replace IndexedKey with PigNullableWritable in spark branch

2017-03-30 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949885#comment-15949885 ] liyunzhang_intel commented on PIG-5197: --- [~rohini]: I tried to replace IndexedKey wih

[jira] [Updated] (PIG-5199) exclude jline in spark dependency

2017-03-30 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5199: -- Status: Patch Available (was: Open) > exclude jline in spark dependency > ---

[jira] [Created] (PIG-5205) Duplicate record key info in GlobalRearrangeConverter#ToGroupKeyValueFunction

2017-03-30 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5205: - Summary: Duplicate record key info in GlobalRearrangeConverter#ToGroupKeyValueFunction Key: PIG-5205 URL: https://issues.apache.org/jira/browse/PIG-5205 Project: Pi

[jira] [Commented] (PIG-4858) Implement Skewed join for spark engine

2017-03-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950552#comment-15950552 ] liyunzhang_intel commented on PIG-4858: --- [~kexianda]: LGTM for PIG-4858_8.patch , comm

[jira] [Resolved] (PIG-4858) Implement Skewed join for spark engine

2017-03-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-4858. --- Resolution: Fixed > Implement Skewed join for spark engine > ---

[jira] [Commented] (PIG-5207) BugFix e2e tests fail on spark

2017-04-03 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15954304#comment-15954304 ] liyunzhang_intel commented on PIG-5207: --- [~szita]: 1 question about the modification i

[jira] [Commented] (PIG-5203) Partitioner E2E test fails on spark

2017-04-04 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955962#comment-15955962 ] liyunzhang_intel commented on PIG-5203: --- [~szita]: cfe.getRequestedParallelism() is

[jira] [Updated] (PIG-5205) Duplicate record key info in GlobalRearrangeConverter#ToGroupKeyValueFunction

2017-04-04 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5205: -- Attachment: PIG-5205.patch all unit tests pass with PIG-5205.patch, now close it as it will be inc

[jira] [Resolved] (PIG-5205) Duplicate record key info in GlobalRearrangeConverter#ToGroupKeyValueFunction

2017-04-04 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-5205. --- Resolution: Fixed > Duplicate record key info in GlobalRearrangeConverter#ToGroupKeyValueFunctio

[jira] [Commented] (PIG-5207) BugFix e2e tests fail on spark

2017-04-05 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15958153#comment-15958153 ] liyunzhang_intel commented on PIG-5207: --- [~szita]: +1 for PIG-5207.1.patch. [~rohini]:

[jira] [Updated] (PIG-5203) Partitioner E2E test fails on spark

2017-04-05 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5203: -- Attachment: PIG-5203.1.patch [~szita]: please help verify PIG-5203.1.patch in e2e test. Have run a

[jira] [Assigned] (PIG-5165) MultiQuery_Union_7 is failing with spark exec type

2017-04-05 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned PIG-5165: - Assignee: liyunzhang_intel > MultiQuery_Union_7 is failing with spark exec type > -

[jira] [Assigned] (PIG-5164) MultiQuery_Union_3 is failing with spark exec type

2017-04-05 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned PIG-5164: - Assignee: liyunzhang_intel > MultiQuery_Union_3 is failing with spark exec type > -

[jira] [Assigned] (PIG-5136) Fix TestPigTest unit test in Spark mode

2017-04-05 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned PIG-5136: - Assignee: liyunzhang_intel > Fix TestPigTest unit test in Spark mode >

[jira] [Updated] (PIG-5136) Fix TestPigTest unit test in Spark mode

2017-04-05 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5136: -- Status: Patch Available (was: Open) > Fix TestPigTest unit test in Spark mode > -

[jira] [Updated] (PIG-5136) Fix TestPigTest unit test in Spark mode

2017-04-05 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5136: -- Attachment: PIG-5136.patch [~szita] or [~nkollar]: please help review > Fix TestPigTest unit test

[jira] [Commented] (PIG-5197) Replace IndexedKey with PigNullableWritable in spark branch

2017-04-06 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15959895#comment-15959895 ] liyunzhang_intel commented on PIG-5197: --- [~rohini]: we can not replace IndexedKey with

[jira] [Updated] (PIG-5197) Replace IndexedKey with PigNullableWritable in spark branch

2017-04-06 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5197: -- Attachment: PIG-5197.patch > Replace IndexedKey with PigNullableWritable in spark branch > ---

[jira] [Comment Edited] (PIG-5197) Replace IndexedKey with PigNullableWritable in spark branch

2017-04-06 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15959895#comment-15959895 ] liyunzhang_intel edited comment on PIG-5197 at 4/6/17 10:28 PM: --

[jira] [Updated] (PIG-5203) Partitioner E2E test fails on spark

2017-04-06 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5203: -- Resolution: Fixed Status: Resolved (was: Patch Available) [~szita]: commit to the branch,

[jira] [Assigned] (PIG-5212) SkewedJoin_6 is failing on Spark

2017-04-06 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned PIG-5212: - Assignee: Xianda Ke > SkewedJoin_6 is failing on Spark > >

[jira] [Assigned] (PIG-5166) GroupAggFunc_9 is failing with spark exec type

2017-04-06 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned PIG-5166: - Assignee: Nandor Kollar > GroupAggFunc_9 is failing with spark exec type >

[jira] [Updated] (PIG-5136) Fix TestPigTest unit test in Spark mode

2017-04-06 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5136: -- Resolution: Fixed Status: Resolved (was: Patch Available) [~nkollar] and [~szita]: thanks

[jira] [Commented] (PIG-5134) Fix TestAvroStorage unit test in Spark mode

2017-04-06 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960207#comment-15960207 ] liyunzhang_intel commented on PIG-5134: --- [~nkollar]: here is my understanding for the

[jira] [Created] (PIG-5215) Merge changes from review board to spark branch

2017-04-07 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5215: - Summary: Merge changes from review board to spark branch Key: PIG-5215 URL: https://issues.apache.org/jira/browse/PIG-5215 Project: Pig Issue Type: Sub-tas

<    1   2   3   4   5   6   7   8   9   10   >