[jira] [Commented] (PIG-5215) Merge changes from review board to spark branch

2017-04-07 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960429#comment-15960429 ] liyunzhang_intel commented on PIG-5215: --- [~szita] and [~nkollar]: If have time, pleas

[jira] [Commented] (PIG-5215) Merge changes from review board to spark branch

2017-04-07 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15960433#comment-15960433 ] liyunzhang_intel commented on PIG-5215: --- [~nkollar] and [~szita]: copy the comment fro

[jira] [Updated] (PIG-5200) Orc_1 and Orc_Pushdown_* tests fail on Spark

2017-04-08 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5200: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Orc_1 and Orc_Pushdown_* test

[jira] [Commented] (PIG-5200) Orc_1 and Orc_Pushdown_* tests fail on Spark

2017-04-08 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15961978#comment-15961978 ] liyunzhang_intel commented on PIG-5200: --- [~szita]: thanks for your work, commit to the

[jira] [Resolved] (PIG-5135) Fix TestOrcStoragePushdown unit test in Spark mode

2017-04-08 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-5135. --- Resolution: Duplicate duplicate with PIG-5200 > Fix TestOrcStoragePushdown unit test in Spark m

[jira] [Updated] (PIG-4846) Use pigmix to test the performance of pig on spark

2017-04-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4846: -- Attachment: PIG-4846_2.patch [~nkollar] and [~szita]: PIG-4846_2.patch is based on e65cdd1. > Us

[jira] [Updated] (PIG-5215) Merge changes from review board to spark branch

2017-04-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5215: -- Attachment: PIG-5215.patch [~szita]:repatch and help review. > Merge changes from review board to

[jira] [Commented] (PIG-5215) Merge changes from review board to spark branch

2017-04-10 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15962584#comment-15962584 ] liyunzhang_intel commented on PIG-5215: --- [~szita]: all unit tests pass in my local je

[jira] [Commented] (PIG-5176) Several ComputeSpec test cases fail

2017-04-10 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15963576#comment-15963576 ] liyunzhang_intel commented on PIG-5176: --- [~nkollar]: add following code to every e2e

[jira] [Commented] (PIG-5212) SkewedJoin_6 is failing on Spark

2017-04-10 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15963793#comment-15963793 ] liyunzhang_intel commented on PIG-5212: --- script: {code} a = load './studenttab10k.mk';

[jira] [Updated] (PIG-5212) SkewedJoin_6 is failing on Spark

2017-04-10 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5212: -- Attachment: PIG-5212.patch after PIG-5212.patch. The spark plan changes to {code} - scope-57-

[jira] [Commented] (PIG-5176) Several ComputeSpec test cases fail

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964023#comment-15964023 ] liyunzhang_intel commented on PIG-5176: --- [~nkollar]: if use the patch, user can not up

[jira] [Assigned] (PIG-5212) SkewedJoin_6 is failing on Spark

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned PIG-5212: - Assignee: liyunzhang_intel (was: Xianda Ke) > SkewedJoin_6 is failing on Spark > -

[jira] [Updated] (PIG-5212) SkewedJoin_6 is failing on Spark

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5212: -- Status: Patch Available (was: Open) > SkewedJoin_6 is failing on Spark >

[jira] [Commented] (PIG-5212) SkewedJoin_6 is failing on Spark

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965241#comment-15965241 ] liyunzhang_intel commented on PIG-5212: --- [~nkollar]: PIG-5212.patch is available and a

[jira] [Updated] (PIG-5202) Create a TestSparkCompiler test class for spark branch

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5202: -- Resolution: Fixed Status: Resolved (was: Patch Available) [~szita]: LGTM, commit to the s

[jira] [Updated] (PIG-5176) Several ComputeSpec test cases fail

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5176: -- Resolution: Fixed Status: Resolved (was: Patch Available) [~nkollar]: LGTM, commit to the

[jira] [Commented] (PIG-5215) Merge changes from review board to spark branch

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965272#comment-15965272 ] liyunzhang_intel commented on PIG-5215: --- [~szita]: according to comment, update PIG-52

[jira] [Updated] (PIG-5215) Merge changes from review board to spark branch

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5215: -- Attachment: PIG-5215.1.patch > Merge changes from review board to spark branch > -

[jira] [Commented] (PIG-5169) SkewedJoin_13 is failing with spark exec type

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965274#comment-15965274 ] liyunzhang_intel commented on PIG-5169: --- after PIG-5206 fixed, verify SkewedJoin_13,14

[jira] [Commented] (PIG-5135) Fix TestOrcStoragePushdown unit test in Spark mode

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965286#comment-15965286 ] liyunzhang_intel commented on PIG-5135: --- [~szita]: quickly review the patch. revert ch

[jira] [Commented] (PIG-5165) MultiQuery_Union_7 is failing with spark exec type

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965389#comment-15965389 ] liyunzhang_intel commented on PIG-5165: --- MultiQuery_Union_7.pig {code} a = load './st

[jira] [Commented] (PIG-5165) MultiQuery_Union_7 is failing with spark exec type

2017-04-11 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965398#comment-15965398 ] liyunzhang_intel commented on PIG-5165: --- the predecessors of POSkewedJoin are valid in

[jira] [Commented] (PIG-5135) HDFS bytes read stats are always 0 in Spark mode

2017-04-12 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966615#comment-15966615 ] liyunzhang_intel commented on PIG-5135: --- [~szita]: I see. please create a jira board

[jira] [Updated] (PIG-4788) the value BytesRead metric info always returns 0 even the length of input file is not 0 in spark engine

2017-04-12 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4788: -- Resolution: Duplicate Status: Resolved (was: Patch Available) duplicate with PIG-5135 >

[jira] [Commented] (PIG-5171) SecondarySort_7 is failing with spark exec type

2017-04-12 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967212#comment-15967212 ] liyunzhang_intel commented on PIG-5171: --- [~nkollar]: it is a problem of mr. I guess if

[jira] [Comment Edited] (PIG-5171) SecondarySort_7 is failing with spark exec type

2017-04-13 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967212#comment-15967212 ] liyunzhang_intel edited comment on PIG-5171 at 4/13/17 7:00 AM: --

[jira] [Updated] (PIG-5171) SecondarySort_7 is failing with spark exec type

2017-04-14 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5171: -- Attachment: PIG-5171.patch [~nkollar]: help review PIG-5171.patch, with the patch , SecondarySort

[jira] [Reopened] (PIG-5202) Create a TestSparkCompiler test class for spark branch

2017-04-17 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reopened PIG-5202: --- in [#392|https://builds.apache.org/job/Pig-spark/lastUnsuccessfulBuild/testReport/org.apache.pig.sp

[jira] [Updated] (PIG-5212) SkewedJoin_6 is failing on Spark

2017-04-17 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5212: -- Attachment: PIG-5212_2.patch [~kexianda]: PIG-5212_2.patch is based on latest code(03dcf4f) > Sk

[jira] [Commented] (PIG-5202) Create a TestSparkCompiler test class for spark branch

2017-04-18 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15973887#comment-15973887 ] liyunzhang_intel commented on PIG-5202: --- [~szita]: got it, commit PIG-5202.disableDOTf

[jira] [Updated] (PIG-5202) Create a TestSparkCompiler test class for spark branch

2017-04-18 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5202: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Create a TestSparkCompiler te

[jira] [Commented] (PIG-5047) support outer join for skewedjoin in spark mode

2017-04-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974276#comment-15974276 ] liyunzhang_intel commented on PIG-5047: --- [~kexianda]: help test whether SkewedJoin_12

[jira] [Updated] (PIG-5212) SkewedJoin_6 is failing on Spark

2017-04-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5212: -- Resolution: Fixed Status: Resolved (was: Patch Available) [~kexianda]: thanks for review.

[jira] [Commented] (PIG-5171) SecondarySort_7 is failing with spark exec type

2017-04-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974299#comment-15974299 ] liyunzhang_intel commented on PIG-5171: --- [~nkollar]: thanks for review. commit to bran

[jira] [Commented] (PIG-5176) Several ComputeSpec test cases fail

2017-04-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974329#comment-15974329 ] liyunzhang_intel commented on PIG-5176: --- [~nkollar]: rebase the patch, commit to the b

[jira] [Commented] (PIG-5218) Jyhton_Checkin_3 fails with spark exec type

2017-04-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975919#comment-15975919 ] liyunzhang_intel commented on PIG-5218: --- [~szita]: the modification related common cod

[jira] [Comment Edited] (PIG-5218) Jyhton_Checkin_3 fails with spark exec type

2017-04-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975919#comment-15975919 ] liyunzhang_intel edited comment on PIG-5218 at 4/20/17 2:02 AM: --

[jira] [Commented] (PIG-5135) HDFS bytes read stats are always 0 in Spark mode

2017-04-20 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15978017#comment-15978017 ] liyunzhang_intel commented on PIG-5135: --- [~szita]: include PIG-5135.1.patch to the tot

[jira] [Updated] (PIG-5215) Merge changes from review board to spark branch

2017-04-20 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5215: -- Attachment: PIG-5215.2.patch [~szita]: PIG-5215.2.patch relates small fix, help review > Merge ch

[jira] [Updated] (PIG-5171) SecondarySort_7 is failing with spark exec type

2017-04-21 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5171: -- Resolution: Fixed Status: Resolved (was: Patch Available) > SecondarySort_7 is failing wi

[jira] [Commented] (PIG-5166) GroupAggFunc_9 is failing with spark exec type

2017-04-21 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15978263#comment-15978263 ] liyunzhang_intel commented on PIG-5166: --- [~nkollar]: this problem is similar as PIG-42

[jira] [Commented] (PIG-5165) MultiQuery_Union_7 is failing with spark exec type

2017-04-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980876#comment-15980876 ] liyunzhang_intel commented on PIG-5165: --- [~szita]: I guess that the modification in Jo

[jira] [Commented] (PIG-5047) support outer join for skewedjoin in spark mode

2017-04-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982246#comment-15982246 ] liyunzhang_intel commented on PIG-5047: --- [~kexianda]: commit to the spark branch, than

[jira] [Commented] (PIG-5166) GroupAggFunc_9 is failing with spark exec type

2017-04-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985599#comment-15985599 ] liyunzhang_intel commented on PIG-5166: --- [~szita]: +1 for PIG-5166.0.patch, commit to

[jira] [Updated] (PIG-5166) GroupAggFunc_9 is failing with spark exec type

2017-04-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5166: -- Resolution: Fixed Status: Resolved (was: Patch Available) > GroupAggFunc_9 is failing wit

[jira] [Commented] (PIG-5165) MultiQuery_Union_7 is failing with spark exec type

2017-04-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985876#comment-15985876 ] liyunzhang_intel commented on PIG-5165: --- [~szita]: commit to spark branch, thanks! for

[jira] [Updated] (PIG-5165) MultiQuery_Union_7 is failing with spark exec type

2017-04-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5165: -- Resolution: Fixed Status: Resolved (was: Patch Available) > MultiQuery_Union_7 is failing

[jira] [Updated] (PIG-5164) MultiQuery_Union_3 is failing with spark exec type

2017-04-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5164: -- Resolution: Fixed Status: Resolved (was: Patch Available) > MultiQuery_Union_3 is failing

[jira] [Commented] (PIG-5164) MultiQuery_Union_3 is failing with spark exec type

2017-04-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985999#comment-15985999 ] liyunzhang_intel commented on PIG-5164: --- [~szita]: commit to the spark branch, thanks!

[jira] [Created] (PIG-5230) Fix the RuntimeException throws in SecondaryKeySortUtil

2017-04-26 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5230: - Summary: Fix the RuntimeException throws in SecondaryKeySortUtil Key: PIG-5230 URL: https://issues.apache.org/jira/browse/PIG-5230 Project: Pig Issue Type:

[jira] [Updated] (PIG-5230) Fix the RuntimeException throws in SecondaryKeySortUtil

2017-04-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5230: -- Attachment: PIG-5230.patch [~szita]: help review. > Fix the RuntimeException throws in SecondaryK

[jira] [Commented] (PIG-5230) Fix the RuntimeException throws in SecondaryKeySortUtil

2017-04-28 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15988432#comment-15988432 ] liyunzhang_intel commented on PIG-5230: --- [~szita]: +1, ready to commit to spark branch

[jira] [Resolved] (PIG-5230) Fix the RuntimeException throws in SecondaryKeySortUtil

2017-04-28 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-5230. --- Resolution: Fixed > Fix the RuntimeException throws in SecondaryKeySortUtil > --

[jira] [Commented] (PIG-5228) Orc_2 is failing with spark exec type

2017-04-28 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15988443#comment-15988443 ] liyunzhang_intel commented on PIG-5228: --- [~szita]: Orc_2 does not fail in my env with

[jira] [Commented] (PIG-5228) Orc_2 is failing with spark exec type

2017-05-01 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991940#comment-15991940 ] liyunzhang_intel commented on PIG-5228: --- [~szita]: {quote} liyunzhang_intel this still

[jira] [Updated] (PIG-4854) Merge spark branch to trunk

2017-05-03 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4854: -- Resolution: Fixed Status: Resolved (was: Patch Available) duplicate with PIG-5215 > Merg

[jira] [Updated] (PIG-5215) Merge changes from review board to spark branch

2017-05-04 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5215: -- Attachment: (was: PIG-5215.2.patch) > Merge changes from review board to spark branch > --

[jira] [Updated] (PIG-5215) Merge changes from review board to spark branch

2017-05-04 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5215: -- Attachment: PIG-5215.3.patch [~szita]: help review PIG-5215.3.patch changes: 1.remove unecessary r

[jira] [Commented] (PIG-5215) Merge changes from review board to spark branch

2017-05-05 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997920#comment-15997920 ] liyunzhang_intel commented on PIG-5215: --- [~szita]: thanks for review. Commit to branch

[jira] [Commented] (PIG-5199) exclude jline in spark dependency

2017-05-05 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997962#comment-15997962 ] liyunzhang_intel commented on PIG-5199: --- [~szita]: based on current branch code(d6bf43

[jira] [Commented] (PIG-5218) Jyhton_Checkin_3 fails with spark exec type

2017-05-07 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16000247#comment-16000247 ] liyunzhang_intel commented on PIG-5218: --- [~rohini]: commit to the branch. [~szita]: th

[jira] [Updated] (PIG-5215) Merge changes from review board to spark branch

2017-05-07 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5215: -- Issue Type: Bug (was: Sub-task) Parent: (was: PIG-4059) > Merge changes from review b

[jira] [Commented] (PIG-5228) Orc_2 is failing with spark exec type

2017-05-14 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010032#comment-16010032 ] liyunzhang_intel commented on PIG-5228: --- [~szita] and [~rohini]: commit to the spark b

[jira] [Issue Comment Deleted] (PIG-5228) Orc_2 is failing with spark exec type

2017-05-14 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5228: -- Comment: was deleted (was: [~szita] and [~rohini]: commit to the spark branch, thanks for contrib

[jira] [Commented] (PIG-5135) HDFS bytes read stats are always 0 in Spark mode

2017-05-17 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16014833#comment-16014833 ] liyunzhang_intel commented on PIG-5135: --- [~szita]: will update the review board accord

[jira] [Commented] (PIG-5135) HDFS bytes read stats are always 0 in Spark mode

2017-05-17 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16015285#comment-16015285 ] liyunzhang_intel commented on PIG-5135: --- [~rohini]: there is some problem in last chec

[jira] [Updated] (PIG-5199) exclude jline in spark dependency

2017-05-17 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5199: -- Resolution: Fixed Status: Resolved (was: Patch Available) [~szita]: LGTM, commit to the s

[jira] [Commented] (PIG-5199) exclude jline in spark dependency

2017-05-17 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16015301#comment-16015301 ] liyunzhang_intel commented on PIG-5199: --- [~szita]: 1 question, it seems that pig-0.17-

[jira] [Assigned] (PIG-5199) exclude jline in spark dependency

2017-05-17 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned PIG-5199: - Assignee: Adam Szita (was: liyunzhang_intel) > exclude jline in spark dependency > ---

[jira] [Commented] (PIG-5207) BugFix e2e tests fail on spark

2017-05-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16016999#comment-16016999 ] liyunzhang_intel commented on PIG-5207: --- [~rohini]: can you spend some time to view th

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017007#comment-16017007 ] liyunzhang_intel commented on PIG-5157: --- [~rohini],[~xuefuz],[~zjffdu]: Should we supp

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-21 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019070#comment-16019070 ] liyunzhang_intel commented on PIG-5157: --- [~zjffdu] and [~rohini]: thanks for your sugg

[jira] [Commented] (PIG-5194) HiveUDF fails with Spark exec type

2017-05-21 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019171#comment-16019171 ] liyunzhang_intel commented on PIG-5194: --- with the patch, it passes in both spark and m

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022446#comment-16022446 ] liyunzhang_intel commented on PIG-5157: --- [~nkollar]: bq. the optimizations offered (pr

[jira] [Created] (PIG-5239) Investigate why there are duplicated A[3,4] inTestLocationInPhysicalPlan#test in spark mode

2017-05-24 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5239: - Summary: Investigate why there are duplicated A[3,4] inTestLocationInPhysicalPlan#test in spark mode Key: PIG-5239 URL: https://issues.apache.org/jira/browse/PIG-5239

[jira] [Updated] (PIG-5239) Investigate why there are duplicated A[3,4] inTestLocationInPhysicalPlan#test in spark mode

2017-05-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5239: -- Issue Type: Sub-task (was: Bug) Parent: PIG-4059 > Investigate why there are duplicated A

[jira] [Created] (PIG-5240) Fix TestPigRunner#simpleMultiQueryTest3 in spark mode for wrong inputStats

2017-05-24 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5240: - Summary: Fix TestPigRunner#simpleMultiQueryTest3 in spark mode for wrong inputStats Key: PIG-5240 URL: https://issues.apache.org/jira/browse/PIG-5240 Project: Pig

[jira] [Commented] (PIG-5135) HDFS bytes read stats are always 0 in Spark mode

2017-05-24 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16024218#comment-16024218 ] liyunzhang_intel commented on PIG-5135: --- [~szita]: bq.I've checked this, it seems that

[jira] [Created] (PIG-5241) Specify the hdfs path directly to spark and avoid the unnecessary download and upload in SparkLauncher.java

2017-05-24 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5241: - Summary: Specify the hdfs path directly to spark and avoid the unnecessary download and upload in SparkLauncher.java Key: PIG-5241 URL: https://issues.apache.org/jira/browse/PIG

[jira] [Commented] (PIG-5215) Merge changes from review board to spark branch

2017-05-25 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16024321#comment-16024321 ] liyunzhang_intel commented on PIG-5215: --- [~szita]: update PIG-5215.4.patch, compilati

[jira] [Updated] (PIG-5215) Merge changes from review board to spark branch

2017-05-25 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5215: -- Attachment: PIG-5215.4.patch > Merge changes from review board to spark branch > -

[jira] [Updated] (PIG-5215) Merge changes from review board to spark branch

2017-05-25 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5215: -- Attachment: PIG-5215.4.patch [~sztia]: update latest PIG-5215.4.patch. > Merge changes from rev

[jira] [Updated] (PIG-5215) Merge changes from review board to spark branch

2017-05-25 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5215: -- Attachment: (was: PIG-5215.4.patch) > Merge changes from review board to spark branch > --

[jira] [Reopened] (PIG-5167) Limit_4 is failing with spark exec type

2017-05-25 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reopened PIG-5167: --- reopen it as Rohini suggested to fix it in another method: bq.Testing distinct + orderby + limit ser

[jira] [Updated] (PIG-5215) Merge changes from review board to spark branch

2017-05-25 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5215: -- Attachment: PIG-5215.5.patch [~szita]: thanks for fix. Include PIG-5215.4.fixes.patch and PIG-52

[jira] [Commented] (PIG-5167) Limit_4 is failing with spark exec type

2017-05-25 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025723#comment-16025723 ] liyunzhang_intel commented on PIG-5167: --- [~nkollar]: my suggestion is 1. add a new ve

[jira] [Commented] (PIG-5215) Merge changes from review board to spark branch

2017-05-25 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025902#comment-16025902 ] liyunzhang_intel commented on PIG-5215: --- [~szita]: sorry, the commit fail, i will comm

[jira] [Comment Edited] (PIG-5215) Merge changes from review board to spark branch

2017-05-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025902#comment-16025902 ] liyunzhang_intel edited comment on PIG-5215 at 5/26/17 7:01 AM: --

[jira] [Commented] (PIG-5215) Merge changes from review board to spark branch

2017-05-26 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025908#comment-16025908 ] liyunzhang_intel commented on PIG-5215: --- [~szita]: the only possible change is PIG-516

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028651#comment-16028651 ] liyunzhang_intel commented on PIG-5157: --- [~nkollar]: will review tomorrow as Monday an

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030799#comment-16030799 ] liyunzhang_intel commented on PIG-5157: --- [~nkollar]: bq. in JobMetricsListener.java th

[jira] [Comment Edited] (PIG-5157) Upgrade to Spark 2.0

2017-05-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030799#comment-16030799 ] liyunzhang_intel edited comment on PIG-5157 at 5/31/17 7:54 AM: --

[jira] [Created] (PIG-5246) Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2

2017-05-31 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-5246: - Summary: Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2 Key: PIG-5246 URL: https://issues.apache.org/jira/browse/PIG-5246 Project: P

[jira] [Commented] (PIG-5245) TestGrunt.testStopOnFailure is flaky

2017-05-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030847#comment-16030847 ] liyunzhang_intel commented on PIG-5245: --- [~rohini]: stop_on_failure is implemented in

[jira] [Commented] (PIG-5247) Investigate stopOnFailure feature with Spark execution engine

2017-05-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032292#comment-16032292 ] liyunzhang_intel commented on PIG-5247: --- [~szita]: what i am confused is currently thi

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032514#comment-16032514 ] liyunzhang_intel commented on PIG-5157: --- [~nkollar]: have tested that we can remove Jo

[jira] [Updated] (PIG-5246) Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2

2017-05-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5246: -- Attachment: PIG-5246.patch [~nkollar], [~szita]: help review in spark2, spark-assembly*.jar does

[jira] [Updated] (PIG-5246) Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2

2017-05-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5246: -- Status: Patch Available (was: Open) > Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after u

[jira] [Updated] (PIG-5246) Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2

2017-06-01 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5246: -- Attachment: PIG-5246.1.patch [~nkollar]: in PIG-5246.1.patch, modify {{spark16}} to {{spark1}} and

<    1   2   3   4   5   6   7   8   9   10   >