[
https://issues.apache.org/jira/browse/PIG-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4659:
--
Attachment: PIG-4659.patch
Hi [~mohitsabharwal],
PIG-4659.patch is attached. Please help review the code.
p.s.
[
https://issues.apache.org/jira/browse/PIG-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4655:
--
Attachment: PIG-4655.patch
Hi [~mohitsabharwal],
PIG-4655.patch is attached. Would you please help review the
[
https://issues.apache.org/jira/browse/PIG-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700919#comment-14700919
]
kexianda commented on PIG-4659:
---
root cause:
{code:title=test/org/apache/pig/test/data/tc.js}
kexianda created PIG-4660:
-
Summary: Add Spark Unit Tests for SparkPigStats
Key: PIG-4660
URL: https://issues.apache.org/jira/browse/PIG-4660
Project: Pig
Issue Type: Sub-task
Reporter:
kexianda created PIG-4661:
-
Summary: Fix UT failures in TestPigServerLocal
Key: PIG-4661
URL: https://issues.apache.org/jira/browse/PIG-4661
Project: Pig
Issue Type: Sub-task
Reporter:
[
https://issues.apache.org/jira/browse/PIG-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda reassigned PIG-4661:
-
Assignee: kexianda
Fix UT failures in TestPigServerLocal
-
[
https://issues.apache.org/jira/browse/PIG-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4661:
--
Attachment: PIG-4661.patch
Fix UT failures in TestPigServerLocal
-
[
https://issues.apache.org/jira/browse/PIG-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702271#comment-14702271
]
kexianda commented on PIG-4661:
---
In spark mode, Storage was initialized in SortConverter, and
kexianda created PIG-4659:
-
Summary: Fix unit test failures in
org.apache.pig.test.TestScriptLanguageJavaScript
Key: PIG-4659
URL: https://issues.apache.org/jira/browse/PIG-4659
Project: Pig
Issue
[
https://issues.apache.org/jira/browse/PIG-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda reassigned PIG-4659:
-
Assignee: kexianda
Fix unit test failures in org.apache.pig.test.TestScriptLanguageJavaScript
[
https://issues.apache.org/jira/browse/PIG-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4634:
--
Attachment: (was: PIG-4634-3.patch)
Fix records count issues in output statistics
[
https://issues.apache.org/jira/browse/PIG-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4634:
--
Attachment: PIG-4634-3.patch
Fix records count issues in output statistics
[
https://issues.apache.org/jira/browse/PIG-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696319#comment-14696319
]
kexianda commented on PIG-4645:
---
Hi [~xuefuz], it seems that the code are not committed to
[
https://issues.apache.org/jira/browse/PIG-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4634:
--
Attachment: PIG-4634-3.patch
Fix records count issues in output statistics
[
https://issues.apache.org/jira/browse/PIG-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693038#comment-14693038
]
kexianda commented on PIG-4634:
---
Hi [~mohitsabharwal] [~xuefuz],
PIG-4634-3.patch is
kexianda created PIG-4655:
-
Summary: Support InputStats in spark mode
Key: PIG-4655
URL: https://issues.apache.org/jira/browse/PIG-4655
Project: Pig
Issue Type: Sub-task
Reporter:
[
https://issues.apache.org/jira/browse/PIG-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda reassigned PIG-4655:
-
Assignee: kexianda
Support InputStats in spark mode
[
https://issues.apache.org/jira/browse/PIG-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679791#comment-14679791
]
kexianda commented on PIG-4645:
---
[~mohitsabharwal], thanks for your comments.
The build-in
[
https://issues.apache.org/jira/browse/PIG-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4645:
--
Attachment: PIG-4645.patch
Support hadoop-like Counter using spark accumulator
[
https://issues.apache.org/jira/browse/PIG-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659317#comment-14659317
]
kexianda commented on PIG-4645:
---
Implement a Hadoop-like Counter, using Spark Accumulator.
[
https://issues.apache.org/jira/browse/PIG-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4645:
--
Summary: Support hadoop-like Counter using spark accumulator (was: Collect
Input/Output Statistics of Spark Job)
[
https://issues.apache.org/jira/browse/PIG-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda reassigned PIG-4645:
-
Assignee: kexianda
Collect Input/Output Statistics of Spark Job
kexianda created PIG-4645:
-
Summary: Collect Input/Output Statistics of Spark Job
Key: PIG-4645
URL: https://issues.apache.org/jira/browse/PIG-4645
Project: Pig
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/PIG-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643721#comment-14643721
]
kexianda commented on PIG-4634:
---
Hi [~xuefuz], When I investigating the Input Statistics
[
https://issues.apache.org/jira/browse/PIG-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643713#comment-14643713
]
kexianda commented on PIG-4594:
---
Hi [~xuefuz], I have resolved the conflicts.
[
https://issues.apache.org/jira/browse/PIG-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641986#comment-14641986
]
kexianda commented on PIG-4594:
---
Hi [~mohitsabharwal], In MR implementation, when connect a
[
https://issues.apache.org/jira/browse/PIG-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4634:
--
Attachment: PIG-4634_2.patch
Fix records count issues in output statistics
[
https://issues.apache.org/jira/browse/PIG-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638486#comment-14638486
]
kexianda commented on PIG-4634:
---
Hi [~xuefuz],
latest patch(PIG-4634_2.patch) is attached.
kexianda created PIG-4634:
-
Summary: Fix records count issues in output statistics
Key: PIG-4634
URL: https://issues.apache.org/jira/browse/PIG-4634
Project: Pig
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/PIG-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4634:
--
Attachment: PIG-4634.patch
Hi [~xuefuz], PIG-4634.patch is attached. Please help review the code.
1. initialize
[
https://issues.apache.org/jira/browse/PIG-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625834#comment-14625834
]
kexianda commented on PIG-4594:
---
Ok, [~xuefuz], I will take a look at this JIRA and prepare
[
https://issues.apache.org/jira/browse/PIG-4633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625690#comment-14625690
]
kexianda commented on PIG-4633:
---
hi [~mohitsabharwal] I was fixing TestPigRunner failures.
[
https://issues.apache.org/jira/browse/PIG-4633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4633:
--
Attachment: PIG-4633.patch
Hi [~mohitsabharwal], patch is attached. Please help review.
Thanks,
Xianda
fix
kexianda created PIG-4633:
-
Summary: fix libaray version to enable output statistics for Pig
on spark
Key: PIG-4633
URL: https://issues.apache.org/jira/browse/PIG-4633
Project: Pig
Issue Type:
[
https://issues.apache.org/jira/browse/PIG-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4613:
--
Attachment: (was: PIG-4613.patch)
Fix unit test failures about TestAssert
[
https://issues.apache.org/jira/browse/PIG-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611503#comment-14611503
]
kexianda commented on PIG-4613:
---
Hi [~mohitsabharwal] [~kellyzly], Thanks for your
[
https://issues.apache.org/jira/browse/PIG-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4613:
--
Attachment: PIG-4613.patch
Fix unit test failures about TestAssert
---
[
https://issues.apache.org/jira/browse/PIG-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4613:
--
Attachment: PIG-4613.patch
Fix unit test failures about TestAssert
---
[
https://issues.apache.org/jira/browse/PIG-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605229#comment-14605229
]
kexianda commented on PIG-4613:
---
The test cases failed because the exception is different
kexianda created PIG-4616:
-
Summary: Fix UT errors of TestPigRunner in Spark mode
Key: PIG-4616
URL: https://issues.apache.org/jira/browse/PIG-4616
Project: Pig
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4607:
--
Attachment: (was: PIG-4607.patch)
Enable TestRank1,TestRank3 unit tests in spark mode
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4607:
--
Attachment: PIG-4607.patch
Hi [~mohitsabharwal],
new PIG-4607.patch is attached. Minor update. Use
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4607:
--
Attachment: PIG-4607.patch
Enable TestRank1,TestRank3 unit tests in spark mode
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4607:
--
Attachment: (was: PIG-4607.patch)
Enable TestRank1,TestRank3 unit tests in spark mode
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4607:
--
Attachment: PIG-4607.patch
This patch includes:
1. add Counter Rank operators for sparkplan
2. Fix testcase
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4607:
--
Attachment: (was: PIG-4607.patch)
Enable TestRank1,TestRank3 unit tests in spark mode
kexianda created PIG-4613:
-
Summary: Fix unit test failures about TestAssert
Key: PIG-4613
URL: https://issues.apache.org/jira/browse/PIG-4613
Project: Pig
Issue Type: Sub-task
Reporter:
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4607:
--
Status: Patch Available (was: Open)
Enable TestRank1,TestRank3 unit tests in spark mode
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4607:
--
Attachment: (was: PIG-4607.patch)
Enable TestRank1,TestRank3 unit tests in spark mode
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4607:
--
Attachment: PIG-4607.patch
Hi [~kellyzly] [~mohitsabharwal],
patch is updated:
1. add Counter Rank operators
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598741#comment-14598741
]
kexianda commented on PIG-4607:
---
Hi [~mohitsabharwal],
1. Why TestRank2 passed?
in the
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598749#comment-14598749
]
kexianda commented on PIG-4607:
---
1. Why TestRank2 passed?
in the verifyExpected function,
[
https://issues.apache.org/jira/browse/PIG-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4607:
--
Attachment: PIG-4607.patch
Hi [~kellyzly] [~mohitsabharwal],
Please help review the code. patch is attached.
kexianda created PIG-4605:
-
Summary: fix a bug when coping Jar to SparkJob working directory
Key: PIG-4605
URL: https://issues.apache.org/jira/browse/PIG-4605
Project: Pig
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/PIG-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4605:
--
Attachment: PIG-4605.patch
Hi [~kellyzly] [~mohitsabharwal],
PIG-4605.patch is attached. Please help review the
[
https://issues.apache.org/jira/browse/PIG-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4605:
--
Description:
The function SparkLauncher.addJarToSparkJobWorkingDirectory() try to copy the
user's Jar files to
[
https://issues.apache.org/jira/browse/PIG-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4605:
--
Description:
The function SparkLauncher.addJarToSparkJobWorkingDirectory() try to copy the
user's Jar files to
[
https://issues.apache.org/jira/browse/PIG-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581694#comment-14581694
]
kexianda commented on PIG-4597:
---
Hi [~kellyzly] [~mohitsabharwal],
PIG-4597.patch is
[
https://issues.apache.org/jira/browse/PIG-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4597:
--
Attachment: PIG-4597.patch
Enable TestNullConstant unit test in spark mode
kexianda created PIG-4597:
-
Summary: Enable TestNullConstant unit test in spark mode
Key: PIG-4597
URL: https://issues.apache.org/jira/browse/PIG-4597
Project: Pig
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/PIG-4589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4589:
--
Status: Patch Available (was: Open)
Fix unit test failure in TestCase
-
[
https://issues.apache.org/jira/browse/PIG-4589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4589:
--
Description:
ant -Dtestcase=TestCase -Dexectype=spark -DdebugPort= -Dhadoopversion=23
test
You will find
[
https://issues.apache.org/jira/browse/PIG-4589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4589:
--
Attachment: PIG-4589.patch
Hi [~kellyzly] [~mohitsabharwal],
I fixed an UT error. Please help review the code.
kexianda created PIG-4589:
-
Summary: Fix unit test failure in TestCase
Key: PIG-4589
URL: https://issues.apache.org/jira/browse/PIG-4589
Project: Pig
Issue Type: Sub-task
Reporter:
[
https://issues.apache.org/jira/browse/PIG-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4582:
--
Attachment: PIG-4582_1.patch
Hi [~mohitsabharwal] and [~kellyzly],
patch is updated. minimal change: remove
[
https://issues.apache.org/jira/browse/PIG-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on PIG-4582 started by kexianda.
-
Enable TestPruneColumn in spark mode
--
[
https://issues.apache.org/jira/browse/PIG-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4582:
--
Attachment: PIG-4582.patch
hi [~mohitsabharwal] and [~kellyzly]:
in PIG-4582.patch,changes are:
1. sort the group
[
https://issues.apache.org/jira/browse/PIG-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kexianda updated PIG-4582:
--
Attachment: (was: PIG-4582.patch)
Enable TestPruneColumn in spark mode
[
https://issues.apache.org/jira/browse/PIG-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572004#comment-14572004
]
kexianda commented on PIG-4582:
---
Hi [~mohitsabharwal],
the name of
[
https://issues.apache.org/jira/browse/PIG-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572002#comment-14572002
]
kexianda commented on PIG-4582:
---
Hi [~mohitsabharwal],
the name of
kexianda created PIG-4582:
-
Summary: Enable TestPruneColumn in spark mode
Key: PIG-4582
URL: https://issues.apache.org/jira/browse/PIG-4582
Project: Pig
Issue Type: Sub-task
Reporter:
71 matches
Mail list logo