[jira] [Commented] (PIG-5316) Initialize mapred.task.id property for PoS jobs

[ https://issues.apache.org/jira/browse/PIG-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269241#comment-16269241 ] Xuefu Zhang commented on PIG-5316: -- [~nkollar], Sorry for the late reply. {quote} Though MRConfiguration

[jira] [Commented] (PIG-5316) Initialize mapred.task.id property for PoS jobs

[ https://issues.apache.org/jira/browse/PIG-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259301#comment-16259301 ] Xuefu Zhang commented on PIG-5316: -- [~nkollar], while it might be just an placeholder, it's used to create

[jira] [Commented] (PIG-4059) Pig on Spark

[ https://issues.apache.org/jira/browse/PIG-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029736#comment-16029736 ] Xuefu Zhang commented on PIG-4059: -- Great jobs! Thanks to everyone for making this happen! > Pig on Sp

Re: [ANNOUNCE] Welcome new Pig Committer - Adam Szita

Congratulations, Adam! On Mon, May 22, 2017 at 10:51 AM, Rohini Palaniswamy < rohini.adi...@gmail.com> wrote: > Hi all, > It is my pleasure to announce that Adam Szita has been voted in as a > committer to Apache Pig. Please join me in congratulating Adam. Adam has > been actively

[jira] [Updated] (PIG-5104) Union_15 e2e test failing on Spark

[ https://issues.apache.org/jira/browse/PIG-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-5104: - Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to Spark branch. Thanks

[jira] [Commented] (PIG-5167) Limit_4 is failing with spark exec type

[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904298#comment-15904298 ] Xuefu Zhang commented on PIG-5167: -- Add sorting is a quick fix. It's fine if it doesn't impact too much

[jira] [Commented] (PIG-5133) Commit changes from last round of review on rb

[ https://issues.apache.org/jira/browse/PIG-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904290#comment-15904290 ] Xuefu Zhang commented on PIG-5133: -- Committed to Spark branch. Thanks, Liyun! > Commit changes from l

[jira] [Resolved] (PIG-5044) Create SparkCompiler#getSamplingJob in spark mode

[ https://issues.apache.org/jira/browse/PIG-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-5044. -- Resolution: Fixed Committed to Spark branch. Thanks. > Create SparkCompiler#getSamplingJob in spark m

[jira] [Resolved] (PIG-4952) Calculate the value of parallism for spark mode

[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4952. -- Resolution: Fixed Patch committed to Spark branch. Thanks, Liyun! > Calculate the value of parall

[jira] [Updated] (PIG-4815) Add xml format support for 'explain' in spark engine

[ https://issues.apache.org/jira/browse/PIG-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4815: - Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to Spark branch. Thanks

[jira] [Updated] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

[ https://issues.apache.org/jira/browse/PIG-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-5068: - Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (PIG-4899) The number of records of input file is calculated wrongly in spark mode in multiquery case

[ https://issues.apache.org/jira/browse/PIG-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4899: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks, Adam

[jira] [Commented] (PIG-5052) Initialize MRConfiguration.JOB_ID in spark mode correctly

[ https://issues.apache.org/jira/browse/PIG-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685729#comment-15685729 ] Xuefu Zhang commented on PIG-5052: -- PIG-5052.3-incrementalToPatch1.patch is committed. Shall we close

[jira] [Updated] (PIG-5051) Initialize PigContants.TASK_INDEX in spark mode correctly

[ https://issues.apache.org/jira/browse/PIG-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-5051: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to spark branch. Thanks, Liyun

[jira] [Updated] (PIG-5052) Initialize MRConfiguration.JOB_ID in spark mode correctly

[ https://issues.apache.org/jira/browse/PIG-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-5052: - Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to spark branch. Thanks

[jira] [Commented] (PIG-5051) Initialize PigContants.TASK_INDEX in spark mode correctly

[ https://issues.apache.org/jira/browse/PIG-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614166#comment-15614166 ] Xuefu Zhang commented on PIG-5051: -- Not sure why it didn't go thur. I did a "svn update" and it

[jira] [Updated] (PIG-4920) Fail to use Javascript UDF in spark yarn client mode

[ https://issues.apache.org/jira/browse/PIG-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4920: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to spark branch. Thanks, Liyun

[jira] [Resolved] (PIG-4969) Optimize combine case for spark mode

[ https://issues.apache.org/jira/browse/PIG-4969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4969. -- Resolution: Fixed Fix Version/s: spark-branch Committed to Spark branch. Thanks, Liyun

[jira] [Comment Edited] (PIG-5024) add a physical operator to broadcast small RDDs

[ https://issues.apache.org/jira/browse/PIG-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475913#comment-15475913 ] Xuefu Zhang edited comment on PIG-5024 at 9/9/16 4:51 AM: -- Committed to Spark

[jira] [Resolved] (PIG-5024) add a physical operator to broadcast small RDDs

[ https://issues.apache.org/jira/browse/PIG-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-5024. -- Resolution: Fixed Committed to Spark branch. Thanks. > add a physical operator to broadcast small R

[jira] [Resolved] (PIG-4870) Enable MergeJoin testcase in TestCollectedGroup for spark engine

[ https://issues.apache.org/jira/browse/PIG-4870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4870. -- Resolution: Fixed Committed to Spark branch. Thanks, Xianda! > Enable MergeJoin testc

[jira] [Resolved] (PIG-4970) Remove the deserialize and serialization of JobConf in code for spark mode

[ https://issues.apache.org/jira/browse/PIG-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4970. -- Resolution: Fixed Committed to Spark branch. Thanks, Liyun! > Remove the deserialize and serializat

Re: [ANNOUNCE] Congratulations to our new PMC member Koji Noguchi

Congratulations, Koji! On Fri, Aug 5, 2016 at 4:28 PM, Daniel Dai wrote: > Please welcome Koji Noguchi as our latest Pig PMC member. > > Congrats Koji! >

[jira] [Resolved] (PIG-4553) Implement secondary sort using one shuffle

[ https://issues.apache.org/jira/browse/PIG-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4553. -- Resolution: Fixed Committed to Spark branch. Thanks, Liyun! > Implement secondary sort using

[jira] [Resolved] (PIG-4941) TestRank3#testRankWithSplitInMap hangs after upgrade to spark 1.6.1

[ https://issues.apache.org/jira/browse/PIG-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4941. -- Resolution: Fixed Fix Version/s: spark-branch Committed to Spark Branch. Thanks, Liyun

[jira] [Resolved] (PIG-4946) Remove redudant code of bin/pig in spark mode after PIG-4903 check in

[ https://issues.apache.org/jira/browse/PIG-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4946. -- Resolution: Fixed Fix Version/s: spark-branch Committed to Spark branch. Thanks, Liyun! > Rem

[jira] [Resolved] (PIG-4944) Reset UDFContext#jobConf in spark mode

[ https://issues.apache.org/jira/browse/PIG-4944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4944. -- Resolution: Fixed Fix Version/s: spark-branch Committed to Spark branch. Thanks, Liyun! > Re

[jira] [Updated] (PIG-4797) Optimization for join/group case for spark mode

[ https://issues.apache.org/jira/browse/PIG-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4797: - Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Resolved] (PIG-4281) Fix TestFinish for Spark engine

[ https://issues.apache.org/jira/browse/PIG-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4281. -- Resolution: Fixed Latest patch is committed to Spark branch. Thanks, Liyun! > Fix TestFinish for Sp

[jira] [Resolved] (PIG-4898) Fix unit test failure after PIG-4771's patch was checked in

[ https://issues.apache.org/jira/browse/PIG-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4898. -- Resolution: Fixed Committed to Spark branch. Thanks, Liyun! > Fix unit test failure after PIG-477

[jira] [Updated] (PIG-4771) Implement FR Join for spark engine

[ https://issues.apache.org/jira/browse/PIG-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4771: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks, Liyun

[jira] [Resolved] (PIG-4876) OutputConsumeIterator can't handle the last buffered tuples for some Operators

[ https://issues.apache.org/jira/browse/PIG-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4876. -- Resolution: Fixed Committed to Spark branch. Thanks, Xianda. > OutputConsumeIterator can't han

[jira] [Commented] (PIG-4893) Task deserialization time is too long for spark on yarn mode

[ https://issues.apache.org/jira/browse/PIG-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282831#comment-15282831 ] Xuefu Zhang commented on PIG-4893: -- [~kellyzly], what's the value for spark.serializer? It should be set

[jira] [Commented] (PIG-4846) Use pigmix to test the performance of pig on spark

[ https://issues.apache.org/jira/browse/PIG-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246099#comment-15246099 ] Xuefu Zhang commented on PIG-4846: -- The basic idea is to make max use of the given resources (memory

[jira] [Commented] (PIG-4846) Use pigmix to test the performance of pig on spark

[ https://issues.apache.org/jira/browse/PIG-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239246#comment-15239246 ] Xuefu Zhang commented on PIG-4846: -- Your machine seems having abundant cores but scarce memory. I suggest

[jira] [Commented] (PIG-4854) Merge spark branch to trunk

[ https://issues.apache.org/jira/browse/PIG-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15237125#comment-15237125 ] Xuefu Zhang commented on PIG-4854: -- Yes, we can still commit to Spark branch and later merge back to trunk

[jira] [Updated] (PIG-4859) Need upgrade snappy-java.version to 1.1.1.3

[ https://issues.apache.org/jira/browse/PIG-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4859: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks, Liyun

[jira] [Resolved] (PIG-4855) Merge trunk[4] into spark branch

[ https://issues.apache.org/jira/browse/PIG-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4855. -- Resolution: Fixed Merged from trunk to Spark branch. > Merge trunk[4] into spark bra

[jira] [Commented] (PIG-4855) Merge trunk[4] into spark branch

[ https://issues.apache.org/jira/browse/PIG-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1590#comment-1590 ] Xuefu Zhang commented on PIG-4855: -- I did a svn merge from trunk to spark branch, and the the merge

[jira] [Updated] (PIG-4855) Merge trunk[4] into spark branch

[ https://issues.apache.org/jira/browse/PIG-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4855: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Resolved] (PIG-4848) pig.noSplitCombination=true should always be set internally for a merge join

[ https://issues.apache.org/jira/browse/PIG-4848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4848. -- Resolution: Fixed Patch committed to Spark branch. Thanks, Xianda! > pig.noSplitCombination=true sho

[jira] [Resolved] (PIG-4842) Collected group doesn't work in some cases

[ https://issues.apache.org/jira/browse/PIG-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4842. -- Resolution: Fixed Committed to Spark branch. Thanks, Xianda! > Collected group doesn't work in s

[jira] [Commented] (PIG-4855) Merge trunk[4] into spark branch

[ https://issues.apache.org/jira/browse/PIG-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219213#comment-15219213 ] Xuefu Zhang commented on PIG-4855: -- [~pallavi.rao], the patch doesn't seem applicable. Could you please

[jira] [Commented] (PIG-4837) TestNativeMapReduce test fix

[ https://issues.apache.org/jira/browse/PIG-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213292#comment-15213292 ] Xuefu Zhang commented on PIG-4837: -- Hi [~kellyzly], I don't know how to switch the build machine. Do you

Re: Welcome our new Pig PMC chair Daniel Dai

Congratulations, Daniel! On Wed, Mar 23, 2016 at 3:23 PM, Rohini Palaniswamy wrote: > Hi folks, > I am very happy to announce that we elected Daniel Dai as our new Pig > PMC Chair and it is official now. Please join me in congratulating Daniel. > > Regards, >

[jira] [Updated] (PIG-4838) Fix test TestBuiltin

[ https://issues.apache.org/jira/browse/PIG-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4838: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks, Liyun

[jira] [Commented] (PIG-4837) TestNativeMapReduce test fix

[ https://issues.apache.org/jira/browse/PIG-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200990#comment-15200990 ] Xuefu Zhang commented on PIG-4837: -- Committed. Thanks, Liyun! I will keep this JIRA open for now

[jira] [Updated] (PIG-4836) Fix TestEvalPipeline test failure

[ https://issues.apache.org/jira/browse/PIG-4836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4836: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Updated] (PIG-4835) Fix TestPigRunner test failure

[ https://issues.apache.org/jira/browse/PIG-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4835: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Updated] (PIG-4827) Fix TestSample UT failure

[ https://issues.apache.org/jira/browse/PIG-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4827: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Updated] (PIG-4829) TestLimitVariable test fix

[ https://issues.apache.org/jira/browse/PIG-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4829: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks, Liyun

[jira] [Updated] (PIG-4828) TestMultiQuery test fix

[ https://issues.apache.org/jira/browse/PIG-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4828: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Updated] (PIG-4828) TestMultiQuery test fix

[ https://issues.apache.org/jira/browse/PIG-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4828: - Labels: spark (was: spork) > TestMultiQuery test fix > --- > >

[jira] [Commented] (PIG-4828) TestMultiQuery test fix

[ https://issues.apache.org/jira/browse/PIG-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184461#comment-15184461 ] Xuefu Zhang commented on PIG-4828: -- +1 > TestMultiQuery test

[jira] [Commented] (PIG-4825) Fix TestMultiQuery failure

[ https://issues.apache.org/jira/browse/PIG-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184401#comment-15184401 ] Xuefu Zhang commented on PIG-4825: -- [~pallavi.rao], to keep the history clean, I guess it's better if we

[jira] [Updated] (PIG-4826) Add excluded-tests-spark

[ https://issues.apache.org/jira/browse/PIG-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4826: - Attachment: PIG-4826-amend.patch It looks like additional change is needed. Trivial patch is attached

[jira] [Commented] (PIG-4826) Add excluded-tests-spark

[ https://issues.apache.org/jira/browse/PIG-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182199#comment-15182199 ] Xuefu Zhang commented on PIG-4826: -- +1. Patch committed to Spark branch. Thanks, Pallavi. > Add exclu

[jira] [Updated] (PIG-4826) Add excluded-tests-spark

[ https://issues.apache.org/jira/browse/PIG-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4826: - Resolution: Fixed Status: Resolved (was: Patch Available) > Add excluded-tests-sp

[jira] [Updated] (PIG-4825) Fix TestMultiQuery failure

[ https://issues.apache.org/jira/browse/PIG-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4825: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Commented] (PIG-4825) Fix TestMultiQuery failure

[ https://issues.apache.org/jira/browse/PIG-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180319#comment-15180319 ] Xuefu Zhang commented on PIG-4825: -- +1 > Fix TestMultiQuery fail

[jira] [Updated] (PIG-4823) SparkMiniCluster does not cleanup old conf files during setup

[ https://issues.apache.org/jira/browse/PIG-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4823: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Updated] (PIG-4820) Merge trunk[3] into spark branch

[ https://issues.apache.org/jira/browse/PIG-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4820: - Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to spark branch

[jira] [Commented] (PIG-4820) Merge trunk[3] into spark branch

[ https://issues.apache.org/jira/browse/PIG-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178131#comment-15178131 ] Xuefu Zhang commented on PIG-4820: -- Hi [~pallavi.rao], to preserve the history, I need to use "svn

[jira] [Commented] (PIG-4823) SparkMiniCluster does not cleanup old conf files during setup

[ https://issues.apache.org/jira/browse/PIG-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178064#comment-15178064 ] Xuefu Zhang commented on PIG-4823: -- +1 > SparkMiniCluster does not cleanup old conf files during se

[jira] [Resolved] (PIG-4776) Enable unit test "TestOrcStoragePushdown" for spark

[ https://issues.apache.org/jira/browse/PIG-4776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4776. -- Resolution: Fixed The patch is committed to Spark branch. Thanks, Liyun! > Enable unit t

[jira] [Commented] (PIG-4776) Enable unit test "TestOrcStoragePushdown" for spark

[ https://issues.apache.org/jira/browse/PIG-4776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171895#comment-15171895 ] Xuefu Zhang commented on PIG-4776: -- +1 > Enable unit test "TestOrcStoragePushdown&qu

[jira] [Resolved] (PIG-4243) Fix "TestStore" for Spark engine

[ https://issues.apache.org/jira/browse/PIG-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4243. -- Resolution: Fixed Committed to Spark branch. Thanks, Liyun! > Fix "TestStore" for

[jira] [Commented] (PIG-4788) the value BytesRead metric info always returns 0 even the length of input file is not 0 in spark engine

[ https://issues.apache.org/jira/browse/PIG-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171344#comment-15171344 ] Xuefu Zhang commented on PIG-4788: -- I think letting PigSplit extend FileSplit is fine. However, I agree

[jira] [Commented] (PIG-4781) Fix remaining unit failure about "TestCollectedGroup" for spark engine

[ https://issues.apache.org/jira/browse/PIG-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166760#comment-15166760 ] Xuefu Zhang commented on PIG-4781: -- +1. > Fix remaining unit failure about "TestCollectedGroup&qu

Re: Welcome to our new Pig PMC member Xuefu Zhang

> > > > -Original Message- > From: Jarek Jarcec Cecho [mailto:jar...@gmail.com] On Behalf Of Jarek > Jarcec Cecho > Sent: Thursday, February 25, 2016 6:36 AM > To: dev@pig.apache.org > Cc: u...@pig.apache.org > Subject: Re: Welcome to our new Pig PMC membe

[jira] [Updated] (PIG-4807) Fix test cases of "TestEvalPipelineLocal" test suite.

[ https://issues.apache.org/jira/browse/PIG-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4807: - Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (PIG-4281) Fix TestFinish for Spark engine

[ https://issues.apache.org/jira/browse/PIG-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4281: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks, Liyun

[jira] [Commented] (PIG-4601) Implement Merge CoGroup for Spark engine

[ https://issues.apache.org/jira/browse/PIG-4601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152352#comment-15152352 ] Xuefu Zhang commented on PIG-4601: -- Reverted the old commit and committed the new patch. Thanks, Liyun

[jira] [Updated] (PIG-4601) Implement Merge CoGroup for Spark engine

[ https://issues.apache.org/jira/browse/PIG-4601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4601: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks, Liyun

[jira] [Updated] (PIG-4616) Fix UT errors of TestPigRunner in Spark mode

[ https://issues.apache.org/jira/browse/PIG-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4616: - Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to Spark branch. >

[jira] [Updated] (PIG-4777) Enable "TestEvalPipelineLocal" for spark

[ https://issues.apache.org/jira/browse/PIG-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4777: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Resolved] (PIG-4784) Enable "pig.disable.counter“ for spark engine

[ https://issues.apache.org/jira/browse/PIG-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4784. -- Resolution: Fixed Committed to Spark branch. Thanks, Liyun! > Enable "pig.disable.counter“ f

[jira] [Updated] (PIG-4766) Ensure GroupBy is optimized for all algebraic Operations

[ https://issues.apache.org/jira/browse/PIG-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4766: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Updated] (PIG-4783) Refactor SparkLauncher for spark engine

[ https://issues.apache.org/jira/browse/PIG-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4783: - Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to spark branch. Thanks

[jira] [Updated] (PIG-4709) Improve performance of GROUPBY operator on Spark

[ https://issues.apache.org/jira/browse/PIG-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4709: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Resolved] (PIG-4611) Fix remaining unit test failures about "TestHBaseStorage" in spark mode

[ https://issues.apache.org/jira/browse/PIG-4611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4611. -- Resolution: Fixed Committed to Spark branch. Thanks, Liyun! > Fix remaining unit test failures ab

[jira] [Resolved] (PIG-4765) Enable TestPoissonSampleLoader in spark mode

[ https://issues.apache.org/jira/browse/PIG-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4765. -- Resolution: Fixed Committed to Spark branch. Thanks, Liyun! > Enable TestPoissonSampleLoader in sp

[jira] [Updated] (PIG-4675) Operators with multiple predecessors fail under multiquery optimization

[ https://issues.apache.org/jira/browse/PIG-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4675: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks, Liyun

[jira] [Updated] (PIG-4746) Ensure spark can be run as PIG action in Oozie

[ https://issues.apache.org/jira/browse/PIG-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4746: - Summary: Ensure spark can be run as PIG action in Oozie (was: Ensure spork can be run as PIG action

[jira] [Resolved] (PIG-4293) Enable unit test "TestNativeMapReduce" for spark

[ https://issues.apache.org/jira/browse/PIG-4293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4293. -- Resolution: Fixed Committed to Spark branch. Thanks, Liyun! > Enable unit test "TestNativeM

[jira] [Resolved] (PIG-4754) Fix UT failures in TestScriptLanguage

[ https://issues.apache.org/jira/browse/PIG-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4754. -- Resolution: Fixed Committed to Spark branch. Thanks, Xianda. > Fix UT failures in TestScriptLangu

Re: Review Request 40743: PIG-4709 Improve performance of GROUPBY operator on Spark

ter var name would be nice. - Xuefu Zhang On Nov. 27, 2015, 11:19 a.m., Pallavi Rao wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > http

[jira] [Commented] (PIG-4709) Improve performance of GROUPBY operator on Spark

[ https://issues.apache.org/jira/browse/PIG-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032504#comment-15032504 ] Xuefu Zhang commented on PIG-4709: -- Thanks, [~pallavi.rao]. Great work! I posted a few comments, mostly

[jira] [Commented] (PIG-4741) the value of $SPARK_DIST_CLASSPATH in pig file is invalid

[ https://issues.apache.org/jira/browse/PIG-4741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015199#comment-15015199 ] Xuefu Zhang commented on PIG-4741: -- [~kellyzly], your observation seems right. "\" seems somet

[jira] [Resolved] (PIG-4720) Spark related JARs are not included when importing project via IDE

[ https://issues.apache.org/jira/browse/PIG-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4720. -- Resolution: Fixed Committed to Spark branch. Thanks, Xianda. > Spark related JARs are not included w

[jira] [Resolved] (PIG-4661) Fix UT failures in TestPigServerLocal

[ https://issues.apache.org/jira/browse/PIG-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4661. -- Resolution: Fixed Committed to Spark branch. Thanks, Xianda! > Fix UT failures in TestPigServerLo

[jira] [Resolved] (PIG-4659) Fix unit test failures in org.apache.pig.test.TestScriptLanguageJavaScript

[ https://issues.apache.org/jira/browse/PIG-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4659. -- Resolution: Fixed Committed to Spark branch. Thanks, Xianda! > Fix unit test failu

[jira] [Resolved] (PIG-4655) Support InputStats in spark mode

[ https://issues.apache.org/jira/browse/PIG-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4655. -- Resolution: Fixed Committed to Spark branch. Thanks, Xianda! > Support InputStats in spark m

[jira] [Resolved] (PIG-4634) Fix records count issues in output statistics

[ https://issues.apache.org/jira/browse/PIG-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4634. -- Resolution: Fixed Committed to Spark branch. Thanks, Xianda. > Fix records count issues in out

[jira] [Updated] (PIG-4711) Tests in TestCombiner fail due to missing leveldb dependency

[ https://issues.apache.org/jira/browse/PIG-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4711: - Resolution: Fixed Status: Resolved (was: Patch Available) Reverted the old commit and committed

[jira] [Commented] (PIG-4698) Enable dynamic resource allocation/de-allocation on Yarn backends

[ https://issues.apache.org/jira/browse/PIG-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975596#comment-14975596 ] Xuefu Zhang commented on PIG-4698: -- +1 > Enable dynamic resource allocation/de-allocation on Yarn backe

Re: Review Request 39641: PIG-4698 Enable dynamic resource allocation/de-allocation on Yarn backends

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/39641/#review104134 --- Ship it! Ship It! - Xuefu Zhang On Oct. 26, 2015, 7:28 a.m

[jira] [Updated] (PIG-4711) Tests in TestCombiner fail due to missing leveldb dependency

[ https://issues.apache.org/jira/browse/PIG-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4711: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Commented] (PIG-4711) Tests in TestCombiner fail due to missing leveldb dependency

[ https://issues.apache.org/jira/browse/PIG-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975628#comment-14975628 ] Xuefu Zhang commented on PIG-4711: -- +1 > Tests in TestCombiner fail due to missing leveldb depende

[jira] [Updated] (PIG-4698) Enable dynamic resource allocation/de-allocation on Yarn backends

[ https://issues.apache.org/jira/browse/PIG-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-4698: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

  1   2   3   4   5   >