[jira] [Updated] (PIG-5278) Unit test failures because of PIG-5264

2017-08-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5278: --- Attachment: PIG-5264_2.patch > Unit test failures because of PIG-5264 >

[jira] [Created] (PIG-5280) Implement auto local mode for Tez

2017-08-02 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5280: -- Summary: Implement auto local mode for Tez Key: PIG-5280 URL: https://issues.apache.org/jira/browse/PIG-5280 Project: Pig Issue Type: Improvement

[jira] [Commented] (PIG-5278) Unit test failures because of PIG-5264

2017-08-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110771#comment-16110771 ] Nandor Kollar commented on PIG-5278: [~rohini] thanks, added the tests to the excludes files, and

[jira] [Commented] (PIG-5283) Configuration is not passed to SparkPigSplits on the backend

2017-08-03 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112500#comment-16112500 ] Nandor Kollar commented on PIG-5283: This is a problem with Hadoop 3 (HADOOP-14459) and Spark with Pig.

[jira] [Commented] (PIG-5283) Configuration is not passed to SparkPigSplits on the backend

2017-08-03 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112502#comment-16112502 ] Nandor Kollar commented on PIG-5283: I think Adam's patch is a good workaround for this problem, looks

[jira] [Commented] (PIG-5264) Remove deprecated keys from PigConfiguration

2017-08-04 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114040#comment-16114040 ] Nandor Kollar commented on PIG-5264: Ah sorry, hope this is the only hidden trap among the deprecations

[jira] [Commented] (PIG-5264) Remove deprecated keys from PigConfiguration

2017-08-04 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114049#comment-16114049 ] Nandor Kollar commented on PIG-5264: [~rohini], [~daijy] by the way, is it possible to get rid of this

[jira] [Comment Edited] (PIG-5264) Remove deprecated keys from PigConfiguration

2017-08-04 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114040#comment-16114040 ] Nandor Kollar edited comment on PIG-5264 at 8/4/17 7:24 AM: Ah sorry, hope this

[jira] [Updated] (PIG-5191) Pig HBase 2.0.0 support

2017-08-15 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5191: --- Status: Patch Available (was: In Progress) > Pig HBase 2.0.0 support > --- > >

[jira] [Commented] (PIG-5288) Improve performance of PigTextRawBytesComparator

2017-08-11 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123153#comment-16123153 ] Nandor Kollar commented on PIG-5288: Looks good to me, commit tests passed! > Improve performance of

[jira] [Commented] (PIG-3655) BinStorage and InterStorage approach to record markers is broken

2017-07-12 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083882#comment-16083882 ] Nandor Kollar commented on PIG-3655: Unit tests passed, looks good to me! > BinStorage and InterStorage

[jira] [Commented] (PIG-5246) Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2

2017-07-14 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087189#comment-16087189 ] Nandor Kollar commented on PIG-5246: [~kellyzly] does this mean, that the problem you mentioned in

[jira] [Commented] (PIG-5080) Support store alias as spark table

2017-07-18 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091473#comment-16091473 ] Nandor Kollar commented on PIG-5080: [~jeffzhang] Could you please apply these modifications: - Minor

[jira] [Created] (PIG-5274) TestEvalPipelineLocal#testSetLocationCalledInFE is failing in spark mode after PIG-5157

2017-07-20 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5274: -- Summary: TestEvalPipelineLocal#testSetLocationCalledInFE is failing in spark mode after PIG-5157 Key: PIG-5274 URL: https://issues.apache.org/jira/browse/PIG-5274

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-07-19 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092811#comment-16092811 ] Nandor Kollar commented on PIG-5157: Thanks [~rohini], [~kellyzly] and [~szita] for your help to resolve

[jira] [Work started] (PIG-5191) Pig HBase 2.0.0 support

2017-07-19 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on PIG-5191 started by Nandor Kollar. -- > Pig HBase 2.0.0 support > --- > > Key: PIG-5191

[jira] [Updated] (PIG-5274) TestEvalPipelineLocal#testSetLocationCalledInFE is failing in spark mode after PIG-5157

2017-07-20 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5274: --- Attachment: PIG-5274_1.patch > TestEvalPipelineLocal#testSetLocationCalledInFE is failing in spark mode

[jira] [Updated] (PIG-5274) TestEvalPipelineLocal#testSetLocationCalledInFE is failing in spark mode after PIG-5157

2017-07-21 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5274: --- Attachment: PIG-5274_2.patch > TestEvalPipelineLocal#testSetLocationCalledInFE is failing in spark mode

[jira] [Updated] (PIG-5274) TestEvalPipelineLocal#testSetLocationCalledInFE is failing in spark mode after PIG-5157

2017-07-21 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5274: --- Assignee: Nandor Kollar Status: Patch Available (was: Open) >

[jira] [Commented] (PIG-5274) TestEvalPipelineLocal#testSetLocationCalledInFE is failing in spark mode after PIG-5157

2017-07-21 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096325#comment-16096325 ] Nandor Kollar commented on PIG-5274: [~rohini], [~szita] how about PIG-5274_2.patch? To tell the Spark

[jira] [Commented] (PIG-5264) Remove deprecated keys from PigConfiguration

2017-07-25 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100031#comment-16100031 ] Nandor Kollar commented on PIG-5264: [~daijy], [~rohini] could either of you please commit this patch?

[jira] [Created] (PIG-5275) Setting pig.logical.plan.signature should be configurable

2017-07-26 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5275: -- Summary: Setting pig.logical.plan.signature should be configurable Key: PIG-5275 URL: https://issues.apache.org/jira/browse/PIG-5275 Project: Pig Issue Type:

[jira] [Updated] (PIG-5275) Setting pig.logical.plan.signature should be configurable

2017-07-26 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5275: --- Issue Type: Improvement (was: Bug) > Setting pig.logical.plan.signature should be configurable >

[jira] [Commented] (PIG-5246) Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2

2017-07-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16098155#comment-16098155 ] Nandor Kollar commented on PIG-5246: [~kellyzly] sorry for the delay in the review. I tested the

[jira] [Commented] (PIG-5268) Review of org.apache.pig.backend.hadoop.datastorage.HDataStorage

2017-06-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068819#comment-16068819 ] Nandor Kollar commented on PIG-5268: Thanks for refactoring this! I've three comments, could you please

[jira] [Updated] (PIG-5269) MapReduceLauncher and MRJobStats imports org.python.google.common.collect.Lists instead of org.google.common.collect.Lists

2017-07-04 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5269: --- Status: Patch Available (was: Open) > MapReduceLauncher and MRJobStats imports >

[jira] [Updated] (PIG-5269) MapReduceLauncher and MRJobStats imports org.python.google.common.collect.Lists instead of org.google.common.collect.Lists

2017-07-04 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5269: --- Attachment: PIG-5269.patch > MapReduceLauncher and MRJobStats imports >

[jira] [Commented] (PIG-5269) MapReduceLauncher and MRJobStats imports org.python.google.common.collect.Lists instead of org.google.common.collect.Lists

2017-07-04 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073541#comment-16073541 ] Nandor Kollar commented on PIG-5269: [~szita] could you please review this patch? > MapReduceLauncher

[jira] [Created] (PIG-5269) MapReduceLauncher and MRJobStats imports org.python.google.common.collect.Lists instead of org.google.common.collect.Lists

2017-07-04 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5269: -- Summary: MapReduceLauncher and MRJobStats imports org.python.google.common.collect.Lists instead of org.google.common.collect.Lists Key: PIG-5269 URL:

[jira] [Updated] (PIG-5264) Remove deprecated keys from PigConfiguration

2017-07-03 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5264: --- Status: Patch Available (was: Open) > Remove deprecated keys from PigConfiguration >

[jira] [Updated] (PIG-5264) Remove deprecated keys from PigConfiguration

2017-07-03 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5264: --- Attachment: PIG-5264_1.patch > Remove deprecated keys from PigConfiguration >

[jira] [Commented] (PIG-5268) Review of org.apache.pig.backend.hadoop.datastorage.HDataStorage

2017-07-06 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076064#comment-16076064 ] Nandor Kollar commented on PIG-5268: Thanks, looks good to me! > Review of

[jira] [Resolved] (PIG-5047) support outer join for skewedjoin in spark mode

2017-04-26 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-5047. Resolution: Fixed > support outer join for skewedjoin in spark mode >

[jira] [Commented] (PIG-5047) support outer join for skewedjoin in spark mode

2017-04-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980948#comment-15980948 ] Nandor Kollar commented on PIG-5047: +1 > support outer join for skewedjoin in spark mode >

[jira] [Commented] (PIG-5165) MultiQuery_Union_7 is failing with spark exec type

2017-04-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980894#comment-15980894 ] Nandor Kollar commented on PIG-5165: LGTM > MultiQuery_Union_7 is failing with spark exec type >

[jira] [Commented] (PIG-5186) Support aggregate warnings with Spark engine

2017-04-25 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982794#comment-15982794 ] Nandor Kollar commented on PIG-5186: +1 > Support aggregate warnings with Spark engine >

[jira] [Assigned] (PIG-5278) Unit test failures because of PIG-5264

2017-08-01 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-5278: -- Assignee: Nandor Kollar > Unit test failures because of PIG-5264 >

[jira] [Commented] (PIG-5276) building "jar" should not call "clean"

2017-07-31 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106921#comment-16106921 ] Nandor Kollar commented on PIG-5276: [~kellyzly] [~knoguchi] how about having a new clean target (which

[jira] [Commented] (PIG-5282) Upgade to Java 8

2017-08-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111004#comment-16111004 ] Nandor Kollar commented on PIG-5282: It seems that HBase 2.0 and Hadoop 3 requires Java 8, and Java 7 is

[jira] [Created] (PIG-5282) Upgade to Java 8

2017-08-02 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5282: -- Summary: Upgade to Java 8 Key: PIG-5282 URL: https://issues.apache.org/jira/browse/PIG-5282 Project: Pig Issue Type: Improvement Reporter: Nandor

[jira] [Updated] (PIG-5278) Unit test failures because of PIG-5264

2017-08-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5278: --- Status: Patch Available (was: Open) > Unit test failures because of PIG-5264 >

[jira] [Commented] (PIG-5191) Pig HBase 2.0.0 support

2017-08-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111245#comment-16111245 ] Nandor Kollar commented on PIG-5191: Actually looks like replacing the deprecated API calls is

[jira] [Updated] (PIG-5191) Pig HBase 2.0.0 support

2017-08-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5191: --- Attachment: PIG-5191_1.patch > Pig HBase 2.0.0 support > --- > >

[jira] [Commented] (PIG-5294) Spark unit tests are always run in spark1 mode

2017-08-18 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16132149#comment-16132149 ] Nandor Kollar commented on PIG-5294: Thanks Adam, indeed, looks like we can't execute unit test in

[jira] [Updated] (PIG-5134) Fix TestAvroStorage unit test in Spark mode

2017-05-15 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5134: --- Attachment: PIG-5134_3.patch > Fix TestAvroStorage unit test in Spark mode >

[jira] [Created] (PIG-5233) Use Kryo serialization instead of Java serialization for Spark

2017-05-15 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5233: -- Summary: Use Kryo serialization instead of Java serialization for Spark Key: PIG-5233 URL: https://issues.apache.org/jira/browse/PIG-5233 Project: Pig Issue

[jira] [Updated] (PIG-5134) Fix TestAvroStorage unit test in Spark mode

2017-05-15 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5134: --- Attachment: (was: PIG-5134_3.patch) > Fix TestAvroStorage unit test in Spark mode >

[jira] [Updated] (PIG-5134) Fix TestAvroStorage unit test in Spark mode

2017-05-15 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5134: --- Attachment: PIG-5134_3.patch > Fix TestAvroStorage unit test in Spark mode >

[jira] [Commented] (PIG-5225) Several unit tests are not annotated with @Test

2017-05-17 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014215#comment-16014215 ] Nandor Kollar commented on PIG-5225: [~rohini] Could you please help to solve this failure? In the test,

[jira] [Commented] (PIG-5134) Fix TestAvroStorage unit test in Spark mode

2017-05-16 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011920#comment-16011920 ] Nandor Kollar commented on PIG-5134: Let's address it in a different Jira, I'll have to investigate what

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-06-12 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047080#comment-16047080 ] Nandor Kollar commented on PIG-5157: Updated RB with Rohini's proposal (see discussion on PIG-5246 for

[jira] [Commented] (PIG-5262) Fix jdiff related issues: fail build upon error, correct xml character escaping

2017-06-20 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055625#comment-16055625 ] Nandor Kollar commented on PIG-5262: Looks good to me > Fix jdiff related issues: fail build upon

[jira] [Created] (PIG-5264) Remove deprecated keys from PigConfiguration

2017-06-26 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5264: -- Summary: Remove deprecated keys from PigConfiguration Key: PIG-5264 URL: https://issues.apache.org/jira/browse/PIG-5264 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-5265) Replace deprecated Hadoop properties

2017-06-26 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5265: --- Priority: Minor (was: Major) > Replace deprecated Hadoop properties >

[jira] [Updated] (PIG-5264) Remove deprecated keys from PigConfiguration

2017-06-26 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5264: --- Issue Type: Improvement (was: Bug) > Remove deprecated keys from PigConfiguration >

[jira] [Created] (PIG-5265) Replace deprecated Hadoop properties

2017-06-26 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5265: -- Summary: Replace deprecated Hadoop properties Key: PIG-5265 URL: https://issues.apache.org/jira/browse/PIG-5265 Project: Pig Issue Type: Improvement

[jira] [Updated] (PIG-5264) Remove deprecated keys from PigConfiguration

2017-06-26 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5264: --- Priority: Minor (was: Major) > Remove deprecated keys from PigConfiguration >

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-06-26 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062815#comment-16062815 ] Nandor Kollar commented on PIG-5157: [~kellyzly] ok, I'm now executing the full e2e test suite on Spark

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-06-23 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060633#comment-16060633 ] Nandor Kollar commented on PIG-5157: I'll update on RB soon, ran with my latest patch: {code} ant

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-06-23 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060622#comment-16060622 ] Nandor Kollar commented on PIG-5157: [~kellyzly] I'll have look at it. It seems that there's an other

[jira] [Comment Edited] (PIG-5157) Upgrade to Spark 2.0

2017-06-23 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060633#comment-16060633 ] Nandor Kollar edited comment on PIG-5157 at 6/23/17 12:50 PM: -- I'll update on

[jira] [Commented] (PIG-5235) Typecast with as-clause fails for tuple/bag with an empty schema

2017-05-18 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015951#comment-16015951 ] Nandor Kollar commented on PIG-5235: +1 > Typecast with as-clause fails for tuple/bag with an empty

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-23 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021051#comment-16021051 ] Nandor Kollar commented on PIG-5157: [~kellyzly] what you think, should we try Spark's DataFrames or

[jira] [Commented] (PIG-2648) MapReduceLauncher squashes unchecked exceptions

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022798#comment-16022798 ] Nandor Kollar commented on PIG-2648: It seems this is fixed meanwhile in PIG-2699. [~rohini] can we

[jira] [Updated] (PIG-3103) make mockito a test dependency (instead of compile)

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-3103: --- Status: Patch Available (was: Open) > make mockito a test dependency (instead of compile) >

[jira] [Updated] (PIG-5157) Upgrade to Spark 2.0

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5157: --- Attachment: PIG-5157.patch > Upgrade to Spark 2.0 > > > Key:

[jira] [Updated] (PIG-3103) make mockito a test dependency (instead of compile)

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-3103: --- Fix Version/s: 0.17.0 > make mockito a test dependency (instead of compile) >

[jira] [Assigned] (PIG-3103) make mockito a test dependency (instead of compile)

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-3103: -- Assignee: Nandor Kollar > make mockito a test dependency (instead of compile) >

[jira] [Updated] (PIG-3103) make mockito a test dependency (instead of compile)

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-3103: --- Attachment: PIG-3103.patch > make mockito a test dependency (instead of compile) >

[jira] [Resolved] (PIG-4292) Enable unit test "TestMergeJoinOuter" for spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-4292. Resolution: Fixed > Enable unit test "TestMergeJoinOuter" for spark >

[jira] [Commented] (PIG-4266) Umbrella jira for unit tests for Spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023032#comment-16023032 ] Nandor Kollar commented on PIG-4266: Closing this Jira since all unit tests are passing on spark branch.

[jira] [Resolved] (PIG-4277) Enable unit test "TestEvalPipeline2" for spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-4277. Resolution: Fixed > Enable unit test "TestEvalPipeline2" for spark >

[jira] [Assigned] (PIG-4277) Enable unit test "TestEvalPipeline2" for spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-4277: -- Assignee: (was: Mohit Sabharwal) > Enable unit test "TestEvalPipeline2" for spark >

[jira] [Assigned] (PIG-4266) Umbrella jira for unit tests for Spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-4266: -- Assignee: (was: liyunzhang_intel) > Umbrella jira for unit tests for Spark >

[jira] [Resolved] (PIG-4266) Umbrella jira for unit tests for Spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-4266. Resolution: Fixed > Umbrella jira for unit tests for Spark > -- >

[jira] [Commented] (PIG-5238) Fix datetime related test issues after PIG-4748

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022876#comment-16022876 ] Nandor Kollar commented on PIG-5238: LGTM > Fix datetime related test issues after PIG-4748 >

[jira] [Resolved] (PIG-4291) Enable unit test "TestMergeJoin" for spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-4291. Resolution: Fixed Assignee: (was: Praveen Rachabattuni) > Enable unit test "TestMergeJoin"

[jira] [Resolved] (PIG-4295) Enable unit test "TestPigContext" for spark

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-4295. Resolution: Fixed Assignee: (was: liyunzhang_intel) > Enable unit test "TestPigContext" for

[jira] [Updated] (PIG-5167) Limit_4 is failing with spark exec type

2017-05-26 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5167: --- Attachment: PIG-5167_4.patch > Limit_4 is failing with spark exec type >

[jira] [Updated] (PIG-5167) Limit_4 is failing with spark exec type

2017-05-26 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5167: --- Attachment: PIG-5167_4.patch > Limit_4 is failing with spark exec type >

[jira] [Updated] (PIG-5167) Limit_4 is failing with spark exec type

2017-05-26 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5167: --- Attachment: (was: PIG-5167_4.patch) > Limit_4 is failing with spark exec type >

[jira] [Updated] (PIG-5157) Upgrade to Spark 2.0

2017-05-25 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5157: --- Status: Patch Available (was: Open) > Upgrade to Spark 2.0 > > >

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028477#comment-16028477 ] Nandor Kollar commented on PIG-5157: [~kellyzly] could you please have a look at my patch? There are two

[jira] [Comment Edited] (PIG-5157) Upgrade to Spark 2.0

2017-05-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028477#comment-16028477 ] Nandor Kollar edited comment on PIG-5157 at 5/29/17 3:52 PM: - [~kellyzly] could

[jira] [Created] (PIG-5242) Evaluate DataFrame API for Pig on Spark

2017-05-25 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5242: -- Summary: Evaluate DataFrame API for Pig on Spark Key: PIG-5242 URL: https://issues.apache.org/jira/browse/PIG-5242 Project: Pig Issue Type: Improvement

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022491#comment-16022491 ] Nandor Kollar commented on PIG-5157: [~kellyzly], [~jeffzhang] I think (and correct me if I'm wrong) we

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022529#comment-16022529 ] Nandor Kollar commented on PIG-5157: Thanks Jeff! Looks like you're more familiar with Spark than me. :)

[jira] [Updated] (PIG-5225) Several unit tests are not annotated with @Test

2017-05-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5225: --- Fix Version/s: 0.17.0 > Several unit tests are not annotated with @Test >

[jira] [Updated] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

2017-05-30 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5244: --- Attachment: PIG-5244_2.patch > Several unit tests are failing in Tez mode after merging spark branch >

[jira] [Created] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

2017-05-30 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5244: -- Summary: Several unit tests are failing in Tez mode after merging spark branch Key: PIG-5244 URL: https://issues.apache.org/jira/browse/PIG-5244 Project: Pig

[jira] [Updated] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

2017-05-30 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5244: --- Description: Looks like during the merge in build.xml PIG-5105 was accidentally partially reverted:

[jira] [Updated] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

2017-05-30 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5244: --- Status: Patch Available (was: Open) > Several unit tests are failing in Tez mode after merging spark

[jira] [Updated] (PIG-5244) Several unit tests are failing in Tez mode after merging spark branch

2017-05-30 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5244: --- Attachment: PIG-5244.patch > Several unit tests are failing in Tez mode after merging spark branch >

[jira] [Assigned] (PIG-5191) Pig HBase 2.0.0 support

2017-06-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-5191: -- Assignee: Nandor Kollar > Pig HBase 2.0.0 support > --- > >

[jira] [Commented] (PIG-5215) Merge changes from review board to spark branch

2017-06-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034363#comment-16034363 ] Nandor Kollar commented on PIG-5215: [~kellyzly] should we close this since the merge is done? > Merge

[jira] [Assigned] (PIG-5242) Evaluate DataFrame API for Pig on Spark

2017-06-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-5242: -- Assignee: Nandor Kollar > Evaluate DataFrame API for Pig on Spark >

[jira] [Commented] (PIG-4923) Drop Hadoop 1.x support in Pig 0.17

2017-06-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034563#comment-16034563 ] Nandor Kollar commented on PIG-4923: LGTM > Drop Hadoop 1.x support in Pig 0.17 >

[jira] [Created] (PIG-5253) Pig Hadoop 3 support

2017-06-07 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5253: -- Summary: Pig Hadoop 3 support Key: PIG-5253 URL: https://issues.apache.org/jira/browse/PIG-5253 Project: Pig Issue Type: Improvement Reporter:

[jira] [Commented] (PIG-5246) Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2

2017-06-01 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032586#comment-16032586 ] Nandor Kollar commented on PIG-5246: [~kellyzly] one comment: Rohini suggested that instead of

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

2017-05-31 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030991#comment-16030991 ] Nandor Kollar commented on PIG-5157: Ok, thanks, then I'll uncomment that and test it. As for

<    1   2   3   4   5   6   >