[jira] [Commented] (PIG-4976) streaming job with store clause stuck if the script fail

2016-09-20 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506435#comment-15506435 ] Nandor Kollar commented on PIG-4976: Ok, so in this case it seems that the file is not getting created

[jira] [Updated] (PIG-4976) streaming job with store clause stuck if the script fail

2016-09-20 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-4976: --- Attachment: PIG-4976-4.patch > streaming job with store clause stuck if the script fail >

[jira] [Commented] (PIG-4976) streaming job with store clause stuck if the script fail

2016-09-16 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15496132#comment-15496132 ] Nandor Kollar commented on PIG-4976: When I applied PIG-4976-2.patch I had the same problem as

[jira] [Commented] (PIG-4976) streaming job with store clause stuck if the script fail

2016-09-22 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513257#comment-15513257 ] Nandor Kollar commented on PIG-4976: Ok, thanks for the explanation, I agree, no need to create a new

[jira] [Commented] (PIG-2125) Make Pig work with hadoop .NEXT

2016-08-22 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432037#comment-15432037 ] Nandor Kollar commented on PIG-2125: How can I make sure that if I remove the ClientProtocolProvider, it

[jira] [Commented] (PIG-4976) streaming job with store clause stuck if the script fail

2016-09-27 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525748#comment-15525748 ] Nandor Kollar commented on PIG-4976: Ok, PIG-4976-5-knoguchi.patch LGTM, no test is hanging in

[jira] [Created] (PIG-5034) Remove org.apache.hadoop.hive.serde2.objectinspector.primitive package

2016-09-29 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5034: -- Summary: Remove org.apache.hadoop.hive.serde2.objectinspector.primitive package Key: PIG-5034 URL: https://issues.apache.org/jira/browse/PIG-5034 Project: Pig

[jira] [Commented] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-10-27 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612202#comment-15612202 ] Nandor Kollar commented on PIG-5048: Do we need this UnlimitedNullTuple class at all? The only place

[jira] [Updated] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-10-27 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5048: --- Attachment: PIG-5048-1.patch > HiveUDTF fail if it is the first expression in projection >

[jira] [Commented] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-11-09 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651841#comment-15651841 ] Nandor Kollar commented on PIG-5048: Thank you Daniel for the review and for helping me learn more about

[jira] [Updated] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-11-09 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5048: --- Attachment: PIG-5048-4.patch > HiveUDTF fail if it is the first expression in projection >

[jira] [Commented] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-11-09 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15650405#comment-15650405 ] Nandor Kollar commented on PIG-5048: Ok, deleted the UDF and UDAF tests, since those are covered in the

[jira] [Commented] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-11-08 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15647088#comment-15647088 ] Nandor Kollar commented on PIG-5048: Thanks Daniel for the comments. I added these tests to the Junit

[jira] [Updated] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-11-08 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5048: --- Attachment: PIG-5048-3.patch > HiveUDTF fail if it is the first expression in projection >

[jira] [Commented] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-11-08 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15647550#comment-15647550 ] Nandor Kollar commented on PIG-5048: Attached patch version 3, decided not to use mock Store in the

[jira] [Commented] (PIG-5026) Remove src/META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider

2016-10-18 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584881#comment-15584881 ] Nandor Kollar commented on PIG-5026: All unit test passed both in MR and in Tez mode on my mac, [~daijy]

[jira] [Commented] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-10-25 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604499#comment-15604499 ] Nandor Kollar commented on PIG-5048: I just realized that I wanted to say I can attach a patch, but

[jira] [Updated] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-10-25 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5048: --- Attachment: PIG-5048.patch > HiveUDTF fail if it is the first expression in projection >

[jira] [Commented] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-10-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602951#comment-15602951 ] Nandor Kollar commented on PIG-5048: It seems that with this trivial modification in UnlimitedNullTuple

[jira] [Commented] (PIG-5057) IndexOutOfBoundsException when pig reducer processOnePackageOutput

2016-11-14 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663167#comment-15663167 ] Nandor Kollar commented on PIG-5057: Could you please add a test case too which demonstrates the

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-11-23 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691496#comment-15691496 ] Nandor Kollar commented on PIG-4952: Apart from the blog post you found, I didn't find anything else

[jira] [Assigned] (PIG-4952) Calculate the value of parallism for spark mode

2016-11-22 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-4952: -- Assignee: Nandor Kollar > Calculate the value of parallism for spark mode >

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-11-22 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687248#comment-15687248 ] Nandor Kollar commented on PIG-4952: [~kellyzly] could you please explain, what should ParallelismSetter

[jira] [Updated] (PIG-4952) Calculate the value of parallism for spark mode

2016-11-22 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-4952: --- Attachment: PIG-4952_1.patch > Calculate the value of parallism for spark mode >

[jira] [Commented] (PIG-5069) Skewed Join is crashing job

2016-11-28 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701371#comment-15701371 ] Nandor Kollar commented on PIG-5069: It looks similar to PIG-3417. I took a look at that issue, and it

[jira] [Created] (PIG-5053) Can't change e2e test HDFS user home using Ant

2016-10-28 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5053: -- Summary: Can't change e2e test HDFS user home using Ant Key: PIG-5053 URL: https://issues.apache.org/jira/browse/PIG-5053 Project: Pig Issue Type: Improvement

[jira] [Updated] (PIG-5053) Can't change e2e test HDFS user home using Ant

2016-10-28 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5053: --- Attachment: PIG-5053.patch > Can't change e2e test HDFS user home using Ant >

[jira] [Updated] (PIG-5053) Can't change HDFS user home in e2e tests using Ant

2016-10-28 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5053: --- Summary: Can't change HDFS user home in e2e tests using Ant (was: Can't change e2e test HDFS user home

[jira] [Updated] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-11-03 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5048: --- Attachment: PIG-5048-2.patch > HiveUDTF fail if it is the first expression in projection >

[jira] [Commented] (PIG-5048) HiveUDTF fail if it is the first expression in projection

2016-11-03 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15632699#comment-15632699 ] Nandor Kollar commented on PIG-5048: Attached a new version of my patch, it includes these changes: -

[jira] [Assigned] (PIG-5034) Remove org.apache.hadoop.hive.serde2.objectinspector.primitive package

2016-11-03 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-5034: -- Assignee: Nandor Kollar > Remove org.apache.hadoop.hive.serde2.objectinspector.primitive package

[jira] [Updated] (PIG-5034) Remove org.apache.hadoop.hive.serde2.objectinspector.primitive package

2016-11-03 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5034: --- Status: Patch Available (was: Open) > Remove org.apache.hadoop.hive.serde2.objectinspector.primitive

[jira] [Updated] (PIG-5034) Remove org.apache.hadoop.hive.serde2.objectinspector.primitive package

2016-11-03 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5034: --- Attachment: PIG-5034.patch > Remove org.apache.hadoop.hive.serde2.objectinspector.primitive package >

[jira] [Updated] (PIG-5039) TestTypeCheckingValidatorNewLP.TestTypeCheckingValidatorNewLP is failing

2016-10-11 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5039: --- Attachment: PIG-5039.patch > TestTypeCheckingValidatorNewLP.TestTypeCheckingValidatorNewLP is failing >

[jira] [Created] (PIG-5039) TestTypeCheckingValidatorNewLP.TestTypeCheckingValidatorNewLP is failing

2016-10-11 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5039: -- Summary: TestTypeCheckingValidatorNewLP.TestTypeCheckingValidatorNewLP is failing Key: PIG-5039 URL: https://issues.apache.org/jira/browse/PIG-5039 Project: Pig

[jira] [Updated] (PIG-5039) TestTypeCheckingValidatorNewLP.TestTypeCheckingValidatorNewLP is failing

2016-10-11 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5039: --- Status: Patch Available (was: Open) > TestTypeCheckingValidatorNewLP.TestTypeCheckingValidatorNewLP is

[jira] [Work started] (PIG-5026) Remove src/META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider

2016-10-11 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on PIG-5026 started by Nandor Kollar. -- > Remove >

[jira] [Updated] (PIG-5026) Remove src/META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider

2016-10-11 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5026: --- Attachment: PIG-5026.patch > Remove >

[jira] [Commented] (PIG-5039) TestTypeCheckingValidatorNewLP.TestTypeCheckingValidatorNewLP is failing

2016-10-11 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565546#comment-15565546 ] Nandor Kollar commented on PIG-5039: Thanks for the review! :) >

[jira] [Updated] (PIG-5026) Remove src/META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider

2016-10-11 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5026: --- Status: Patch Available (was: In Progress) > Remove >

[jira] [Updated] (PIG-4750) REPLACE_MULTI should compile Pattern once and reuse it

2016-10-10 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-4750: --- Attachment: PIG-4750.patch > REPLACE_MULTI should compile Pattern once and reuse it >

[jira] [Assigned] (PIG-4750) REPLACE_MULTI should compile Pattern once and reuse it

2016-10-10 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-4750: -- Assignee: Nandor Kollar (was: Murali Rao) > REPLACE_MULTI should compile Pattern once and reuse

[jira] [Comment Edited] (PIG-4750) REPLACE_MULTI should compile Pattern once and reuse it

2016-10-10 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561830#comment-15561830 ] Nandor Kollar edited comment on PIG-4750 at 10/10/16 9:48 AM: -- Attached a patch

[jira] [Commented] (PIG-4750) REPLACE_MULTI should compile Pattern once and reuse it

2016-10-10 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561830#comment-15561830 ] Nandor Kollar commented on PIG-4750: Attached a patch and two test cases. This patch changes the

[jira] [Updated] (PIG-4750) REPLACE_MULTI should compile Pattern once and reuse it

2016-10-10 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-4750: --- Status: Patch Available (was: Open) > REPLACE_MULTI should compile Pattern once and reuse it >

[jira] [Commented] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2016-12-16 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15754306#comment-15754306 ] Nandor Kollar commented on PIG-4930: [~daijy] would you mind if I would work on this item? > Skewed

[jira] [Commented] (PIG-4748) DateTimeWritable forgets Chronology

2016-12-16 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15754626#comment-15754626 ] Nandor Kollar commented on PIG-4748: Using zone ID instead of offset looks good to me. >

[jira] [Commented] (PIG-4815) Add xml format support for 'explain' in spark engine

2016-12-12 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15741770#comment-15741770 ] Nandor Kollar commented on PIG-4815: [~xuefuz] it looks like XMLSparkPrinter is missing from the commit,

[jira] [Commented] (PIG-3417) Skewed Join On Tuple Column Kills Job

2016-12-12 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15741601#comment-15741601 ] Nandor Kollar commented on PIG-3417: Investigated this issue, and it seems, that the problem is with the

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-12-07 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15728194#comment-15728194 ] Nandor Kollar commented on PIG-4952: This is simpler than I thought! Looks good, however it seemed to me

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-12-07 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15728334#comment-15728334 ] Nandor Kollar commented on PIG-4952: [~kellyzly] you search for the max default parallelism value by

[jira] [Commented] (PIG-3417) Skewed Join On Tuple Column Kills Job

2016-12-15 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750855#comment-15750855 ] Nandor Kollar commented on PIG-3417: Looks like the patch didn't break any test, neither in Tez nor in

[jira] [Updated] (PIG-3417) Skewed Join On Tuple Column Kills Job

2016-12-15 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-3417: --- Fix Version/s: 0.17.0 Status: Patch Available (was: Open) > Skewed Join On Tuple Column

[jira] [Commented] (PIG-3417) Skewed Join On Tuple Column Kills Job

2016-12-17 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15757043#comment-15757043 ] Nandor Kollar commented on PIG-3417: Thanks Rohini for your comments, I'll upload a new patch soon. >

[jira] [Updated] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2016-12-17 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-4930: --- Attachment: PIG-4930.patch > Skewed Join Breaks On Empty Sampled Input When Key is From Map >

[jira] [Updated] (PIG-3417) Skewed Join On Tuple Column Kills Job

2016-12-12 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-3417: --- Attachment: PIG-3417.patch > Skewed Join On Tuple Column Kills Job >

[jira] [Assigned] (PIG-3417) Skewed Join On Tuple Column Kills Job

2016-12-12 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-3417: -- Assignee: Nandor Kollar > Skewed Join On Tuple Column Kills Job >

[jira] [Updated] (PIG-5104) Union_15 e2e test failing on Spark

2017-01-13 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5104: --- Description: While working on PIG-4891 I noticed that Union_15 e2e test is failing on Spark mode with

[jira] [Updated] (PIG-3891) FileBasedOutputSizeReader does not calculate size of files in sub-directories

2016-12-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-3891: --- Attachment: PIG-3891-5.patch > FileBasedOutputSizeReader does not calculate size of files in

[jira] [Commented] (PIG-3891) FileBasedOutputSizeReader does not calculate size of files in sub-directories

2016-12-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15715158#comment-15715158 ] Nandor Kollar commented on PIG-3891: Thanks [~rohini] for your comments, I made the required

[jira] [Updated] (PIG-3891) FileBasedOutputSizeReader does not calculate size of files in sub-directories

2016-12-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-3891: --- Attachment: PIG-3891-5.patch > FileBasedOutputSizeReader does not calculate size of files in

[jira] [Updated] (PIG-3891) FileBasedOutputSizeReader does not calculate size of files in sub-directories

2016-12-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-3891: --- Attachment: (was: PIG-3891-5.patch) > FileBasedOutputSizeReader does not calculate size of files in

[jira] [Commented] (PIG-3891) FileBasedOutputSizeReader does not calculate size of files in sub-directories

2016-12-02 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15715771#comment-15715771 ] Nandor Kollar commented on PIG-3891: Thanks Rohini for committing and reviewing my patch! >

[jira] [Commented] (PIG-4858) Implement Skewed join for spark engine

2017-01-06 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804056#comment-15804056 ] Nandor Kollar commented on PIG-4858: Yes, and with this change, we also have to make sure that the e2e

[jira] [Comment Edited] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2017-01-06 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804038#comment-15804038 ] Nandor Kollar edited comment on PIG-4930 at 1/6/17 1:20 PM: Sure, I can, could

[jira] [Assigned] (PIG-4891) Implement FR join by broadcasting small rdd not making more copys of data

2017-01-05 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-4891: -- Assignee: Nandor Kollar > Implement FR join by broadcasting small rdd not making more copys of

[jira] [Updated] (PIG-3417) Skewed Join On Tuple Column Kills Job

2016-12-18 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-3417: --- Attachment: PIG-3417_2.patch > Skewed Join On Tuple Column Kills Job >

[jira] [Commented] (PIG-3417) Skewed Join On Tuple Column Kills Job

2016-12-18 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15759517#comment-15759517 ] Nandor Kollar commented on PIG-3417: Attached PIG-3417_2.patch with these changes: - key tuple is not

[jira] [Comment Edited] (PIG-3417) Skewed Join On Tuple Column Kills Job

2016-12-18 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15759517#comment-15759517 ] Nandor Kollar edited comment on PIG-3417 at 12/18/16 9:28 PM: -- Attached

[jira] [Commented] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2016-12-18 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15759565#comment-15759565 ] Nandor Kollar commented on PIG-4930: When there is no data, PoissonSampleLoader still emits one tuple:

[jira] [Assigned] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2016-12-18 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-4930: -- Assignee: Nandor Kollar (was: Daniel Dai) > Skewed Join Breaks On Empty Sampled Input When Key

[jira] [Updated] (PIG-4930) Skewed Join Breaks On Empty Sampled Input When Key is From Map

2016-12-18 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-4930: --- Status: Patch Available (was: Open) > Skewed Join Breaks On Empty Sampled Input When Key is From Map >

[jira] [Commented] (PIG-3417) Skewed Join On Tuple Column Kills Job

2016-12-19 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762054#comment-15762054 ] Nandor Kollar commented on PIG-3417: Thanks Rohini, I agree, let's leave the unit test out, and commit

[jira] [Assigned] (PIG-5157) Upgrade to Spark 2.0

2017-03-23 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar reassigned PIG-5157: -- Assignee: Nandor Kollar > Upgrade to Spark 2.0 > > > Key:

[jira] [Updated] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5167: --- Attachment: (was: PIG-5167_3.patch) > Limit_4 is failing with spark exec type >

[jira] [Updated] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5167: --- Attachment: PIG-5167_3.patch > Limit_4 is failing with spark exec type >

[jira] [Updated] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5167: --- Status: Patch Available (was: In Progress) > Limit_4 is failing with spark exec type >

[jira] [Updated] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5167: --- Attachment: PIG-5167_3.patch > Limit_4 is failing with spark exec type >

[jira] [Commented] (PIG-5134) Fix TestAvroStorage unit test in Spark mode

2017-03-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940712#comment-15940712 ] Nandor Kollar commented on PIG-5134: [~kellyzly] an update: I managed to solve this without using Kryo,

[jira] [Commented] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-28 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944842#comment-15944842 ] Nandor Kollar commented on PIG-5163: It looks like this is an issue with multi-query optimization.

[jira] [Commented] (PIG-5134) Fix TestAvroStorage unit test in Spark mode

2017-03-27 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942974#comment-15942974 ] Nandor Kollar commented on PIG-5134: Actually this issue came up before, Kryo was downgraded on spark

[jira] [Commented] (PIG-5134) Fix TestAvroStorage unit test in Spark mode

2017-03-27 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942812#comment-15942812 ] Nandor Kollar commented on PIG-5134: [~rohini] yes, unfortunately using Kryo would lead to issues: Hive

[jira] [Updated] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5163: --- Attachment: PIG-5163_1.patch > MultiQuery_Streaming_1 is failing with spark exec type >

[jira] [Updated] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5163: --- Attachment: (was: PIG-5163_1.patch) > MultiQuery_Streaming_1 is failing with spark exec type >

[jira] [Created] (PIG-5204) Implement illustrate in Spark

2017-03-29 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5204: -- Summary: Implement illustrate in Spark Key: PIG-5204 URL: https://issues.apache.org/jira/browse/PIG-5204 Project: Pig Issue Type: Improvement

[jira] [Updated] (PIG-5204) Implement illustrate in Spark

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5204: --- Priority: Minor (was: Major) > Implement illustrate in Spark > - > >

[jira] [Commented] (PIG-5158) Several e2e tests are marked to run only in Tez or MR mode only

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947318#comment-15947318 ] Nandor Kollar commented on PIG-5158: Yeah, I think this was the original idea. [~knoguchi] can you

[jira] [Updated] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5163: --- Attachment: PIG-5163_1.patch > MultiQuery_Streaming_1 is failing with spark exec type >

[jira] [Commented] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947177#comment-15947177 ] Nandor Kollar commented on PIG-5163: I did some more investigation, and it seems that the problem is

[jira] [Updated] (PIG-5158) Several e2e tests are marked to run only in Tez or MR mode only

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5158: --- Attachment: PIG-5158_4.patch > Several e2e tests are marked to run only in Tez or MR mode only >

[jira] [Commented] (PIG-5176) Several ComputeSpec test cases fail

2017-03-30 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948768#comment-15948768 ] Nandor Kollar commented on PIG-5176: Let's leave this open for now, I'll verify, but I'm afraid it is

[jira] [Updated] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5163: --- Attachment: PIG-5163_1.patch > MultiQuery_Streaming_1 is failing with spark exec type >

[jira] [Updated] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5163: --- Attachment: (was: PIG-5163_1.patch) > MultiQuery_Streaming_1 is failing with spark exec type >

[jira] [Commented] (PIG-5158) Several e2e tests are marked to run only in Tez or MR mode only

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947324#comment-15947324 ] Nandor Kollar commented on PIG-5158: Uploaded PIG-5158_4.patch: illustrate is not ye implemented for

[jira] [Comment Edited] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948015#comment-15948015 ] Nandor Kollar edited comment on PIG-5163 at 3/29/17 10:42 PM: -- [~kellyzly]

[jira] [Commented] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948015#comment-15948015 ] Nandor Kollar commented on PIG-5163: [~kellyzly] thank you for the review! MapReduceLauncher was

[jira] [Resolved] (PIG-5172) StreamingPerformance_2 is failing with spark exec type

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar resolved PIG-5172. Resolution: Duplicate This test fails due to the same reason. > StreamingPerformance_2 is failing

[jira] [Commented] (PIG-5163) MultiQuery_Streaming_1 is failing with spark exec type

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946895#comment-15946895 ] Nandor Kollar commented on PIG-5163: [~kellyzly] the plan after multiquery optimization you mentioned

[jira] [Commented] (PIG-5170) SkewedJoin_14 is failing with spark exec type

2017-03-31 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950708#comment-15950708 ] Nandor Kollar commented on PIG-5170: Thanks [~kexianda]! [~kellyzly] I'll close these issues as

[jira] [Commented] (PIG-5167) Limit_4 is failing with spark exec type

2017-03-24 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940432#comment-15940432 ] Nandor Kollar commented on PIG-5167: [~kellyzly] actually I updated PIG-5158 with patch #3: excluded

<    1   2   3   4   5   6   >