[jira] [Updated] (PIG-4951) Rename PIG_ATS_ENABLED constant

[ https://issues.apache.org/jira/browse/PIG-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4951: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Updated] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3087: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Updated] (PIG-5036) Remove biggish from e2e input dataset

[ https://issues.apache.org/jira/browse/PIG-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5036: Status: Patch Available (was: Open) > Remove biggish from e2e input dataset >

[jira] [Updated] (PIG-5036) Remove biggish from e2e input dataset

[ https://issues.apache.org/jira/browse/PIG-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5036: Attachment: PIG-5036-1.patch Once remove biggish and setting max split size, Rank_4/Rank_5 is meaningless as

[jira] [Created] (PIG-5036) Remove biggish from e2e input dataset

Daniel Dai created PIG-5036: --- Summary: Remove biggish from e2e input dataset Key: PIG-5036 URL: https://issues.apache.org/jira/browse/PIG-5036 Project: Pig Issue Type: Improvement

[jira] [Commented] (PIG-4951) Rename PIG_ATS_ENABLED constant

[ https://issues.apache.org/jira/browse/PIG-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552798#comment-15552798 ] Daniel Dai commented on PIG-4951: - +1. Will commit shortly. > Rename PIG_ATS_ENABLED constant >

[jira] [Commented] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552793#comment-15552793 ] Daniel Dai commented on PIG-3087: - Another question, why setting

[jira] [Commented] (PIG-4951) Rename PIG_ATS_ENABLED constant

[ https://issues.apache.org/jira/browse/PIG-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552538#comment-15552538 ] Daniel Dai commented on PIG-4951: - CALLER_ID falls in the same category. However, I am not enthusiastic in

[jira] [Issue Comment Deleted] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3087: Comment: was deleted (was: I think the original test is intended to test the fail path. It's better to

[jira] [Commented] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552504#comment-15552504 ] Daniel Dai commented on PIG-3087: - I think the original test is intended to test the fail path. It's better

[jira] [Commented] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552503#comment-15552503 ] Daniel Dai commented on PIG-3087: - I think the original test is intended to test the fail path. It's better

[jira] [Comment Edited] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15550171#comment-15550171 ] Daniel Dai edited comment on PIG-3087 at 10/6/16 4:35 AM: -- The bug fix in

[jira] [Commented] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15550171#comment-15550171 ] Daniel Dai commented on PIG-3087: - The bug fix in ForEachUserSchemaVisitor looks good. I have comments on

[jira] [Commented] (PIG-5033) MultiQueryOptimizerTez creates bad plan with union, split and FRJoin

[ https://issues.apache.org/jira/browse/PIG-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543420#comment-15543420 ] Daniel Dai commented on PIG-5033: - scope-61 definitely cause the issue as we cannot have parallel edges

[jira] [Commented] (PIG-5020) Give file location for loadcaster related warning and errors

[ https://issues.apache.org/jira/browse/PIG-5020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543359#comment-15543359 ] Daniel Dai commented on PIG-5020: - +1 > Give file location for loadcaster related warning and errors >

[jira] [Commented] (PIG-4897) Scope of param substitution for run/exec commands

[ https://issues.apache.org/jira/browse/PIG-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543299#comment-15543299 ] Daniel Dai commented on PIG-4897: - +1 for doc addition. > Scope of param substitution for run/exec commands

[jira] [Commented] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543280#comment-15543280 ] Daniel Dai commented on PIG-4976: - I do have a "foo" file in my test directory, that's why I hit (2) not (1)

[jira] [Commented] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15494941#comment-15494941 ] Daniel Dai commented on PIG-4976: - TestStreamingLocal pass for me with PIG-4976-2.patch. You are using

[jira] [Updated] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4976: Attachment: PIG-4976-2.patch Yes, that's doable. At least we can signal error to the pipeline. > streaming

[jira] [Commented] (PIG-4897) Scope of param substitution for run/exec commands

[ https://issues.apache.org/jira/browse/PIG-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15492656#comment-15492656 ] Daniel Dai commented on PIG-4897: - +1, the new behavior is more useful. We shall also document it. > Scope

[jira] [Commented] (PIG-5032) Output record stats in Tez is wrong when there is split followed by union

[ https://issues.apache.org/jira/browse/PIG-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491372#comment-15491372 ] Daniel Dai commented on PIG-5032: - Discussed offline, there is a minor behavior change: In Tez, we might get

[jira] [Commented] (PIG-5032) Output record stats in Tez is wrong when there is split followed by union

[ https://issues.apache.org/jira/browse/PIG-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491306#comment-15491306 ] Daniel Dai commented on PIG-5032: - Now MULTI_STORE_COUNTER_GROUP is actually STORE_COUNTER_GROUP. Is that

[jira] [Created] (PIG-5030) kill command only kill application the session launches in Tez mode

Daniel Dai created PIG-5030: --- Summary: kill command only kill application the session launches in Tez mode Key: PIG-5030 URL: https://issues.apache.org/jira/browse/PIG-5030 Project: Pig Issue

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15473036#comment-15473036 ] Daniel Dai commented on PIG-4967: - That's fine for me. Patch committed to branch-0.16 as well. > NPE in

[jira] [Commented] (PIG-5020) Give file location for loadcaster related warning and errors

[ https://issues.apache.org/jira/browse/PIG-5020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472894#comment-15472894 ] Daniel Dai commented on PIG-5020: - +1 > Give file location for loadcaster related warning and errors >

[jira] [Updated] (PIG-5019) Pig generates tons of warnings for udf with enabled warnings aggregation

[ https://issues.apache.org/jira/browse/PIG-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5019: Assignee: Murshid Chalaev > Pig generates tons of warnings for udf with enabled warnings aggregation >

[jira] [Resolved] (PIG-4973) Bigdecimal divison fails

[ https://issues.apache.org/jira/browse/PIG-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4973. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.0 +1, that's useful fix. Patch

[jira] [Commented] (PIG-4975) Map schema shows "Type: null Uid: null" in explain

[ https://issues.apache.org/jira/browse/PIG-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454629#comment-15454629 ] Daniel Dai commented on PIG-4975: - +1 pending tests. > Map schema shows "Type: null Uid: null" in explain >

[jira] [Commented] (PIG-4974) A simple map reference fail to cast

[ https://issues.apache.org/jira/browse/PIG-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454570#comment-15454570 ] Daniel Dai commented on PIG-4974: - +1 for (1) for this issue. We can do it later but we need (3) as long

[jira] [Updated] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4967: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Updated] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4976: Description: When investigating PIG-4972, I also notice Pig job stuck when the perl script have syntax

[jira] [Updated] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4976: Attachment: PIG-4976-1.patch > streaming job with store clause stuck if the script fail >

[jira] [Updated] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4976: Status: Patch Available (was: Open) > streaming job with store clause stuck if the script fail >

[jira] [Commented] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454501#comment-15454501 ] Daniel Dai commented on PIG-4976: - The reason is, when the process exit, the input/output stream closed. Pig

[jira] [Created] (PIG-4976) streaming job with store clause stuck if the script fail

Daniel Dai created PIG-4976: --- Summary: streaming job with store clause stuck if the script fail Key: PIG-4976 URL: https://issues.apache.org/jira/browse/PIG-4976 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-4972) StreamingIO_1 fail on perl 5.22

[ https://issues.apache.org/jira/browse/PIG-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4972: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448412#comment-15448412 ] Daniel Dai commented on PIG-4967: - I am fine with the fix. The line "Because MAPREDUCE-6762 fixes PIG-4967

[jira] [Updated] (PIG-4972) StreamingIO_1 fail on perl 5.22

[ https://issues.apache.org/jira/browse/PIG-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4972: Status: Patch Available (was: Open) > StreamingIO_1 fail on perl 5.22 > --- > >

[jira] [Updated] (PIG-4972) StreamingIO_1 fail on perl 5.22

[ https://issues.apache.org/jira/browse/PIG-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4972: Attachment: PIG-4972-1.patch > StreamingIO_1 fail on perl 5.22 > --- > >

[jira] [Created] (PIG-4972) StreamingIO_1 fail on perl 5.22

Daniel Dai created PIG-4972: --- Summary: StreamingIO_1 fail on perl 5.22 Key: PIG-4972 URL: https://issues.apache.org/jira/browse/PIG-4972 Project: Pig Issue Type: Bug Components: e2e

[jira] [Comment Edited] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15437217#comment-15437217 ] Daniel Dai edited comment on PIG-4967 at 8/25/16 4:58 PM: -- Sorry for confusion.

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15437217#comment-15437217 ] Daniel Dai commented on PIG-4967: - Sorry for confusion. When I say clone ControlledJob#toString(), I don't

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433214#comment-15433214 ] Daniel Dai commented on PIG-4967: - I assume by doing " j.getJob().getStatus()==null", we don't need to pull

[jira] [Commented] (PIG-2125) Make Pig work with hadoop .NEXT

[ https://issues.apache.org/jira/browse/PIG-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432147#comment-15432147 ] Daniel Dai commented on PIG-2125: - If something went wrong, I believe any MiniCluster or local unit test

[jira] [Commented] (PIG-2125) Make Pig work with hadoop .NEXT

[ https://issues.apache.org/jira/browse/PIG-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431871#comment-15431871 ] Daniel Dai commented on PIG-2125: - org.apache.pig.ExecType is required, Pig use this to enumerate all

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431866#comment-15431866 ] Daniel Dai commented on PIG-4967: - Thank for your patch, but it is longer than I expected. Can we try to

[jira] [Commented] (PIG-4971) Non Hadoop23 builds are broken. Perhaps, default value for 'hadoopversion' should be set to 23

[ https://issues.apache.org/jira/browse/PIG-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431851#comment-15431851 ] Daniel Dai commented on PIG-4971: - That's true. We break compatibility of Hadoop 1 with acknowledgement. I

[jira] [Resolved] (PIG-4971) Non Hadoop23 builds are broken. Perhaps, default value for 'hadoopversion' should be set to 23

[ https://issues.apache.org/jira/browse/PIG-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4971. - Resolution: Not A Problem > Non Hadoop23 builds are broken. Perhaps, default value for 'hadoopversion' >

[jira] [Commented] (PIG-4912) Tez code does not differentiate between cache archives and files

[ https://issues.apache.org/jira/browse/PIG-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431846#comment-15431846 ] Daniel Dai commented on PIG-4912: - We only need to fix on Tez side. MR side is good. We don't need to change

[jira] [Commented] (PIG-4912) Tez code does not differentiate between cache archives and files

[ https://issues.apache.org/jira/browse/PIG-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421898#comment-15421898 ] Daniel Dai commented on PIG-4912: - Can you attach a patch without the space changes? > Tez code does not

[jira] [Resolved] (PIG-1183) Minor nits on pig trunk code

[ https://issues.apache.org/jira/browse/PIG-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-1183. - Resolution: Invalid Yes, those are no longer valid. Thanks for pointing out. > Minor nits on pig trunk

[jira] [Commented] (PIG-4933) TestDataBagAccess.testBagConstantFlatten1/TestLogicalPlanBuilder.testQuery90 broken after PIG-2315

[ https://issues.apache.org/jira/browse/PIG-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416472#comment-15416472 ] Daniel Dai commented on PIG-4933: - Thanks for dealing with nested schema. Though the code is lengthy, I

[jira] [Resolved] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4931. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Artem! > Document IN

[jira] [Commented] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414793#comment-15414793 ] Daniel Dai commented on PIG-4931: - There are extra spaces, such as "IN (expression)        ", should be "IN

[jira] [Commented] (PIG-4968) Fix unit test failure of TestLogicalPlanBuilder#testQuery90

[ https://issues.apache.org/jira/browse/PIG-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414418#comment-15414418 ] Daniel Dai commented on PIG-4968: - I don't think build.xml changes are related, right? > Fix unit test

[jira] [Commented] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414269#comment-15414269 ] Daniel Dai commented on PIG-4931: - There is a typo in "IN operator) allows", the right parenthesis is

[jira] [Commented] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413061#comment-15413061 ] Daniel Dai commented on PIG-4931: - The patch is way too big than it should be. The format changes are

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412955#comment-15412955 ] Daniel Dai commented on PIG-4967: - Decompose means instead of invoking j.toString, you can construct the

[jira] [Updated] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4931: Assignee: Artem Ervits > Document IN operator > > > Key: PIG-4931 >

[jira] [Commented] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412508#comment-15412508 ] Daniel Dai commented on PIG-4931: - [~dbist13], can you try if you can attach patch now? > Document IN

[jira] [Updated] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4967: Assignee: Xiang Li > NPE in PigJobControl.run() when job status is null >

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412351#comment-15412351 ] Daniel Dai commented on PIG-4967: - Sure, you can decompose ControlledJob and do null check on individual

[jira] [Resolved] (PIG-4965) Refactor test/perf/pigmix/bin/runpigmix.pl to delete the output of single test case if we enable cleanup_after_test

[ https://issues.apache.org/jira/browse/PIG-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4965. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.0 spark-branch

[jira] [Commented] (PIG-4966) Fix Pig compatibility with Hive 2.1.0

[ https://issues.apache.org/jira/browse/PIG-4966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411396#comment-15411396 ] Daniel Dai commented on PIG-4966: - There are incompatible changes between Hive 2 and Hive 1. Currently Hive

[jira] [Commented] (PIG-4965) Refactor test/perf/pigmix/bin/runpigmix.pl to delete the output of single test case if we enable cleanup_after_test

[ https://issues.apache.org/jira/browse/PIG-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411389#comment-15411389 ] Daniel Dai commented on PIG-4965: - The suggested code makes sense to me. Remove a non-exist file is

[jira] [Commented] (PIG-4964) Pig code when executed on Tez fails with and error 'Schema cannot be determined'. Pig version we use is 0.15

[ https://issues.apache.org/jira/browse/PIG-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410506#comment-15410506 ] Daniel Dai commented on PIG-4964: - Can you find the complete exception stack from pig.log and paste here? >

[jira] [Commented] (PIG-259) allow store to overwrite existing directroy

[ https://issues.apache.org/jira/browse/PIG-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410505#comment-15410505 ] Daniel Dai commented on PIG-259: [~pritish_sa...@yahoo.com], it is only applicable to customized StoreFunc.

[jira] [Commented] (PIG-4958) Tez autoparallelism estimation for order by is higher than mapreduce

[ https://issues.apache.org/jira/browse/PIG-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410497#comment-15410497 ] Daniel Dai commented on PIG-4958: - If we want to use counter, why not get NUM_RECORDS as well? Then we can

[jira] [Commented] (PIG-4965) Refactor test/perf/pigmix/bin/runpigmix.pl to delete the output of single test case if we enable cleanup_after_test

[ https://issues.apache.org/jira/browse/PIG-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410180#comment-15410180 ] Daniel Dai commented on PIG-4965: - Remove a file does not exist clearly a bug. I think you can just add

[jira] [Commented] (PIG-4935) TEZ_USE_CLUSTER_HADOOP_LIBS is always set to true

[ https://issues.apache.org/jira/browse/PIG-4935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394578#comment-15394578 ] Daniel Dai commented on PIG-4935: - +1 > TEZ_USE_CLUSTER_HADOOP_LIBS is always set to true >

[jira] [Commented] (PIG-4960) Split followed by order by/skewed join is skewed

[ https://issues.apache.org/jira/browse/PIG-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393277#comment-15393277 ] Daniel Dai commented on PIG-4960: - +1 > Split followed by order by/skewed join is skewed >

[jira] [Commented] (PIG-4961) CROSS followed by LIMIT inside nested foreach drop data from result

[ https://issues.apache.org/jira/browse/PIG-4961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393274#comment-15393274 ] Daniel Dai commented on PIG-4961: - +1 > CROSS followed by LIMIT inside nested foreach drop data from result

[jira] [Resolved] (PIG-4852) Add accumulator implementation for MaxTupleBy1stField

[ https://issues.apache.org/jira/browse/PIG-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4852. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.0 Patch committed to trunk. Thanks

[jira] [Commented] (PIG-4961) LIMIT operation drop data from result

[ https://issues.apache.org/jira/browse/PIG-4961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392544#comment-15392544 ] Daniel Dai commented on PIG-4961: - Yes, I can reproduce. [~rohini], I don't feel the POLimit change is

[jira] [Commented] (PIG-4957) See "Received kill signal" message for a normal run after PIG-4921

[ https://issues.apache.org/jira/browse/PIG-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392533#comment-15392533 ] Daniel Dai commented on PIG-4957: - +1 > See "Received kill signal" message for a normal run after PIG-4921

[jira] [Commented] (PIG-4957) See "Received kill signal" message for a normal run after PIG-4921

[ https://issues.apache.org/jira/browse/PIG-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390402#comment-15390402 ] Daniel Dai commented on PIG-4957: - It happens in MR job, does not sound like PIG-4928. > See "Received kill

[jira] [Commented] (PIG-4921) Kill running jobs on InterruptedException

[ https://issues.apache.org/jira/browse/PIG-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390244#comment-15390244 ] Daniel Dai commented on PIG-4921: - See lots of "Received kill signal" message after the patch. Created

[jira] [Updated] (PIG-4957) See "Received kill signal" message for a normal run after PIG-4921

[ https://issues.apache.org/jira/browse/PIG-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4957: Summary: See "Received kill signal" message for a normal run after PIG-4921 (was: See "Received kill signal"

[jira] [Created] (PIG-4957) See "Received kill signal" message for a normal run after pig-4921

Daniel Dai created PIG-4957: --- Summary: See "Received kill signal" message for a normal run after pig-4921 Key: PIG-4957 URL: https://issues.apache.org/jira/browse/PIG-4957 Project: Pig Issue

[jira] [Resolved] (PIG-4955) Difference in record counts for same pig script on same data

[ https://issues.apache.org/jira/browse/PIG-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4955. - Resolution: Duplicate Fix Version/s: 0.16.0 It is PIG-4683. > Difference in record counts for same

[jira] [Commented] (PIG-4852) Add accumulator implementation for MaxTupleBy1stField

[ https://issues.apache.org/jira/browse/PIG-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388945#comment-15388945 ] Daniel Dai commented on PIG-4852: - You also need to change javac.version to 1.7 in

[jira] [Commented] (PIG-4955) Difference in record counts for same pig script on same data

[ https://issues.apache.org/jira/browse/PIG-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388941#comment-15388941 ] Daniel Dai commented on PIG-4955: - The issue is fixed in 0.16. I haven't pin down which patch actually fix

[jira] [Updated] (PIG-4953) Predicate push-down will not run filters for single unary expressions

[ https://issues.apache.org/jira/browse/PIG-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4953: Attachment: PIG-4953.3.patch The import statement in TestNewPartitionFilterPushDown is unnecessary. Also

[jira] [Updated] (PIG-4953) Predicate push-down will not run filters for single unary expressions

[ https://issues.apache.org/jira/browse/PIG-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4953: Fix Version/s: 0.17.0 > Predicate push-down will not run filters for single unary expressions >

[jira] [Commented] (PIG-4092) Predicate pushdown for Parquet

[ https://issues.apache.org/jira/browse/PIG-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387189#comment-15387189 ] Daniel Dai commented on PIG-4092: - Pig's ParquetLoader is a wrapper. It's true PARQUET-397 implements

[jira] [Updated] (PIG-4947) LOAD with HBaseStorage using a mix of pure wildcards and prefixed wildcards results in empty maps for the pure wildcarded column families.

[ https://issues.apache.org/jira/browse/PIG-4947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4947: Fix Version/s: 0.16.1 0.17.0 > LOAD with HBaseStorage using a mix of pure wildcards and

[jira] [Commented] (PIG-4953) Predicate push-down will not run filters for single unary expressions

[ https://issues.apache.org/jira/browse/PIG-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385296#comment-15385296 ] Daniel Dai commented on PIG-4953: - Seems you miss something in the test, I only see you change

[jira] [Resolved] (PIG-4954) Pig ToDate() exception with hive partition table ,partitioned by column of DATE datatype

[ https://issues.apache.org/jira/browse/PIG-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4954. - Resolution: Invalid > Pig ToDate() exception with hive partition table ,partitioned by column of > DATE

[jira] [Commented] (PIG-4954) Pig ToDate() exception with hive partition table ,partitioned by column of DATE datatype

[ https://issues.apache.org/jira/browse/PIG-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384549#comment-15384549 ] Daniel Dai commented on PIG-4954: - The issue should be in HCatalog. Please open a Hive ticket instead. >

[jira] [Updated] (PIG-4948) Pig on Tez AM use too much memory on a small cluster

[ https://issues.apache.org/jira/browse/PIG-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4948: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Updated] (PIG-4948) Pig on Tez AM use too much memory on a small cluster

[ https://issues.apache.org/jira/browse/PIG-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4948: Attachment: PIG-4948-2.patch Rename pig.tez.override.am.memory to pig.tez.configure.am.memory as suggested.

[jira] [Created] (PIG-4951) Rename PIG_ATS_ENABLED constant

Daniel Dai created PIG-4951: --- Summary: Rename PIG_ATS_ENABLED constant Key: PIG-4951 URL: https://issues.apache.org/jira/browse/PIG-4951 Project: Pig Issue Type: Improvement Reporter:

[jira] [Updated] (PIG-4940) Predicate push-down filtering unary expressions can be pushed.

[ https://issues.apache.org/jira/browse/PIG-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4940: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.0 Status: Resolved (was:

[jira] [Updated] (PIG-4940) Predicate push-down filtering unary expressions can be pushed.

[ https://issues.apache.org/jira/browse/PIG-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4940: Attachment: PIG-4940.3.patch Move the test to TestNewPartitionFilterPushDown. > Predicate push-down

[jira] [Commented] (PIG-4939) QueryParserUtils.setHdfsServers(QueryParserUtils.java:104) should not be called for non-dfs methods

[ https://issues.apache.org/jira/browse/PIG-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383131#comment-15383131 ] Daniel Dai commented on PIG-4939: - I suggest hardcode it into getRemoteHosts. >

[jira] [Commented] (PIG-4940) Predicate push-down filtering unary expressions can be pushed.

[ https://issues.apache.org/jira/browse/PIG-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15381588#comment-15381588 ] Daniel Dai commented on PIG-4940: - No worry, I can move it. > Predicate push-down filtering unary

[jira] [Updated] (PIG-4942) Fix mvn-install ant target

[ https://issues.apache.org/jira/browse/PIG-4942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4942: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1 for

[jira] [Updated] (PIG-4950) Fix minor issues with running scripts in non-local FileSystems

[ https://issues.apache.org/jira/browse/PIG-4950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4950: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.16.1 0.17.0

[jira] [Updated] (PIG-4950) Fix minor issues with running scripts in non-local FileSystems

[ https://issues.apache.org/jira/browse/PIG-4950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4950: Assignee: Peter Slawski > Fix minor issues with running scripts in non-local FileSystems >

[jira] [Commented] (PIG-4940) Predicate push-down filtering unary expressions can be pushed.

[ https://issues.apache.org/jira/browse/PIG-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15381221#comment-15381221 ] Daniel Dai commented on PIG-4940: - The fix looks good. However, the test case fits better in

<    1   2   3   4   5   6   7   8   9   10   >