[
https://issues.apache.org/jira/browse/PIG-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-3317:
-
Attachment: PIG-3317_disable_opts.4.patch
> disable optimizations via pig propert
lanVisitor.java:52)
at
org.apache.pig.newplan.logical.optimizer.ProjectionPatcher.transformed(ProjectionPatcher.java:48)
at
org.apache.pig.newplan.optimizer.PlanOptimizer.optimize(PlanOptimizer.java:113)
... 13 more
Thanks,
Travis Crawford
[
https://issues.apache.org/jira/browse/PIG-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-3317:
-
Attachment: PIG-3317_disable_opts.3.patch
Changes per review.
> disa
zer.optimize(PlanOptimizer.java:113)
... 13 more
Thanks,
Travis Crawford
the pig
> > properties file and the command line (or script) will be additive.
>
> Travis Crawford wrote:
> Currently it works like this:
>
> (a) -optimizer_off command-line rules are always disabled.
> (b) The "pig.optimizer.rules.disabled" p
the pig
> > properties file and the command line (or script) will be additive.
>
> Travis Crawford wrote:
> Currently it works like this:
>
> (a) -optimizer_off command-line rules are always disabled.
> (b) The "pig.optimizer.rules.disabled" p
he common use-cases without
introducing extra complexity.
- Travis
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11032/#review20516
------
ruleSet, "ruleSet") give a better error message ?
>
> Travis Crawford wrote:
> I'm generally against checkNotNull in constructors because an NPE
> suggests the method did something wrong. checkArgument signals the caller did
> something wrong. Since this is validati
nVisitor.java:142)
> at
> org.apache.pig.newplan.logical.relational.LOInnerLoad.accept(LOInnerLoad.java:128)
> at
> org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
> at
> org.apache.pig.newplan.logical.optimizer.AllExpressionVisitor.visit(AllExpressionVisitor.java:124)
> at
> org.apache.pig.newplan.logical.relational.LOForEach.accept(LOForEach.java:76)
> at
> org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
> at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
> at
> org.apache.pig.newplan.logical.optimizer.ProjectionPatcher.transformed(ProjectionPatcher.java:48)
> at
> org.apache.pig.newplan.optimizer.PlanOptimizer.optimize(PlanOptimizer.java:113)
> ... 13 more
>
>
> Thanks,
>
> Travis Crawford
>
>
[
https://issues.apache.org/jira/browse/PIG-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-3317:
-
Status: Patch Available (was: Open)
> disable optimizations via pig propert
[
https://issues.apache.org/jira/browse/PIG-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-3317:
-
Attachment: PIG-3317_disable_opts.2.patch
Updated patch; please see review for comments. Main
, in
HExecutionEngine.java line 251 the property is required to exist. I believe
this bug snuck in because FilterLogicExpressionSimplifier is disabled by
default so there's typically something disabled.
- Travis Crawford
On May 1
wplan.PlanVisitor.visit(PlanVisitor.java:52)
at
org.apache.pig.newplan.logical.optimizer.ProjectionPatcher.transformed(ProjectionPatcher.java:48)
at
org.apache.pig.newplan.optimizer.PlanOptimizer.optimize(PlanOptimizer.java:113)
... 13 more
Thanks,
Travis Crawford
ript works because query
parsing may not have happened yet. He's correct - I did not explicitly test
that and it doesn't work. Taking a look at how to proceed. It would be ideal if
individual scripts can disable optimizations.
- Travis Crawford
On May 9, 2013, 9:03 p.m., T
[
https://issues.apache.org/jira/browse/PIG-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-3317:
-
Affects Version/s: 0.12
Release Note: Optimization rules can be disabled with the
[
https://issues.apache.org/jira/browse/PIG-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-3317:
-
Attachment: PIG-3317_disable_opts.1.patch
Review board: https://reviews.apache.org/r/11032
[
https://issues.apache.org/jira/browse/PIG-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on PIG-3317 started by Travis Crawford.
> disable optimizations via pig properties
>
>
> K
lanVisitor.java:52)
at
org.apache.pig.newplan.logical.optimizer.ProjectionPatcher.transformed(ProjectionPatcher.java:48)
at
org.apache.pig.newplan.optimizer.PlanOptimizer.optimize(PlanOptimizer.java:113)
... 13 more
Thanks,
Travis Crawford
Travis Crawford created PIG-3317:
Summary: disable optimizations via pig properties
Key: PIG-3317
URL: https://issues.apache.org/jira/browse/PIG-3317
Project: Pig
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/PIG-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13479191#comment-13479191
]
Travis Crawford commented on PIG-2582:
--
Sounds good!
> Store
[
https://issues.apache.org/jira/browse/PIG-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13479102#comment-13479102
]
Travis Crawford commented on PIG-2582:
--
Hey [~prkommireddi], this came up w
[
https://issues.apache.org/jira/browse/PIG-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433669#comment-13433669
]
Travis Crawford commented on PIG-2873:
--
Very cool the pig script will be switched
[
https://issues.apache.org/jira/browse/PIG-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford reassigned PIG-2775:
Assignee: Daniel Dai (was: Travis Crawford)
Accidentally assigned to me. Reverting
[
https://issues.apache.org/jira/browse/PIG-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford reassigned PIG-2775:
Assignee: Travis Crawford (was: Daniel Dai)
> Register jar does not goes to classp
[
https://issues.apache.org/jira/browse/PIG-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2730:
-
Attachment: PIG-2730.1.patch
> TFileStorage getStatistics incorrectly throws an except
[
https://issues.apache.org/jira/browse/PIG-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2730:
-
Status: Patch Available (was: Open)
> TFileStorage getStatistics incorrectly throws
Travis Crawford created PIG-2730:
Summary: TFileStorage getStatistics incorrectly throws an
exception instead of returning null
Key: PIG-2730
URL: https://issues.apache.org/jira/browse/PIG-2730
Travis Crawford created PIG-2723:
Summary: Pig fails when pig.jar is removed during a job
Key: PIG-2723
URL: https://issues.apache.org/jira/browse/PIG-2723
Project: Pig
Issue Type: Bug
[
https://issues.apache.org/jira/browse/PIG-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276273#comment-13276273
]
Travis Crawford commented on PIG-2693:
--
+1 (nonbinding). Thanks Bill! I just te
[
https://issues.apache.org/jira/browse/PIG-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276260#comment-13276260
]
Travis Crawford commented on PIG-2693:
--
Confirmed the patch above fixes this i
[
https://issues.apache.org/jira/browse/PIG-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276238#comment-13276238
]
Travis Crawford commented on PIG-2693:
--
This patch is causing the issue:
h
[
https://issues.apache.org/jira/browse/PIG-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276206#comment-13276206
]
Travis Crawford commented on PIG-2693:
--
Looking into this, I confirmed the red
[
https://issues.apache.org/jira/browse/PIG-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on PIG-2604 started by Travis Crawford.
> Pig should print its build info at runtime
> --
>
> K
[
https://issues.apache.org/jira/browse/PIG-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2604:
-
Attachment: PIG-2604_print_build_info_2.diff
This change is far simpler than the previous one
[
https://issues.apache.org/jira/browse/PIG-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231778#comment-13231778
]
Travis Crawford commented on PIG-2604:
--
@jco - Ha, thanks for cluing me into that
[
https://issues.apache.org/jira/browse/PIG-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2604:
-
Attachment: PIG-2604_print_build_info.diff
> Pig should print its build info at runt
Pig should print its build info at runtime
--
Key: PIG-2604
URL: https://issues.apache.org/jira/browse/PIG-2604
Project: Pig
Issue Type: Improvement
Reporter: Travis Crawford
[
https://issues.apache.org/jira/browse/PIG-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford reassigned PIG-2604:
Assignee: Travis Crawford
> Pig should print its build info at runt
[
https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2573:
-
Attachment: PIG-2573_get_size_from_stats_if_possible_4.diff
Whoops, the previous diff missed a
Store size in bytes (not mbytes) in ResourceStatistics
--
Key: PIG-2582
URL: https://issues.apache.org/jira/browse/PIG-2582
Project: Pig
Issue Type: Bug
Reporter: Travis
[
https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2573:
-
Attachment: PIG-2573_get_size_from_stats_if_possible_3.diff
Good comments Julien, thanks.
Please
[
https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2573:
-
Attachment: PIG-2573_get_size_from_stats_if_possible_2.diff
Updated patch renamed method, and
[
https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13227962#comment-13227962
]
Travis Crawford commented on PIG-2573:
--
PIGSTORAGEWITHSTATISTICS COMMENT:
Origin
[
https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2573:
-
Status: Patch Available (was: Open)
> Automagically setting parallelism based on input f
[
https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2573:
-
Attachment: PIG-2573_get_size_from_stats_if_possible.diff
Patch has been updated to get the size
[
https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2573:
-
Attachment: PIG-2573_move_getinputbytes_to_loadfunc.diff
The attached patch shows what moving the
[
https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13224970#comment-13224970
]
Travis Crawford commented on PIG-2573:
--
Yup, I'm looking into this. After pig
[
https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford reassigned PIG-2573:
Assignee: Travis Crawford
> Automagically setting parallelism based on input file s
[
https://issues.apache.org/jira/browse/PIG-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13224953#comment-13224953
]
Travis Crawford commented on PIG-2574:
--
This is somewhat related to PIG-2573. In
: Pig
Issue Type: Bug
Reporter: Travis Crawford
PIG-2334 was helpful in understanding this issue. Short version is input file
size is only computed if the path begins with a whitelisted prefix, currently:
* /
* hdfs:
* file:
* s3n:
As HCatalog locations use the form
[
https://issues.apache.org/jira/browse/PIG-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219749#comment-13219749
]
Travis Crawford commented on PIG-2532:
--
Thomas, thanks for the report. I will ta
[
https://issues.apache.org/jira/browse/PIG-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2532:
-
Attachment: PIG-2532-v2.patch
Internally we discussed and think this approach is best because it
[
https://issues.apache.org/jira/browse/PIG-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2532:
-
Attachment: PIG-253_javax.zip
Uploading zip file of version that compiles+jars at runtime, mainly
[
https://issues.apache.org/jira/browse/PIG-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209982#comment-13209982
]
Travis Crawford commented on PIG-2532:
--
Status update:
I reproduced the issue
[
https://issues.apache.org/jira/browse/PIG-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208869#comment-13208869
]
Travis Crawford commented on PIG-2533:
--
The now unused method actually is remove
[
https://issues.apache.org/jira/browse/PIG-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2533:
-
Attachment: PIG-2533.patch
Updated patch to remove {{getFirstLineFromMessage}} and update all
[
https://issues.apache.org/jira/browse/PIG-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2532:
-
Attachment: PIG-2532.patch
> Registered classes fail deserialization in front
[
https://issues.apache.org/jira/browse/PIG-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2532:
-
Status: Patch Available (was: In Progress)
> Registered classes fail deserialization
[
https://issues.apache.org/jira/browse/PIG-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2533:
-
Status: Patch Available (was: In Progress)
> Pig MR job exceptions masked on front
[
https://issues.apache.org/jira/browse/PIG-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on PIG-2532 started by Travis Crawford.
> Registered classes fail deserialization in front
[
https://issues.apache.org/jira/browse/PIG-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford updated PIG-2533:
-
Attachment: PIG-2533.patch
> Pig MR job exceptions masked on front
[
https://issues.apache.org/jira/browse/PIG-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on PIG-2533 started by Travis Crawford.
> Pig MR job exceptions masked on frontend
>
>
> K
Pig MR job exceptions masked on frontend
Key: PIG-2533
URL: https://issues.apache.org/jira/browse/PIG-2533
Project: Pig
Issue Type: Bug
Reporter: Travis Crawford
Assignee
Registered classes fail deserialization in frontend
---
Key: PIG-2532
URL: https://issues.apache.org/jira/browse/PIG-2532
Project: Pig
Issue Type: Bug
Reporter: Travis Crawford
[
https://issues.apache.org/jira/browse/PIG-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13023340#comment-13023340
]
Travis Crawford commented on PIG-2010:
--
Given how widespread the distributedc
65 matches
Mail list logo
