[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich reassigned PIG-832:
--
Assignee: Daniel Dai (was: Olga Natkovich)
> Make import list configurable
>
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721353#action_12721353
]
Olga Natkovich commented on PIG-832:
As part of this fix we should also expand the default
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721361#action_12721361
]
Milind Bhandarkar commented on PIG-832:
---
If we include the piggybank functions in the de
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721371#action_12721371
]
Daniel Dai commented on PIG-832:
How about this syntax:
Add a new java property: udf.import.li
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721373#action_12721373
]
Olga Natkovich commented on PIG-832:
In response to Milind. I don't think we are committin
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721375#action_12721375
]
Olga Natkovich commented on PIG-832:
Daniel, your proposal looks good
> Make import list
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721379#action_12721379
]
Milind Bhandarkar commented on PIG-832:
---
Can we have:
{code}
java -Dimport.list += com.
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721387#action_12721387
]
Olga Natkovich commented on PIG-832:
Milind, Not quite sure what you are saying. We curren
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721396#action_12721396
]
Milind Bhandarkar commented on PIG-832:
---
Olga, what I am saying is to have a default imp
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721407#action_12721407
]
Daniel Dai commented on PIG-832:
My thinking is that most users will use build-in UDFs. So it
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721413#action_12721413
]
Milind Bhandarkar commented on PIG-832:
---
Instead of a list, if you make it a map (i.e. s
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721414#action_12721414
]
Olga Natkovich commented on PIG-832:
Milind,
Couple of comments and clarifications:
(1)
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721423#action_12721423
]
Olga Natkovich commented on PIG-832:
Also think you are suggesting UDF aliasing on command
Hi,
I created a candidate build for Pig 0.3.0 release. The main feature of
this release is support for multiquery which allows to share computation
across multiple queries within the same script. We see significant
performance improvements (up to order of magnitude) as the result of
this optimiza
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721428#action_12721428
]
Milind Bhandarkar commented on PIG-832:
---
Hardwiring names that are not reserved words is
Pig should implement Tool interface from Hadoop
---
Key: PIG-857
URL: https://issues.apache.org/jira/browse/PIG-857
Project: Pig
Issue Type: Improvement
Components: impl
Affects Versi
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721456#action_12721456
]
Daniel Dai commented on PIG-832:
Hi, Milind, in the use case you mentioned, he/she can write h
[
https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Gates updated PIG-734:
---
Status: Open (was: Patch Available)
> Non-string keys in maps
> ---
>
> Key
[
https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Gates updated PIG-734:
---
Attachment: PIG-734_2.patch
New version of the patch, brought up to date with current trunk.
> Non-string keys
[
https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Gates updated PIG-734:
---
Status: Patch Available (was: Open)
> Non-string keys in maps
> ---
>
> Key
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721481#action_12721481
]
Olga Natkovich commented on PIG-832:
Milind, we have parameter substitution for what you a
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721490#action_12721490
]
Milind Bhandarkar commented on PIG-832:
---
Daniel: For that to work, user's class will hav
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721503#action_12721503
]
Daniel Dai commented on PIG-832:
Hi, Milind,
For your first comment, yes, user's class have to
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721506#action_12721506
]
Olga Natkovich commented on PIG-832:
Milind,
Issue is not the complexity of implementatio
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721514#action_12721514
]
Milind Bhandarkar commented on PIG-832:
---
Olga, specifying a list of packages as a path l
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721519#action_12721519
]
Daniel Dai commented on PIG-832:
Hi, Milind,
If a user wrote 10 UDFs, I guess he/she does not
[
https://issues.apache.org/jira/browse/PIG-849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-849:
---
Affects Version/s: 0.2.0
Fix Version/s: 0.3.0
> Local engine loses records in splits
> -
[
https://issues.apache.org/jira/browse/PIG-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-852:
---
Fix Version/s: 0.3.0
> pig -version or pig -help returns exit code of 1
> --
[
https://issues.apache.org/jira/browse/PIG-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-819:
---
Fix Version/s: 0.3.0
> run -param -param; is a valid grunt command
> ---
[
https://issues.apache.org/jira/browse/PIG-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-818:
---
Fix Version/s: 0.3.0
> Explain doesn't handle PODemux properly
> ---
[
https://issues.apache.org/jira/browse/PIG-564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-564:
---
Fix Version/s: 0.3.0
> Parameter Substitution using -param option does not seem to work when
> paramete
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721523#action_12721523
]
Milind Bhandarkar commented on PIG-832:
---
Daniel,
Hi, Milind, If a user wrote 10 UDF
[
https://issues.apache.org/jira/browse/PIG-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-627:
---
Fix Version/s: 0.3.0
> PERFORMANCE: multi-query optimization
> -
>
>
[
https://issues.apache.org/jira/browse/PIG-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-850:
---
Fix Version/s: (was: 0.3.0)
0.4.0
> Dump produce wrong result while "store into"
[
https://issues.apache.org/jira/browse/PIG-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-852:
---
Fix Version/s: (was: 0.3.0)
0.4.0
> pig -version or pig -help returns exit code o
[
https://issues.apache.org/jira/browse/PIG-849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-849:
---
Fix Version/s: (was: 0.3.0)
0.4.0
> Local engine loses records in splits
> --
See http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/92/
--
[...truncated 93989 lines...]
[exec] [junit] 09/06/18 22:16:02 INFO dfs.DataNode: PacketResponder 1
for block blk_-3610909769110207607_1010 terminating
[exec]
[
https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721527#action_12721527
]
Hadoop QA commented on PIG-734:
---
-1 overall. Here are the results of testing the latest attachm
[
https://issues.apache.org/jira/browse/PIG-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-781:
---
Fix Version/s: 0.3.0
> Error reporting for failed MR jobs
> --
>
>
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721528#action_12721528
]
Daniel Dai commented on PIG-832:
yes, `cat myudflist` is a way to get around. However, in my h
[
https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Gates updated PIG-734:
---
Status: Open (was: Patch Available)
> Non-string keys in maps
> ---
>
> Key
[
https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Gates updated PIG-734:
---
Fix Version/s: (was: 0.3.0)
0.4.0
Status: Patch Available (was: Open)
> Non-s
[
https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Gates updated PIG-734:
---
Attachment: PIG-734_3.patch
Attaching a version of the file that fixes some of the introduced compiler
warnings
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721550#action_12721550
]
Milind Bhandarkar commented on PIG-832:
---
Daniel,
Pig streaming already uses backquotes
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721551#action_12721551
]
Olga Natkovich commented on PIG-832:
You use a fully qualified name for the other one.
I
[
https://issues.apache.org/jira/browse/PIG-753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721559#action_12721559
]
Alan Gates commented on PIG-753:
+1
I tested the patch, and the issue was just with the bzip
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721558#action_12721558
]
Olga Natkovich commented on PIG-856:
The number of replicas can be set via dfs.replication
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721562#action_12721562
]
Milind Bhandarkar commented on PIG-832:
---
Olga,
As long the suggested improvements do no
[
https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721563#action_12721563
]
Olga Natkovich commented on PIG-832:
I don't believe this prevents future improvements
>
[
https://issues.apache.org/jira/browse/PIG-753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721564#action_12721564
]
Santhosh Srinivasan commented on PIG-753:
-
+1 for the code changes. The license header
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721565#action_12721565
]
Milind Bhandarkar commented on PIG-856:
---
Olga,
setting dfs.replication for the whole pi
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721570#action_12721570
]
Olga Natkovich commented on PIG-856:
Hi Milind, yes, these are very good points.
I was h
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721574#action_12721574
]
Milind Bhandarkar commented on PIG-856:
---
+1 on seeing performance differences. But, is t
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721577#action_12721577
]
Olga Natkovich commented on PIG-856:
If a job fails, the store connected to this job will
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721581#action_12721581
]
Milind Bhandarkar commented on PIG-856:
---
+1. I will file a separate Jira (if replication
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721590#action_12721590
]
Alan Gates commented on PIG-856:
My $0.02, based on the assumption that we see a significant p
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721593#action_12721593
]
Olga Natkovich commented on PIG-856:
Yes, I agree - we should let users choose, I was thin
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721592#action_12721592
]
Santhosh Srinivasan commented on PIG-856:
-
Would that be through a configuration param
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721594#action_12721594
]
Milind Bhandarkar commented on PIG-856:
---
+1 to both Alan and Olga. Default should still
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721596#action_12721596
]
Santhosh Srinivasan commented on PIG-856:
-
Essentially, are we adding more knobs to tu
See http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/93/
--
[...truncated 94294 lines...]
[exec] [junit] 09/06/19 01:06:15 INFO dfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49808 is added to
[
https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721598#action_12721598
]
Hadoop QA commented on PIG-734:
---
-1 overall. Here are the results of testing the latest attachm
[
https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721599#action_12721599
]
Milind Bhandarkar commented on PIG-856:
---
+1 to Sathosh to documenting Knobs. Better to a
[
https://issues.apache.org/jira/browse/PIG-753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Gates resolved PIG-753.
Resolution: Fixed
Fix Version/s: 0.4.0
I added headers to the two test files. I reran the unit tests a
64 matches
Mail list logo
