So far this is not easy.
On Mon, Apr 9, 2012 at 5:42 PM, Russell Jurney russell.jur...@gmail.comwrote:
I see Jackson being used in the Mozilla stuff. It looks pretty
straightforward.
On Mon, Apr 9, 2012 at 5:38 PM, Dmitriy Ryaboy dvrya...@gmail.com wrote:
Jackson is your friend.
On
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250473#comment-13250473
]
Dmitriy V. Ryaboy commented on PIG-2632:
you know guys,
at this point, I am starting
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250477#comment-13250477
]
Dmitriy V. Ryaboy commented on PIG-2632:
Before Jon kills me: one reason we aren't
[
https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Coveney updated PIG-2643:
--
Attachment: PIG-2643-0.patch
Oh, I also should add tests. Can leverage the tests Dmitriy used
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250479#comment-13250479
]
Jonathan Coveney commented on PIG-2632:
---
Haha, I won't kill anyone if we find a better
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250481#comment-13250481
]
Jonathan Coveney commented on PIG-2632:
---
One last note: implementing getfield(String)
Is there a way to get the field names in an EvalFunc? I am close to done
but... no cigar :) I need these to finish.
On Mon, Apr 9, 2012 at 11:03 PM, Russell Jurney russell.jur...@gmail.comwrote:
So far this is not easy.
On Mon, Apr 9, 2012 at 5:42 PM, Russell Jurney
[
https://issues.apache.org/jira/browse/PIG-2596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Mokashi updated PIG-2596:
Status: Patch Available (was: Open)
Jython UDF does not handle boolean output
Followup question: would it be nice if JsonLoader inferred schemas when
none is present, according to some defaults?
On Tue, Apr 10, 2012 at 12:48 AM, Russell Jurney
russell.jur...@gmail.comwrote:
Is there a way to get the field names in an EvalFunc? I am close to done
but... no cigar :) I
Whoops, sorry to post to user. Scott Carey explains how to fix my
ARRAY_ELEM problem.
-- Forwarded message --
From: Scott Carey scottca...@apache.org
Date: Mon, Apr 2, 2012 at 9:13 AM
Subject: Re: AvroStorage/Avro Schema Question
To: u...@avro.apache.org
It appears as though
[
https://issues.apache.org/jira/browse/PIG-2627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Mokashi updated PIG-2627:
Attachment: PIG-2627.patch
Custom partitioner not set when POSplit is involved in Plan
[
https://issues.apache.org/jira/browse/PIG-2627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Mokashi updated PIG-2627:
Status: Patch Available (was: Open)
Custom partitioner not set when POSplit is involved in
[
https://issues.apache.org/jira/browse/PIG-2603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250542#comment-13250542
]
Aniket Mokashi commented on PIG-2603:
-
how about pig.additional.jars?
Piggybank's HadoopJobHistoryLoader throws NPE when reading broken history file
--
Key: PIG-2644
URL: https://issues.apache.org/jira/browse/PIG-2644
Project: Pig
[
https://issues.apache.org/jira/browse/PIG-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mathias Herberts updated PIG-2644:
--
Attachment: PIG-2644.patch
The following patch adds nullity tests prior to accessing a value
[
https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250703#comment-13250703
]
Dmitriy V. Ryaboy commented on PIG-2643:
Jon, the problem with non-static methods
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250706#comment-13250706
]
Dmitriy V. Ryaboy commented on PIG-2632:
that's a good point, actually. What would
first question: you can do this when outputSchema() is called, as it's
passed the input schema. IIRC, in trunk you have hooks to pass that
info to the backend in a udf.
second question: see discussion on JsonLoader jira.. short answer:
non-trivial, no clear decision on what the most sensible
I forgot about UDFContext providing the schema, and the pig docs are
out of date. Is no problem now.
About default behavior for json, that would seem to be: tuples -
objects, bags - arrays, integers - long, decimals - double, and
configs for setting low precision to substitute int/float. Maps are
[
https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250720#comment-13250720
]
Jonathan Coveney commented on PIG-2643:
---
I'm not quite sure what you mean...could you
[
https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250745#comment-13250745
]
Jonathan Coveney commented on PIG-2643:
---
I am thinking about this and what I _think_
[
https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250804#comment-13250804
]
Dmitriy V. Ryaboy commented on PIG-2643:
Not quite -- what I mean is that people
Russ,
I appreciate the passion, but let's drop fiery rhetoric in favor of
technical discussion, yeah? :-)
No one is against accessibility. The problem with making things simple
is that it's really hard to make them simple. Without appropriate
amount of forethought, you paint yourself into ugly
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250831#comment-13250831
]
Scott Carey commented on PIG-2632:
--
{quote}
should a:int,b:int really generate a different
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250837#comment-13250837
]
Jonathan Coveney commented on PIG-2632:
---
I agree 100% that it's time to iron out
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250845#comment-13250845
]
Dmitriy V. Ryaboy commented on PIG-2632:
remember to attribute the code to mahout
[
https://issues.apache.org/jira/browse/PIG-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250852#comment-13250852
]
Jonathan Eagles commented on PIG-2642:
--
Thomas, I have tested the patch and it is
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250853#comment-13250853
]
Jonathan Coveney commented on PIG-2632:
---
Ah, gotcha.
As far as the NOTICE.txt, I
[
https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250854#comment-13250854
]
Jonathan Coveney commented on PIG-2643:
---
Ah, ok. Well, first, since we have a more
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250857#comment-13250857
]
Julien Le Dem commented on PIG-2632:
By design Avro defines the binary format and the
[
https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250987#comment-13250987
]
Dmitriy V. Ryaboy commented on PIG-2643:
I'm a bit confused about the math keyword
[
https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250999#comment-13250999
]
Scott Carey commented on PIG-2632:
--
Avro has a pure Java code generator that uses the
[
https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13251336#comment-13251336
]
Jonathan Coveney commented on PIG-2643:
---
I don't know that I like including all of the
[
https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13251343#comment-13251343
]
Jonathan Coveney commented on PIG-2643:
---
Also, as an aside, I think it'd be awesome to
34 matches
Mail list logo