[jira] Subscription: PIG patch available
Issue Subscription Filter: PIG patch available (10 issues) Subscriber: pigdaily Key Summary PIG-3613UDF for SimilarityMatching between strings with matching scores https://issues.apache.org/jira/browse/PIG-3613 PIG-3609ClassCastException when calling compareTo method on AvroBagWrapper https://issues.apache.org/jira/browse/PIG-3609 PIG-3608ClassCastException when looking up a value from AvroMapWrapper using a Utf8 key https://issues.apache.org/jira/browse/PIG-3608 PIG-3592Should not try to create success file for non-fs schemes like hbase https://issues.apache.org/jira/browse/PIG-3592 PIG-3587add functionality for rolling over dates https://issues.apache.org/jira/browse/PIG-3587 PIG-3573Provide StoreFunc and LoadFunc for Accumulo https://issues.apache.org/jira/browse/PIG-3573 PIG-3572Fix all unit test for during build pig with Hadoop 2.X on Windows. https://issues.apache.org/jira/browse/PIG-3572 PIG-3453Implement a Storm backend to Pig https://issues.apache.org/jira/browse/PIG-3453 PIG-3441Allow Pig to use default resources from Configuration objects https://issues.apache.org/jira/browse/PIG-3441 PIG-3347Store invocation brings side effect https://issues.apache.org/jira/browse/PIG-3347 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=13225&filterId=12322384
[jira] [Commented] (PIG-3608) ClassCastException when looking up a value from AvroMapWrapper using a Utf8 key
[
https://issues.apache.org/jira/browse/PIG-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13841884#comment-13841884
]
Rohini Palaniswamy commented on PIG-3608:
-
- Can we change "if (isUtf8key && !(key instanceof Utf8))" to "if (isUtf8key
&& (key instanceof String))". Previous code was assuming it was always a String
key. This would be a better check.
- Also can we have a pig script as test case instead of just testing the
method. Because I still don't get in which case the key is being Utf8 when pig
tries to access the map. Having that test might cover other code paths as well.
Or are you hitting this error when calling the class standalone outside of pig?
> ClassCastException when looking up a value from AvroMapWrapper using a Utf8
> key
> ---
>
> Key: PIG-3608
> URL: https://issues.apache.org/jira/browse/PIG-3608
> Project: Pig
> Issue Type: Bug
> Components: impl
>Affects Versions: 0.12.0
>Reporter: Richard Ding
>Assignee: Richard Ding
>Priority: Minor
> Attachments: PIG-3608.patch, PIG-3608_2.patch
>
>
> One got the following exception:
> {code}
> java.lang.ClassCastException: org.apache.avro.util.Utf8 incompatible with
> java.lang.String
> at
> org.apache.pig.impl.util.avro.AvroMapWrapper.get(AvroMapWrapper.java:80)
> {code}
> This is related to the change by PIG-3420.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (PIG-3609) ClassCastException when calling compareTo method on AvroBagWrapper
[
https://issues.apache.org/jira/browse/PIG-3609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Ding updated PIG-3609:
--
Attachment: PIG-3609_2.patch
New patch with a test case.
> ClassCastException when calling compareTo method on AvroBagWrapper
> ---
>
> Key: PIG-3609
> URL: https://issues.apache.org/jira/browse/PIG-3609
> Project: Pig
> Issue Type: Bug
> Components: impl
>Affects Versions: 0.12.0
>Reporter: Richard Ding
>Assignee: Richard Ding
>Priority: Minor
> Attachments: PIG-3609.patch, PIG-3609_2.patch
>
>
> One got the following exception when calling compareTo method on
> AvroBagWrapper with an AvroBagWrapper object:
> {code}
> java.lang.ClassCastException: org.apache.pig.impl.util.avro.AvroBagWrapper
> incompatible with java.util.Collection
> at org.apache.avro.generic.GenericData.compare(GenericData.java:786)
> at org.apache.avro.generic.GenericData.compare(GenericData.java:760)
> at
> org.apache.pig.impl.util.avro.AvroBagWrapper.compareTo(AvroBagWrapper.java:78)
> {code}
> Looking at the code, it compares objects with different types:
> {code}
> return GenericData.get().compare(theArray, o, theArray.getSchema());
> {code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (PIG-3608) ClassCastException when looking up a value from AvroMapWrapper using a Utf8 key
[
https://issues.apache.org/jira/browse/PIG-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Ding updated PIG-3608:
--
Attachment: PIG-3608_2.patch
You are right. Update the patch with a test case.
> ClassCastException when looking up a value from AvroMapWrapper using a Utf8
> key
> ---
>
> Key: PIG-3608
> URL: https://issues.apache.org/jira/browse/PIG-3608
> Project: Pig
> Issue Type: Bug
> Components: impl
>Affects Versions: 0.12.0
>Reporter: Richard Ding
>Assignee: Richard Ding
>Priority: Minor
> Attachments: PIG-3608.patch, PIG-3608_2.patch
>
>
> One got the following exception:
> {code}
> java.lang.ClassCastException: org.apache.avro.util.Utf8 incompatible with
> java.lang.String
> at
> org.apache.pig.impl.util.avro.AvroMapWrapper.get(AvroMapWrapper.java:80)
> {code}
> This is related to the change by PIG-3420.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (PIG-2778) Add 'matches' operator to predicate pushdown
[ https://issues.apache.org/jira/browse/PIG-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13841498#comment-13841498 ] Rohini Palaniswamy commented on PIG-2778: - [~daijy], We are not using 0.12 yet. But saw that http://svn.apache.org/viewvc/hive/trunk/hcatalog/hcatalog-pig-adapter/src/main/java/org/apache/hcatalog/pig/HCatLoader.java?view=markup getHCatComparisonString() does not convert matches to LIKE. Wouldn't that cause issues? Have you encountered it? According to https://issues.apache.org/jira/browse/HIVE-1609 - LIKE is supported. So HCatLoader will have to change to support that or if there is a matches condition on a partition column I am suspecting there will be a exception looking at the InitializeInput code in hcat. Will try it out next week and confirm. > Add 'matches' operator to predicate pushdown > > > Key: PIG-2778 > URL: https://issues.apache.org/jira/browse/PIG-2778 > Project: Pig > Issue Type: Bug >Reporter: Dmitriy V. Ryaboy >Assignee: Cheolsoo Park > Fix For: 0.12.0 > > Attachments: PIG-2778.patch, test_e2e.log, test_unit.log > > > Currently the regex match operation does not get pushed down to LoadMetadata > (and Expression does not have an enum value for it); it would be quite useful > to enable this for some optimizations. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (PIG-3613) UDF for SimilarityMatching between strings with matching scores
[ https://issues.apache.org/jira/browse/PIG-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated PIG-3613: - Attachment: PIG-3613.0.patch > UDF for SimilarityMatching between strings with matching scores > --- > > Key: PIG-3613 > URL: https://issues.apache.org/jira/browse/PIG-3613 > Project: Pig > Issue Type: Task > Components: piggybank >Affects Versions: 0.10.1 >Reporter: Rekha Joshi >Assignee: Rekha Joshi > Labels: piggybank > Fix For: 0.10.1 > > Attachments: PIG-3613.0.patch > > > It would be great if we can do similarity matching between strings on big > data using pig udf. > Proposed udf works on tuple of strings and gives a matching score. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (PIG-3613) UDF for SimilarityMatching between strings with matching scores
[ https://issues.apache.org/jira/browse/PIG-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated PIG-3613: - Tags: udf Fix Version/s: 0.10.1 Labels: piggybank (was: ) Release Note: UDF for SimilarityMatching for string and returns the matching score. Status: Patch Available (was: In Progress) Attached patch. > UDF for SimilarityMatching between strings with matching scores > --- > > Key: PIG-3613 > URL: https://issues.apache.org/jira/browse/PIG-3613 > Project: Pig > Issue Type: Task > Components: piggybank >Affects Versions: 0.10.1 >Reporter: Rekha Joshi >Assignee: Rekha Joshi > Labels: piggybank > Fix For: 0.10.1 > > > It would be great if we can do similarity matching between strings on big > data using pig udf. > Proposed udf works on tuple of strings and gives a matching score. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Work started] (PIG-3613) UDF for SimilarityMatching between strings with matching scores
[ https://issues.apache.org/jira/browse/PIG-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on PIG-3613 started by Rekha Joshi. > UDF for SimilarityMatching between strings with matching scores > --- > > Key: PIG-3613 > URL: https://issues.apache.org/jira/browse/PIG-3613 > Project: Pig > Issue Type: Task > Components: piggybank >Affects Versions: 0.10.1 >Reporter: Rekha Joshi >Assignee: Rekha Joshi > > It would be great if we can do similarity matching between strings on big > data using pig udf. > Proposed udf works on tuple of strings and gives a matching score. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (PIG-3613) UDF for SimilarityMatching between strings with matching scores
Rekha Joshi created PIG-3613: Summary: UDF for SimilarityMatching between strings with matching scores Key: PIG-3613 URL: https://issues.apache.org/jira/browse/PIG-3613 Project: Pig Issue Type: Task Components: piggybank Affects Versions: 0.10.1 Reporter: Rekha Joshi Assignee: Rekha Joshi It would be great if we can do similarity matching between strings on big data using pig udf. Proposed udf works on tuple of strings and gives a matching score. -- This message was sent by Atlassian JIRA (v6.1#6144)
