[jira] [Commented] (AVRO-1315) Java: Schema Validation utilities

2014-04-04 Thread Felix GV (JIRA)

[ 
https://issues.apache.org/jira/browse/AVRO-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13960481#comment-13960481
 ] 

Felix GV commented on AVRO-1315:


Bump. Are there any updates on this?

[~scott_carey], are you guys using this code in production to validate new 
schemas?

Anyone else has any comments, blessings, warnings or outstanding patch for this 
;) ?

> Java: Schema Validation utilities
> -
>
> Key: AVRO-1315
> URL: https://issues.apache.org/jira/browse/AVRO-1315
> Project: Avro
>  Issue Type: New Feature
>  Components: java
>Reporter: Scott Carey
>Assignee: Scott Carey
> Fix For: 1.8.0
>
> Attachments: AVRO-1315.patch
>
>
> As part of AVRO-1124 we needed Schema Validation utilities.  I have separated 
> those out of that ticket as a stand-alone item.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (AVRO-1492) Upgrade snappy-java to 1.1.0 (or later)

2014-04-04 Thread Gabriel Reid (JIRA)

 [ 
https://issues.apache.org/jira/browse/AVRO-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gabriel Reid updated AVRO-1492:
---

Attachment: AVRO-1492.patch

Here's the trivial patch to bump the version.

I've successfully tested this by running the full automated test suite on both 
Mac OS 10 and Ubuntu 12.04, both with JDK 1.7.

> Upgrade snappy-java to 1.1.0 (or later)
> ---
>
> Key: AVRO-1492
> URL: https://issues.apache.org/jira/browse/AVRO-1492
> Project: Avro
>  Issue Type: Improvement
>Reporter: Gabriel Reid
>Priority: Minor
> Attachments: AVRO-1492.patch
>
>
> The version of snappy-java that is currently used in Avro (1.0.5) uses a 
> method of loading native code that can cause issues in certain cases. A 
> specific example of this is making use of Avro with snappy to write files 
> from a Groovy script. Another example of the same situation can be seen [here 
> on 
> StackOverflow|http://stackoverflow.com/questions/16036179/snappy-java-exception-after-elastic-search-upgrade].
> As of [version 
> 1.1.0-m4|https://github.com/xerial/snappy-java/blob/develop/Milestone.md#snappy-java-110-m4-20-august-2013],
>  snappy-java makes use of a new method of loading native code which no longer 
> presents the issue when using snappy from Groovy.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (AVRO-1492) Upgrade snappy-java to 1.1.0 (or later)

2014-04-04 Thread Gabriel Reid (JIRA)

 [ 
https://issues.apache.org/jira/browse/AVRO-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gabriel Reid updated AVRO-1492:
---

Status: Patch Available  (was: Open)

> Upgrade snappy-java to 1.1.0 (or later)
> ---
>
> Key: AVRO-1492
> URL: https://issues.apache.org/jira/browse/AVRO-1492
> Project: Avro
>  Issue Type: Improvement
>Reporter: Gabriel Reid
>Priority: Minor
> Attachments: AVRO-1492.patch
>
>
> The version of snappy-java that is currently used in Avro (1.0.5) uses a 
> method of loading native code that can cause issues in certain cases. A 
> specific example of this is making use of Avro with snappy to write files 
> from a Groovy script. Another example of the same situation can be seen [here 
> on 
> StackOverflow|http://stackoverflow.com/questions/16036179/snappy-java-exception-after-elastic-search-upgrade].
> As of [version 
> 1.1.0-m4|https://github.com/xerial/snappy-java/blob/develop/Milestone.md#snappy-java-110-m4-20-august-2013],
>  snappy-java makes use of a new method of loading native code which no longer 
> presents the issue when using snappy from Groovy.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Created] (AVRO-1492) Upgrade snappy-java to 1.1.0 (or later)

2014-04-04 Thread Gabriel Reid (JIRA)
Gabriel Reid created AVRO-1492:
--

 Summary: Upgrade snappy-java to 1.1.0 (or later)
 Key: AVRO-1492
 URL: https://issues.apache.org/jira/browse/AVRO-1492
 Project: Avro
  Issue Type: Improvement
Reporter: Gabriel Reid
Priority: Minor


The version of snappy-java that is currently used in Avro (1.0.5) uses a method 
of loading native code that can cause issues in certain cases. A specific 
example of this is making use of Avro with snappy to write files from a Groovy 
script. Another example of the same situation can be seen [here on 
StackOverflow|http://stackoverflow.com/questions/16036179/snappy-java-exception-after-elastic-search-upgrade].

As of [version 
1.1.0-m4|https://github.com/xerial/snappy-java/blob/develop/Milestone.md#snappy-java-110-m4-20-august-2013],
 snappy-java makes use of a new method of loading native code which no longer 
presents the issue when using snappy from Groovy.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (AVRO-1402) Support for DECIMAL type

2014-04-04 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13959889#comment-13959889
 ] 

Hudson commented on AVRO-1402:
--

SUCCESS: Integrated in AvroJava #448 (See 
[https://builds.apache.org/job/AvroJava/448/])
AVRO-1402. Support for DECIMAL type (as a record mapping). (tomwhite: rev 
1584605)
* /avro/trunk/CHANGES.txt
* /avro/trunk/doc/src/content/xdocs/spec.xml
* 
/avro/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/DecimalRecordMapping.java
* 
/avro/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java
* 
/avro/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericDatumReader.java
* 
/avro/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericDatumWriter.java
* 
/avro/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/RecordMapping.java
* /avro/trunk/lang/java/ipc/src/test/java/org/apache/avro/TestSchema.java


> Support for DECIMAL type
> 
>
> Key: AVRO-1402
> URL: https://issues.apache.org/jira/browse/AVRO-1402
> Project: Avro
>  Issue Type: New Feature
>Affects Versions: 1.7.5
>Reporter: Mariano Dominguez
>Assignee: Tom White
>Priority: Minor
>  Labels: Hive
> Fix For: 1.7.7
>
> Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, 
> AVRO-1402.patch, UnixEpochRecordMapping.patch
>
>
> Currently, Avro does not seem to support a DECIMAL type or equivalent.
> http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive
> Adding DECIMAL support would be particularly interesting when converting 
> types from Avro to Hive, since DECIMAL is already a supported data type in 
> Hive (0.11.0).



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Resolved] (AVRO-1402) Support for DECIMAL type

2014-04-04 Thread Tom White (JIRA)

 [ 
https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tom White resolved AVRO-1402.
-

  Resolution: Fixed
Hadoop Flags: Reviewed

I just committed this. Thanks for all the feedback and reviews.

> Support for DECIMAL type
> 
>
> Key: AVRO-1402
> URL: https://issues.apache.org/jira/browse/AVRO-1402
> Project: Avro
>  Issue Type: New Feature
>Affects Versions: 1.7.5
>Reporter: Mariano Dominguez
>Assignee: Tom White
>Priority: Minor
>  Labels: Hive
> Fix For: 1.7.7
>
> Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, 
> AVRO-1402.patch, UnixEpochRecordMapping.patch
>
>
> Currently, Avro does not seem to support a DECIMAL type or equivalent.
> http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive
> Adding DECIMAL support would be particularly interesting when converting 
> types from Avro to Hive, since DECIMAL is already a supported data type in 
> Hive (0.11.0).



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (AVRO-1402) Support for DECIMAL type

2014-04-04 Thread Tom White (JIRA)

 [ 
https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tom White updated AVRO-1402:


Summary: Support for DECIMAL type  (was: Support for DECIMALtype)

> Support for DECIMAL type
> 
>
> Key: AVRO-1402
> URL: https://issues.apache.org/jira/browse/AVRO-1402
> Project: Avro
>  Issue Type: New Feature
>Affects Versions: 1.7.5
>Reporter: Mariano Dominguez
>Assignee: Tom White
>Priority: Minor
>  Labels: Hive
> Fix For: 1.7.7
>
> Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, 
> AVRO-1402.patch, UnixEpochRecordMapping.patch
>
>
> Currently, Avro does not seem to support a DECIMAL type or equivalent.
> http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive
> Adding DECIMAL support would be particularly interesting when converting 
> types from Avro to Hive, since DECIMAL is already a supported data type in 
> Hive (0.11.0).



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (AVRO-1402) Support for DECIMALtype

2014-04-04 Thread Tom White (JIRA)

 [ 
https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tom White updated AVRO-1402:


Fix Version/s: 1.7.7
 Assignee: Tom White
  Summary: Support for DECIMALtype  (was: Support for DECIMAL primitive 
type)

> Support for DECIMALtype
> ---
>
> Key: AVRO-1402
> URL: https://issues.apache.org/jira/browse/AVRO-1402
> Project: Avro
>  Issue Type: New Feature
>Affects Versions: 1.7.5
>Reporter: Mariano Dominguez
>Assignee: Tom White
>Priority: Minor
>  Labels: Hive
> Fix For: 1.7.7
>
> Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, 
> AVRO-1402.patch, UnixEpochRecordMapping.patch
>
>
> Currently, Avro does not seem to support a DECIMAL type or equivalent.
> http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive
> Adding DECIMAL support would be particularly interesting when converting 
> types from Avro to Hive, since DECIMAL is already a supported data type in 
> Hive (0.11.0).



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (AVRO-1402) Support for DECIMAL primitive type

2014-04-04 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13959853#comment-13959853
 ] 

ASF subversion and git services commented on AVRO-1402:
---

Commit 1584605 from tomwh...@apache.org in branch 'avro/trunk'
[ https://svn.apache.org/r1584605 ]

AVRO-1402. Support for DECIMAL type (as a record mapping).

> Support for DECIMAL primitive type
> --
>
> Key: AVRO-1402
> URL: https://issues.apache.org/jira/browse/AVRO-1402
> Project: Avro
>  Issue Type: New Feature
>Affects Versions: 1.7.5
>Reporter: Mariano Dominguez
>Priority: Minor
>  Labels: Hive
> Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, 
> AVRO-1402.patch, UnixEpochRecordMapping.patch
>
>
> Currently, Avro does not seem to support a DECIMAL type or equivalent.
> http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive
> Adding DECIMAL support would be particularly interesting when converting 
> types from Avro to Hive, since DECIMAL is already a supported data type in 
> Hive (0.11.0).



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (AVRO-1402) Support for DECIMAL primitive type

2014-04-04 Thread Tom White (JIRA)

 [ 
https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tom White updated AVRO-1402:


Attachment: UnixEpochRecordMapping.patch

Here's a patch (not for commit) of what a Unix Epoch mapping might look like as 
discussed in AVRO-739.

> Support for DECIMAL primitive type
> --
>
> Key: AVRO-1402
> URL: https://issues.apache.org/jira/browse/AVRO-1402
> Project: Avro
>  Issue Type: New Feature
>Affects Versions: 1.7.5
>Reporter: Mariano Dominguez
>Priority: Minor
>  Labels: Hive
> Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, 
> AVRO-1402.patch, UnixEpochRecordMapping.patch
>
>
> Currently, Avro does not seem to support a DECIMAL type or equivalent.
> http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive
> Adding DECIMAL support would be particularly interesting when converting 
> types from Avro to Hive, since DECIMAL is already a supported data type in 
> Hive (0.11.0).



--
This message was sent by Atlassian JIRA
(v6.2#6252)