[jira] [Updated] (AVRO-1402) Support for DECIMAL primitive type
[ https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated AVRO-1402: Attachment: UnixEpochRecordMapping.patch Here's a patch (not for commit) of what a Unix Epoch mapping might look like as discussed in AVRO-739. Support for DECIMAL primitive type -- Key: AVRO-1402 URL: https://issues.apache.org/jira/browse/AVRO-1402 Project: Avro Issue Type: New Feature Affects Versions: 1.7.5 Reporter: Mariano Dominguez Priority: Minor Labels: Hive Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, UnixEpochRecordMapping.patch Currently, Avro does not seem to support a DECIMAL type or equivalent. http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive Adding DECIMAL support would be particularly interesting when converting types from Avro to Hive, since DECIMAL is already a supported data type in Hive (0.11.0). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (AVRO-1402) Support for DECIMAL primitive type
[ https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959853#comment-13959853 ] ASF subversion and git services commented on AVRO-1402: --- Commit 1584605 from tomwh...@apache.org in branch 'avro/trunk' [ https://svn.apache.org/r1584605 ] AVRO-1402. Support for DECIMAL type (as a record mapping). Support for DECIMAL primitive type -- Key: AVRO-1402 URL: https://issues.apache.org/jira/browse/AVRO-1402 Project: Avro Issue Type: New Feature Affects Versions: 1.7.5 Reporter: Mariano Dominguez Priority: Minor Labels: Hive Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, UnixEpochRecordMapping.patch Currently, Avro does not seem to support a DECIMAL type or equivalent. http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive Adding DECIMAL support would be particularly interesting when converting types from Avro to Hive, since DECIMAL is already a supported data type in Hive (0.11.0). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (AVRO-1402) Support for DECIMALtype
[ https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated AVRO-1402: Fix Version/s: 1.7.7 Assignee: Tom White Summary: Support for DECIMALtype (was: Support for DECIMAL primitive type) Support for DECIMALtype --- Key: AVRO-1402 URL: https://issues.apache.org/jira/browse/AVRO-1402 Project: Avro Issue Type: New Feature Affects Versions: 1.7.5 Reporter: Mariano Dominguez Assignee: Tom White Priority: Minor Labels: Hive Fix For: 1.7.7 Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, UnixEpochRecordMapping.patch Currently, Avro does not seem to support a DECIMAL type or equivalent. http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive Adding DECIMAL support would be particularly interesting when converting types from Avro to Hive, since DECIMAL is already a supported data type in Hive (0.11.0). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (AVRO-1402) Support for DECIMAL type
[ https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated AVRO-1402: Summary: Support for DECIMAL type (was: Support for DECIMALtype) Support for DECIMAL type Key: AVRO-1402 URL: https://issues.apache.org/jira/browse/AVRO-1402 Project: Avro Issue Type: New Feature Affects Versions: 1.7.5 Reporter: Mariano Dominguez Assignee: Tom White Priority: Minor Labels: Hive Fix For: 1.7.7 Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, UnixEpochRecordMapping.patch Currently, Avro does not seem to support a DECIMAL type or equivalent. http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive Adding DECIMAL support would be particularly interesting when converting types from Avro to Hive, since DECIMAL is already a supported data type in Hive (0.11.0). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (AVRO-1402) Support for DECIMAL type
[ https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White resolved AVRO-1402. - Resolution: Fixed Hadoop Flags: Reviewed I just committed this. Thanks for all the feedback and reviews. Support for DECIMAL type Key: AVRO-1402 URL: https://issues.apache.org/jira/browse/AVRO-1402 Project: Avro Issue Type: New Feature Affects Versions: 1.7.5 Reporter: Mariano Dominguez Assignee: Tom White Priority: Minor Labels: Hive Fix For: 1.7.7 Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, UnixEpochRecordMapping.patch Currently, Avro does not seem to support a DECIMAL type or equivalent. http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive Adding DECIMAL support would be particularly interesting when converting types from Avro to Hive, since DECIMAL is already a supported data type in Hive (0.11.0). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (AVRO-1402) Support for DECIMAL type
[ https://issues.apache.org/jira/browse/AVRO-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959889#comment-13959889 ] Hudson commented on AVRO-1402: -- SUCCESS: Integrated in AvroJava #448 (See [https://builds.apache.org/job/AvroJava/448/]) AVRO-1402. Support for DECIMAL type (as a record mapping). (tomwhite: rev 1584605) * /avro/trunk/CHANGES.txt * /avro/trunk/doc/src/content/xdocs/spec.xml * /avro/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/DecimalRecordMapping.java * /avro/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericData.java * /avro/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericDatumReader.java * /avro/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/GenericDatumWriter.java * /avro/trunk/lang/java/avro/src/main/java/org/apache/avro/generic/RecordMapping.java * /avro/trunk/lang/java/ipc/src/test/java/org/apache/avro/TestSchema.java Support for DECIMAL type Key: AVRO-1402 URL: https://issues.apache.org/jira/browse/AVRO-1402 Project: Avro Issue Type: New Feature Affects Versions: 1.7.5 Reporter: Mariano Dominguez Assignee: Tom White Priority: Minor Labels: Hive Fix For: 1.7.7 Attachments: AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, AVRO-1402.patch, UnixEpochRecordMapping.patch Currently, Avro does not seem to support a DECIMAL type or equivalent. http://avro.apache.org/docs/1.7.5/spec.html#schema_primitive Adding DECIMAL support would be particularly interesting when converting types from Avro to Hive, since DECIMAL is already a supported data type in Hive (0.11.0). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (AVRO-1492) Upgrade snappy-java to 1.1.0 (or later)
Gabriel Reid created AVRO-1492: -- Summary: Upgrade snappy-java to 1.1.0 (or later) Key: AVRO-1492 URL: https://issues.apache.org/jira/browse/AVRO-1492 Project: Avro Issue Type: Improvement Reporter: Gabriel Reid Priority: Minor The version of snappy-java that is currently used in Avro (1.0.5) uses a method of loading native code that can cause issues in certain cases. A specific example of this is making use of Avro with snappy to write files from a Groovy script. Another example of the same situation can be seen [here on StackOverflow|http://stackoverflow.com/questions/16036179/snappy-java-exception-after-elastic-search-upgrade]. As of [version 1.1.0-m4|https://github.com/xerial/snappy-java/blob/develop/Milestone.md#snappy-java-110-m4-20-august-2013], snappy-java makes use of a new method of loading native code which no longer presents the issue when using snappy from Groovy. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (AVRO-1492) Upgrade snappy-java to 1.1.0 (or later)
[ https://issues.apache.org/jira/browse/AVRO-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabriel Reid updated AVRO-1492: --- Status: Patch Available (was: Open) Upgrade snappy-java to 1.1.0 (or later) --- Key: AVRO-1492 URL: https://issues.apache.org/jira/browse/AVRO-1492 Project: Avro Issue Type: Improvement Reporter: Gabriel Reid Priority: Minor Attachments: AVRO-1492.patch The version of snappy-java that is currently used in Avro (1.0.5) uses a method of loading native code that can cause issues in certain cases. A specific example of this is making use of Avro with snappy to write files from a Groovy script. Another example of the same situation can be seen [here on StackOverflow|http://stackoverflow.com/questions/16036179/snappy-java-exception-after-elastic-search-upgrade]. As of [version 1.1.0-m4|https://github.com/xerial/snappy-java/blob/develop/Milestone.md#snappy-java-110-m4-20-august-2013], snappy-java makes use of a new method of loading native code which no longer presents the issue when using snappy from Groovy. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (AVRO-1492) Upgrade snappy-java to 1.1.0 (or later)
[ https://issues.apache.org/jira/browse/AVRO-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabriel Reid updated AVRO-1492: --- Attachment: AVRO-1492.patch Here's the trivial patch to bump the version. I've successfully tested this by running the full automated test suite on both Mac OS 10 and Ubuntu 12.04, both with JDK 1.7. Upgrade snappy-java to 1.1.0 (or later) --- Key: AVRO-1492 URL: https://issues.apache.org/jira/browse/AVRO-1492 Project: Avro Issue Type: Improvement Reporter: Gabriel Reid Priority: Minor Attachments: AVRO-1492.patch The version of snappy-java that is currently used in Avro (1.0.5) uses a method of loading native code that can cause issues in certain cases. A specific example of this is making use of Avro with snappy to write files from a Groovy script. Another example of the same situation can be seen [here on StackOverflow|http://stackoverflow.com/questions/16036179/snappy-java-exception-after-elastic-search-upgrade]. As of [version 1.1.0-m4|https://github.com/xerial/snappy-java/blob/develop/Milestone.md#snappy-java-110-m4-20-august-2013], snappy-java makes use of a new method of loading native code which no longer presents the issue when using snappy from Groovy. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (AVRO-1315) Java: Schema Validation utilities
[ https://issues.apache.org/jira/browse/AVRO-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13960481#comment-13960481 ] Felix GV commented on AVRO-1315: Bump. Are there any updates on this? [~scott_carey], are you guys using this code in production to validate new schemas? Anyone else has any comments, blessings, warnings or outstanding patch for this ;) ? Java: Schema Validation utilities - Key: AVRO-1315 URL: https://issues.apache.org/jira/browse/AVRO-1315 Project: Avro Issue Type: New Feature Components: java Reporter: Scott Carey Assignee: Scott Carey Fix For: 1.8.0 Attachments: AVRO-1315.patch As part of AVRO-1124 we needed Schema Validation utilities. I have separated those out of that ticket as a stand-alone item. -- This message was sent by Atlassian JIRA (v6.2#6252)
