Re: Formal spec for Avro Schema

Hi everyone, A bit late, but I though I’d add a few thoughts on this as well. For one, I love the idea of improving our documentation. Separating the schema specification from the encoding makes perfect sense to me, and also allows us to clearly state which encoding to use. Currently, most

Re: Schema version in namespace? good practice

Hi, As far as best practices are concerned, I have never seen any that change the names and/or namespace of a schema. But that is also because of generating code from the Avro schema. What I usually see is adding an extra property to the root schema, named "version" or similar, combined with a

Schema version in namespace? good practice

Hi, I am new to avro and started working on it recently. I am in the process of designing a schema evolution process. We use java applications and make use of maven plugin to auto generate the classes from .avsc schema files. I am thinking of adding the version in the namespace during each

RE: Formal spec for Avro Schema

Hi Martin, I am saying that the specification of the schema is currently entangled with the specification of the serialization framework. Avro Schema is useful and usable even if you never touch the Avro binaries (the framework, an implementation using the spec). I am indeed proposing to

Re: Formal spec for Avro Schema

Hi Elliot, I am not sure which document you are referring to - the new proposal by Clemens or the official specification. Please start a new email thread or file a Jira ticket if you think something needs to be improved in the specification! On Wed, May 15, 2024 at 10:56 AM Elliot West wrote:

Re: Formal spec for Avro Schema

Hi Clemens, On Wed, May 15, 2024 at 11:18 AM Clemens Vasters wrote: > Hi Martin, > > we find Avro Schema to be a great fit for describing application data > structures in general and even independent of wire-serialization scenarios. > Therefore, I would like to have a spec that focuses

RE: Formal spec for Avro Schema

Hi Martin, we find Avro Schema to be a great fit for describing application data structures in general and even independent of wire-serialization scenarios. Therefore, I would like to have a spec that focuses specifically on the schema format, is grounded in the IETF RFC specs, and which

Re: Formal spec for Avro Schema

I note that the enum type appears to be missing the specification of the default attribute. On Wed, 15 May 2024 at 08:26, Martin Grigorov wrote: > Hi Clemens, > > What is the difference between your document and the specification [1] ? > I haven't read it completely but it looks very similar to

Re: Formal spec for Avro Schema

Hi Clemens, What is the difference between your document and the specification [1] ? I haven't read it completely but it looks very similar to the specification to me. 1. https://avro.apache.org/docs/1.11.1/specification/ 2.

Formal spec for Avro Schema

I wrote a formal spec for the Avro Schema format. https://gist.github.com/clemensv/498c481965c425b218ee156b38b49333 Where would that go in the repo? [cid:image001.jpg@01DAA6A1.96E35FC0] Clemens

Re: Avro JSON Encoding

Hi Clemens Yeah it makes sense. I will be back from the US next week so I will have time to work with you on that and also move forward on the releases. Thanks ! Regards JB Le mer. 24 avr. 2024 à 07:03, Clemens Vasters a écrit : > Hi JB, > > since there seems to be interest in the group even

Re: Avro JSON Encoding

Hi JB, since there seems to be interest in the group even if not full consensus on the scope, I propose that I open an umbrella issue on this with more specific focus on the "what"/"how" more than the "why" as I did in the opening email, which can then be broken down into individual feature

Re: Avro JSON Encoding

Hi, Using a JSON encoding to bridge Avro to/from JSON is indeed a good idea. But the systems still need to talk the same “language” (data structure). I rarely encounter systems that allow fully free-form objects (and never in production); there’s always some data structure behind it. This data

Re: Avro JSON Encoding

I don't think you get around either maps or unions for a model where Avro Schema can describe a JSON originating from an existing producer that isn't aware of Avro Schema being used by the consumer. That is the test I would apply for whether the encoder (or decoder in this case) is practically

Re: Avro JSON Encoding

Hi everyone, Having looked a bit more into what I usually see when using JSON to transfer data, I think we can limit cross-format support (what this essentially is) to a common denominator as we can see between Python objects / dicts, Rust structs, Java POJOs/records, and Parquet MessageTypes,

Re: Avro JSON Encoding

> There's probably a nice balance between a rigorous and interoperable (but less customizable) JSON encoding, and trying to accommodate arbitrary JSON in the Avro project. For my own purposes, I'd only need a very limited set of JSON support. For event streaming, we limit JSONSchema usages to

Re: Avro JSON Encoding

Thank you, Ryan. I am specifically trying to avoid JSON specific attributes that would not be otherwise useful (hence "const" and "displayname") and I do indeed imagine the alternate encoding to be selected by a new switch on the encoders. Gesendet von Outlook für iOS

Re: Avro JSON Encoding

Hello! A bit tongue in cheek: the one advantage of the current Avro JSON encoding is that it drives users rapidly to prefer the binary encoding! In its current state, Avro isn't really a satisfactory toolkit for JSON interoperability, while it shines for binary interoperability. Using JSON with

Re: Avro JSON Encoding

The discriminator is "const". I added "displayname" because I also have other scenarios for it and it appears like a good workaround for alias names that do not fit the "name", e.g. "$type". I am not passionate about "displayname", but "alias" is taken and it's going to be a user-supplied name

Re: Avro JSON Encoding

Thank you Clemens, This is a very detailed set of proposals, and it looks like it would work. I do however, feel we'd need to define a way to unions with records. Your proposal lists various options, of which the discriminatory option seems most portable to me. You mention the "displayName"

RE: Avro JSON Encoding

I literally do the “FWIW” here: https://github.com/clemensv/avrotize?tab=readme-ov-file#convert-json-schema-to-avro-schema From: Andrew Otto Sent: Thursday, April 18, 2024 2:24 PM To: user@avro.apache.org Cc: Clemens Vasters Subject: Re: Avro JSON Encoding Sie erhalten nicht oft eine E-Mail

Re: Avro JSON Encoding

This is a great proposal. At the Wikimedia Foundation, we've explicitly chosen to use JSON as our streaming serialization format . We considered using Avro JSON, but the need to use an Avro specific

"Avrotize" tool

Hi everyone, I'm interested in feedback on the "Avrotize" tool: Git: https://github.com/clemensv/avrotize PyPI: https://pypi.org/project/avrotize/ Avrotize is a command-line tool for converting data structure definitions between different schema formats, using Apache Avro Schema as the

Re: Avro JSON Encoding

Hi Clemens, I propose to wait a bit to give a chance to the community to review your email and points. Then, we will create the Jira accordingly. Regards JB On Thu, Apr 18, 2024 at 9:20 AM Clemens Vasters wrote: > > Hi JB, > > > > I have not done that yet. I’m happy to break that up into

RE: Avro JSON Encoding

Hi JB, I have not done that yet. I'm happy to break that up into items once I get the sense that this is a direction we can get to a consensus on. Shall I file the whole email as a "New Feature" issue first? Thanks Clemens From: Jean-Baptiste Onofré Sent: Thursday, April 18, 2024 10:17 AM

Re: Avro JSON Encoding

Hi Clemens Thanks for the detailed email. Quick question : did you already create Jira about each improvements/issues ? I will take the time to read asap. Thanks Regards JB Le jeu. 18 avr. 2024 à 09:12, Clemens Vasters via user a écrit : > Hi everyone, > > > > the current JSON Encoding

Avro JSON Encoding

Hi everyone, the current JSON Encoding approach severely limits interoperability with other JSON serialization frameworks. In my view, the JSON Encoding is only really useful if it acts as a bridge into and from JSON-centric applications and it currently gets in its own way. The current

Issue while generating POJO using Avro Compiler

Hello, I am using Avro Compiler (1.11.1) to generate Java Objects (PoJo) from Avro Schema (avsc) files. I found a scenario, where if the field name starts with undersore (e.g. _employeeName), getter/setter names are generated using $ symbol (getEmployeeName$1()). Debugging the scenario a bit,

Participate in the ASF 25th Anniversary Campaign

Hi everyone, As part of The ASF’s 25th anniversary campaign[1], we will be celebrating projects and communities in multiple ways. We invite all projects and contributors to participate in the following ways: * Individuals - submit your first contribution:

Community Over Code NA 2024 Travel Assistance Applications now open!

Hello to all users, contributors and Committers! [ You are receiving this email as a subscriber to one or more ASF project dev or user mailing lists and is not being sent to you directly. It is important that we reach all of our users and contributors/committers so that they may get a chance

Getter/Setter name generation using Apache Compiler

Hello, I am using Avro Compiler (1.11.1) to generate Java Objects (PoJo) from Avro Schema (avsc) files. I found a scenario, where if the field name (e.g. _employeeName) starts with undersore (_), getter/setter names are generated using $ symbol (getEmployeeName$1()). Is there any specific

Community Over Code Asia 2024 Travel Assistance Applications now open!

Hello to all users, contributors and Committers! The Travel Assistance Committee (TAC) are pleased to announce that travel assistance applications for Community over Code Asia 2024 are now open! We will be supporting Community over Code Asia, Hangzhou, China July 26th - 28th, 2024. TAC exists

Re: avro_schema_from_json return code 22

Hi I have been digging a bit and I found that json-c (used by my application) cannot cohexist with jansson (used by avro) as they define the same symbols. No compilation or linking error of course, just a weird issue. Thank you for the hint. Alfredo > On 9 Feb 2024, at 16:28, Martin Grigorov

Re: avro_schema_from_json return code 22

Hi, Error 22 in Linux is EINVAL - Invalid argument Martin On Fri, Feb 9, 2024 at 5:21 PM Alfredo Cardigliano wrote: > Hi > I am integrating Avro in an application, using avro_schema_from_json to > parse the schema, > while this function is working fine when compiling a C sample application, >

avro_schema_from_json return code 22

Hi I am integrating Avro in an application, using avro_schema_from_json to parse the schema, while this function is working fine when compiling a C sample application, this fails returning error code 22 when compiling in a C++ application. I am using the libavro shipped with latest Ubuntu 22.

Re: Avro query on Testing if Beta feature of Generating faster code is enabled

On Tue, Feb 6, 2024 at 3:03 PM Chirag Nahata wrote: > hey Martin, > > Thanks, This worked for me and I can confirm that I have enabled the flag > * "-Dorg.apache.avro.specific.use_custom_coders=true"* . > > Can you suggest to me how I can observe the performance improvements > before/after? >

Re: Avro query on Testing if Beta feature of Generating faster code is enabled

On Tue, Feb 6, 2024 at 1:15 PM Siddharth Baranidharan wrote: > Hey Oscar, > Thank you for your response. > My application is an enterprise server(java based)-agent(python based) > model which uses avro-protocol for communication between server & agents. > To the best of my knowledge I have added

Re: [Java] Avro does not respect logicalType with map type

Hi, On Fri, Feb 2, 2024 at 11:37 AM Dupa Trianko wrote: > I have lib class Dimension3D which contains 3 fields and I want to convert > it as one avro filed. > > My definition of logical type connected classes: > public class Dim3AvroLogicalType { > > public static final String

Re: Avro query on Testing if Beta feature of Generating faster code is enabled

Hi, What do you mean by testing if the flag is successfully turned on? Do you need to test its effects? Are you willing to trust the tests we have on the flag? As for testing the performance difference, we do have a performance test module. Perhaps you can use the same technique? Kind regards,

Community over Code EU 2024 Travel Assistance Applications now open!

Hello to all users, contributors and Committers! The Travel Assistance Committee (TAC) are pleased to announce that travel assistance applications for Community over Code EU 2024 are now open! We will be supporting Community over Code EU, Bratislava, Slovakia, June 3th - 5th, 2024. TAC exists

[no subject]

Hello to all users, contributors and Committers! The Travel Assistance Committee (TAC) are pleased to announce that travel assistance applications for Community over Code EU 2024 are now open! We will be supporting Community over Code EU, Bratislava, Slovakia, June 3th - 5th, 2024. TAC exists

[Java] Avro does not respect logicalType with map type

I have lib class Dimension3D which contains 3 fields and I want to convert it as one avro filed. My definition of logical type connected classes: public class Dim3AvroLogicalType { public static final String LOGICAL_TYPE_NAME = "dim3"; public static class Dim3LogicalType extends

Re: Avro schema evolution support in AVRO CPP

fwiw, I'm using it and it works fine, at least for my use cases. J On Fri, Jan 12, 2024 at 1:55 AM Martin Grigorov wrote: > Hi Vivek, > > I am not sure there is anyone to give you an exact answer. The C++ SDK has > not been actively developed in the last few years. > The best is to try it for

Re: Avro schema evolution support in AVRO CPP

"In practice, it is very rare for schema evolution to change the order of the fields." - I'll say. Since we are talking about a protocol that is deliberately not self-describing we cannot just pluck out what we want - how would such code get to it? This is why the standard advice in these

Re: Avro schema evolution support in AVRO CPP

Out-of-order fields are not handled transparently in C++ if you are manually using the resolving decoder. (It's the same situation in Java as well). But, in C++ and in Java, if you generate code for the given Avro schema, the generated code takes care of the field ordering issue. Similarly, in

Re: Avro schema evolution support in AVRO CPP

Hi Vivek, I am not sure there is anyone to give you an exact answer. The C++ SDK has not been actively developed in the last few years. The best is to try it for your use cases and see if it works or not. The next step is to contribute Pull Requests for the missing functionalities! Martin On

Re: Metadata / Annotations support

On wed 11 okt. 2023 17:24, Gustavo Monarin wrote: > Sometimes is usefull to give a contextual information to a field. > > Other protocols like protobuf support annotations through what they call > Option > which allows the following

Release of Avro Java with updates Jackson.databind library

Was wondering if there's a timeline to release a version of the Java library that is using the newer version of the com.fasterxml.jackson.core:jackson-databind? Most of my other dependencies have migrated to 2.15.x but since my project uses Avro I'm unable to upgrade due to the incompatibility

Metadata / Annotations support

Sometimes is usefull to give a contextual information to a field. Other protocols like protobuf support annotations through what they call Option which allows the following customization (uuid field annotation): ``` message

CVE-2023-39410: Apache Avro Java SDK: Memory when deserializing untrusted data in Avro Java SDK

Severity: low Affected versions: - Apache Avro Java SDK before 1.11.3 Description: When deserializing untrusted or corrupted data, it is possible for a reader to consume memory beyond the allowed constraints and thus lead to out of memory on the system. This issue affects Java applications

[ANNOUNCE] Apache Avro 1.11.3 released

The Apache Avro community is pleased to announce the release of Avro 1.11.3! All signed release artifacts, signatures and verification instructions can be found here: https://avro.apache.org/releases.html This is a minor release, specifically addressing known issues with the 1.11.2 release, but

Registration open for Community Over Code North America

Hello! Registration is still open for the upcoming Community Over Code NA event in Halifax, NS! We invite you to register for the event https://communityovercode.org/registration/ Apache Committers, note that you have a special discounted rate for the conference at US$250. To take advantage of

Re: EOS/EOL Date

Hello! While Avro doesn't have an official "end-of-life" statement or policy, there is no active development on the 1.9 or 1.10 branch. Our current policy is to add major features to the next major release (1.12.0) while bug fixes, CVEs and minor features will be backported to the next minor

EOS/EOL Date

Hi, Could you please share End of life/End of support detail or any EoS criteria that is followed for below: * Apache Avro version-1.9.2 Regards, Pranav

[ANNOUNCE] Apache Avro 1.11.2 released

The Apache Avro community is pleased to announce the release of Avro 1.11.2! All signed release artifacts, signatures and verification instructions can be found here: https://avro.apache.org/releases.html This release addresses ~89 Avro JIRA, including some interesting highlights: C# -

CFP for the 2nd Performance Engineering track at Community over Code NA 2023

Hi Apache Avro people - There are only 10 days left to submit a talk proposal (title and abstract only) for Community over Code NA 2023! The 2nd Performance Engineering track is on this year so any Apache project-related performance and scalability talks are welcome, here's the track CFP for

TAC Applications for Community Over Code North America and Asia now open

Hi All, (This email goes out to all our user and dev project mailing lists, so you may receive this email more than once.) The Travel Assistance Committee has opened up applications to help get people to the following events: *Community Over Code Asia 2023 - * *August 18th to August 20th in

configure Avro to use a different hashing algorithm

Hi Avro experts, We are using "avro-1.10.2" on python3 So it seems that the MD5 hash is baked into the Avro protocol standard. The problem is that the Avro protocol library we use to communicate between server and agent is using MD5 hash, which causes a security violation exception when run on

Re: enum schema evolution

https://umanwizard.com/avro.rst Read the section called "Is it always possible to tell, given two schemas, whether they are compatible?". The example in that section uses unions, but your example is similar. The schemas are "compatible" in the sense that it is possible to resolve one against the

Re: enum schema evolution

It works both ways in compatibility Validation. I have used the Avro library for compatibility check SchemaValidator validator = builder.mutualReadStrategy().validateAll(); The SchemaValidator says it is valid with the first schema as reader and second schema as writer and vice versa is valid as

Re: enum schema evolution

Which one is the writer and which is the reader? Sent from my iPhone > On May 4, 2023, at 22:47, KV 59 wrote: > >  > Hi, > > I see that that java Avro compatibility check doesn't work as per > specification for enum schema evolution. I have a the following schema >> { >> "type" :

enum schema evolution

Hi, I see that that java Avro compatibility check doesn't work as per specification for enum schema evolution. I have a the following schema { > "type" : "record", > "name" : "TestEnumRec", > "namespace" : "com.five9.avro.enum.test", > "fields" : [ { > "name" : "enumType", >

Re: Subscribe to Avro users mailing list

Oops :) I thought I had unsubscribed to this mailing list. That's why I wrote such a random email. I thought a bot would respond. Seems like I was wrong. On Fri, Mar 10, 2023 at 3:23 PM Martin Grigorov wrote: > Hi, > > I didn't notice an email to be moderated, so I guess you are already >

Re: Subscribe to Avro users mailing list

Hi, I didn't notice an email to be moderated, so I guess you are already subscribed. Feel free to start new topics/threads and ask any questions! On Fri, Mar 10, 2023 at 11:31 AM Abhishek Dasgupta < abhishekdasgupta...@gmail.com> wrote: > Hi Team, > I would like to ask questions. >

Subscribe to Avro users mailing list

Hi Team, I would like to ask questions.

Re: Ints & Bools Issue

Hello David, Please file a ticket at JIRA for this problem. And attach or link to a a mini application demonstrating the problem. I assume the bug is in the C++ code, since the Java SDK is more widely used. On Mon, Jan 23, 2023 at 5:28 AM David Funnell wrote: > Hello, > > My coworker and I are

Ints & Bools Issue

Hello, My coworker and I are having an issue with what seems like the decoder not respecting byte lengths of ints and bools. I am working in c++ and we use kafka to consume and produce. I am the producer and am encoding to binary and sending a data set to a server. My coworker is working in

Re: Skip Namespace while Decoding Union Types from JSON

Hi Chirag, Please note that json encoded Avro is NOT the same as plain json. It's a special json dialect that is generally not compatible with regular json data. Sad news: there exists no json parser that yields Avro records. Json simply lacks the context information that Avro union parsing

Skip Namespace while Decoding Union Types from JSON

Hello, My system is receiving JSON data serialized from JSON schemas. I am trying to represent the *minProperties *and *maxProperties *types in JSON schema in AVRO using Union types. But the problem is, AVRO JSON decoder expect the Union branch to be present in data and it searches the union type

Re: Modifying a field's schema property in Java

Thanks Oscar! Julien (or anyone else) -- do you think it would be useful to have a category of "Schema" objects that are mutable for the Java SDK? Something like: MutableSchema ms = originalSchema.unlock(); ms.getField("quantity").setProperty("precision", 5);

Re: Modifying a field's schema property in Java

On sun 13 nov. 2022 05:34, Julien Phalip wrote: > I've got a schema with multiple levels of depths (sub-records) that I > would need to change slightly. [...] > > Is there a way to make this type of modification on an existing schema, or > do you have to recreate the entire schema from scratch?

Modifying a field's schema property in Java

Hi, I've got a schema with multiple levels of depths (sub-records) that I would need to change slightly. In particular, I need to change the "precision" and "scale" properties on a decimal field. My problem is that apparently in Java a field's properties are immutable. If you call the "add

Re: Rust Serde Deserialize

https://github.com/lerouxrgd/rsgen-avro/pull/36 On Tue, Aug 30, 2022 at 9:07 AM Martin Grigorov wrote: > Hi Rajiv, > > Now, when you said it I remembered about this prerequisite for serializing > bytes. > I will open a PR to rsgen-avro to add #[serde(with = "serde_bytes")] when > "bytes" schema

Re: Rust Serde Deserialize

Hi Rajiv, Now, when you said it I remembered about this prerequisite for serializing bytes. I will open a PR to rsgen-avro to add #[serde(with = "serde_bytes")] when "bytes" schema is used! Regards, Martin On Mon, Aug 29, 2022 at 5:10 PM Rajiv M Ranganath wrote: > Hi Martin, > > It looks like

Re: Rust Serde Deserialize

Hi Martin, It looks like there are no changes needed on the Avro side. I was not using Serde correctly. On the Rust side, we need to use `serde_bytes` [1] crate, and define our Rust struct as follows. ``` #[derive(Debug, PartialEq, Eq, Clone, serde::Deserialize, serde::Serialize)]

Re: Rust Serde Deserialize

On Mon, Aug 29, 2022 at 3:18 PM Martin Grigorov wrote: [...] > Do you want to contribute the code as a failing unit test in a Pull > Request ? > With a fix would be awesome! Okay. Please give me a couple of days. I'll investigate and open a PR. Best, Rajiv

Re: Rust Serde Deserialize

Hi Rajiv, There are 0 known issues for the Rust SDK! :-) Do you want to contribute the code as a failing unit test in a Pull Request ? With a fix would be awesome! Thanks! Martin On Mon, Aug 29, 2022 at 12:11 PM Rajiv M Ranganath < rajiv.rangan...@gmail.com> wrote: > Hi Martin, > > On Mon,

Re: Rust Serde Deserialize

Hi Martin, On Mon, Aug 29, 2022 at 1:43 PM Martin Grigorov wrote: [...] > I'd recommend you this nice tool for generating Rust structs from Avro > schema: https://github.com/lerouxrgd/rsgen-avro Thanks for the reply and the pointer to `rsgen-avro`. :-) It looks like there seems to be an

Re: Rust Serde Deserialize

Hi Rajiv, I'd recommend you this nice tool for generating Rust structs from Avro schema: https://github.com/lerouxrgd/rsgen-avro $ cat q.avsc 1 │ { 2 │ "type": "record", 3 │ "name": "Abcd", 4 │ "fields": [ 5 │ {"name": "b", "type": ["null", "bytes"], "default":

Rust Serde Deserialize

Hi, I am new to Avro. When I have an Arvo schema of the form, ``` record Abcd { union { null, bytes } efgh = null; } ``` What would be the corresponding Rust struct? I tried ``` #[derive(Debug, Deserialize, PartialEq)] struct Abcd { efgh: Option>, } ``` But for some reason,

[ANNOUNCE] Apache Avro 1.11.1 released

The Apache Avro community is pleased to announce the release of Avro 1.11.0! All signed release artifacts, signatures and verification instructions can be found here: https://avro.apache.org/releases.html This release includes ~250 Jira issues, including some interesting features: Some

Re: GenericDatumReader writer's schema question

Hello Oscar, Yes, I've looked inside DataFileReader and now it's clear for me Thank you пт, 22 лип. 2022 р. о 12:46 Oscar Westra van Holthe - Kind < os...@westravanholthe.nl> пише: > Hi Ivan, > > You're correct about the GenericDatumReader javadoc, but the writer > schema can be adjusted after

Re: GenericDatumReader writer's schema question

Hi Ivan, You're correct about the GenericDatumReader javadoc, but the writer schema can be adjusted after creation. This is what the DataFileReader does. So after the DataFileReader is initialised, the underlying GenericDatumReader uses the the schema in the file as write schema (to understand

GenericDatumReader writer's schema question

Hello As stated in Avro Getting Started about deserialization without code generation: "The data will be read using the writer's schema included in the file, and the reader's schema provided to the GenericDatumReader".

Re: What exception to specify in Avro RPC message so that it generates to AvroRemoteException?

Hi Abhishek, Avro 1.9.0 introduced a change in the generated protocols that removes the throws clause for AvroRemoteException. Since then, any undeclared exception is wrapped in an AvroRuntimeException. Kind regards, Oscar On Fri, 24 Jun 2022 at 15:01, Abhishek Dasgupta <

Re: Manageable avro schema evolution in Java

Hi Niels, Thanks a lot for sharing. Very interesting talk! Adding thumbs up :) One comment around JSON Schema: in the talk you mention that JSON Schema is still on beta given it is a draft. While JSON Schema is a "draft" from the point of view of IETF, it is considered production-ready and the

Manageable avro schema evolution in Java

Hi, Back in 2019 I spoke at the Datawork Summit conference about using Avro for schema evolution in streaming scenarios. https://youtu.be/QOdhaEHbSZM Recently a few people asked me how to actually do this in a practical way. To facilitate this I have created an "as clean as possible"

[FINAL CALL] - Travel Assistance to ApacheCon New Orleans 2022

To all committers and non-committers. This is a final call to apply for travel/hotel assistance to get to and stay in New Orleans for ApacheCon 2022. Applications have been extended by one week and so the application deadline is now the 8th July 2022. The rest of this email is a copy of what

Re: What exception to specify in Avro RPC message so that it generates to AvroRemoteException?

Hi Oscar, Thanks for the reply. Actually I'm trying to migrate from Avro 1.7.6-cdh5.12.0 to 1.11.0 in my codebase. We had these Avro IDL files that generated the POJOs having methods with "throws AvroRemoteException" clause even though there is no "throws" clause specified in their

Re: What exception to specify in Avro RPC message so that it generates to AvroRemoteException?

Hi Abhishek, The throws something in your protocol will be compiled into a throws something in Java. The definition of something must be an error (not a record), which will be compiled into a subclass of AvroRemoteException. So while your exact requirement cannot be satisfied, you will get

What exception to specify in Avro RPC message so that it generates to AvroRemoteException?

I want the Avro generated Java class methods to have throws AvroRemoteException ? How to code this in my Avro IDL file ? Suppose I have this RPC message in my Avro protocol: void foo(int arg) throws something; so the generated Avro POJO has: void foo(int arg) throws AvroRemoteException What

Final reminder: ApacheCon North America call for presentations closing soon

[Note: You're receiving this because you are subscribed to one or more Apache Software Foundation project mailing lists.] This is your final reminder that the Call for Presetations for ApacheCon North America 2022 will close at 00:01 GMT on Monday, May 23rd, 2022. Please don't wait! Get your talk

Re: Unable to resolve NettyTransceiver/ NettyServer (Netty based classes) in avro-ipc 1.11.0

On Wed, May 18, 2022 at 4:28 PM Abhishek Dasgupta < abhishekdasgupta...@gmail.com> wrote: > Hi Martin, > Thanks for the prompt reply but I am still unable to resolve the classes > above. Any other suggestions? >

Re: Unable to resolve NettyTransceiver/ NettyServer (Netty based classes) in avro-ipc 1.11.0

Hi Martin, Thanks for the prompt reply but I am still unable to resolve the classes above. Any other suggestions? On Wed, May 18, 2022 at 6:11 PM Martin Grigorov wrote: > Hi, > > You need to use > https://search.maven.org/artifact/org.apache.avro/avro-ipc-netty/1.11.0/bundle > instead. > > >

Re: Unable to resolve NettyTransceiver/ NettyServer (Netty based classes) in avro-ipc 1.11.0

Hi, You need to use https://search.maven.org/artifact/org.apache.avro/avro-ipc-netty/1.11.0/bundle instead. On Wed, May 18, 2022 at 2:41 PM Abhishek Dasgupta < abhishekdasgupta...@gmail.com> wrote: > > > > Hi, > I am solving this CVE-2021-43045 in my project. I am upgrading Avro and >

Fwd: Unable to resolve NettyTransceiver/ NettyServer (Netty based classes) in avro-ipc 1.11.0

> > Hi, > I am solving this CVE-2021-43045 in my project. I am upgrading Avro and > Avro-ipc from 1.7.6-cdh5.12.0 to 1.11.0. There are some NettyTransceiver, > NettyServer calls in the project. After upgrade, such imports become > un-resolvable which results in compilation error. From

Conversions.DecimalConversion() doesn't work as expected

Hello, I'm trying to serialize json to avro and back also I'm using fields having decimal logical type, so I'd like to have possibility to provide json with normal numbers for serializer and receive equal json from deserializer. And I was hoping that Conversions.DecimalConversion() will help

C++ decimal logical type

Hi, I'm using C++ avro library to serialize json data and schema to avro bytecode and vice versa. I utilize jsonDecoder+binaryEncoder and binaryDecoder+jsonEncoder for this. Some of data includes logical decimal types and now my serializer and deserializer can only receive and return hexademical

REMINDER - Travel Assistance available for ApacheCon NA New Orleans 2022

Hi All Contributors and Committers, This is a first reminder email that travel assistance applications for ApacheCon NA 2022 are now open! We will be supporting ApacheCon North America in New Orleans, Louisiana, on October 3rd through 6th, 2022. TAC exists to help those that would like to

Re: Converting an AVDL file into something that the avro python package can parse

Hello Oscar, Worked perfectly. Thank you! I had tried idl2schemata, but didn't realize I needed to pass an output directory. Tried telling it to write the output to a file, but that obviously didn't work. Regards, Eric On Fri, Apr 22, 2022 at 10:00 AM Oscar Westra van Holthe - Kind <

  1   2   3   4   5   6   7   8   9   10   >