Re: Avro JSON Encoding

2024-04-25 Thread Jean-Baptiste Onofré
ssues. I can work on that early next week. > > Best Regards > Clemens > > -- > *Von:* Jean-Baptiste Onofré > *Gesendet:* Donnerstag, April 18, 2024 10:58 AM > *An:* Clemens Vasters > *Cc:* Jean-Baptiste Onofré ; user@avro.apache.org < > use

Re: Avro JSON Encoding

2024-04-24 Thread Clemens Vasters via user
n down into individual feature issues. I can work on that early next week. Best Regards Clemens Von: Jean-Baptiste Onofré Gesendet: Donnerstag, April 18, 2024 10:58 AM An: Clemens Vasters Cc: Jean-Baptiste Onofré ; user@avro.apache.org Betreff: Re: Avro JSON En

Re: Avro JSON Encoding

2024-04-23 Thread Oscar Westra van Holthe - Kind
y, April 23, 2024 1:10:16 PM > An: user@avro.apache.org > Betreff: Re: Avro JSON Encoding > > Sie erhalten nicht oft eine E-Mail von opw...@apache.org. Erfahren Sie, warum > dies wichtig ist <https://aka.ms/LearnAboutSenderIdentification> > Hi everyone, > > Having

Re: Avro JSON Encoding

2024-04-23 Thread Clemens Vasters via user
Holthe - Kind Gesendet: Tuesday, April 23, 2024 1:10:16 PM An: user@avro.apache.org Betreff: Re: Avro JSON Encoding Sie erhalten nicht oft eine E-Mail von opw...@apache.org. Erfahren Sie, warum dies wichtig ist<https://aka.ms/LearnAboutSenderIdentification> Hi everyone, Having looked a bi

Re: Avro JSON Encoding

2024-04-23 Thread Oscar Westra van Holthe - Kind
Hi everyone, Having looked a bit more into what I usually see when using JSON to transfer data, I think we can limit cross-format support (what this essentially is) to a common denominator as we can see between Python objects / dicts, Rust structs, Java POJOs/records, and Parquet MessageTypes,

Re: Avro JSON Encoding

2024-04-19 Thread Andrew Otto
> There's probably a nice balance between a rigorous and interoperable (but less customizable) JSON encoding, and trying to accommodate arbitrary JSON in the Avro project. For my own purposes, I'd only need a very limited set of JSON support. For event streaming, we limit JSONSchema usages to

Re: Avro JSON Encoding

2024-04-19 Thread Clemens Vasters via user
t;https://aka.ms/o0ukef> Von: Ryan Skraba Gesendet: Friday, April 19, 2024 5:57:37 PM An: user@avro.apache.org Cc: Clemens Vasters Betreff: Re: Avro JSON Encoding [Sie erhalten nicht häufig E-Mails von r...@skraba.com. Weitere Informationen, warum dies wichtig is

Re: Avro JSON Encoding

2024-04-19 Thread Ryan Skraba
Hello! A bit tongue in cheek: the one advantage of the current Avro JSON encoding is that it drives users rapidly to prefer the binary encoding! In its current state, Avro isn't really a satisfactory toolkit for JSON interoperability, while it shines for binary interoperability. Using JSON with

Re: Avro JSON Encoding

2024-04-18 Thread Clemens Vasters via user
"const": "cat" }, ... cat things .. ] }, { "type":"record", "fields": [ { "name": "typename", "displayname": "$type",

Re: Avro JSON Encoding

2024-04-18 Thread Oscar Westra van Holthe - Kind
Thank you Clemens, This is a very detailed set of proposals, and it looks like it would work. I do however, feel we'd need to define a way to unions with records. Your proposal lists various options, of which the discriminatory option seems most portable to me. You mention the "displayName"

RE: Avro JSON Encoding

2024-04-18 Thread Clemens Vasters via user
I literally do the “FWIW” here: https://github.com/clemensv/avrotize?tab=readme-ov-file#convert-json-schema-to-avro-schema From: Andrew Otto Sent: Thursday, April 18, 2024 2:24 PM To: user@avro.apache.org Cc: Clemens Vasters Subject: Re: Avro JSON Encoding Sie erhalten nicht oft eine E-Mail

Re: Avro JSON Encoding

2024-04-18 Thread Andrew Otto
This is a great proposal. At the Wikimedia Foundation, we've explicitly chosen to use JSON as our streaming serialization format . We considered using Avro JSON, but the need to use an Avro specific

Re: Avro JSON Encoding

2024-04-18 Thread Jean-Baptiste Onofré
ril 18, 2024 10:17 AM > To: Clemens Vasters ; user@avro.apache.org > Subject: Re: Avro JSON Encoding > > > > Hi Clemens > > > > Thanks for the detailed email. > > > > Quick question : did you already create Jira about each improvements/issues ? > > >

RE: Avro JSON Encoding

2024-04-18 Thread Clemens Vasters via user
4 10:17 AM To: Clemens Vasters ; user@avro.apache.org Subject: Re: Avro JSON Encoding Hi Clemens Thanks for the detailed email. Quick question : did you already create Jira about each improvements/issues ? I will take the time to read asap. Thanks Regards JB Le jeu. 18 avr. 2024 à 09:12, Cleme

Re: Avro JSON Encoding

2024-04-18 Thread Jean-Baptiste Onofré
Hi Clemens Thanks for the detailed email. Quick question : did you already create Jira about each improvements/issues ? I will take the time to read asap. Thanks Regards JB Le jeu. 18 avr. 2024 à 09:12, Clemens Vasters via user a écrit : > Hi everyone, > > > > the current JSON Encoding