Hi all,
In case this helps anyone, I was able to create a simple class to do the
join and it works nicely for my use case. It assumes you have schema for
the input and output records.
Example (
https://github.com/Quantiply/rico/blob/master/avro-serde/src/test/java/com/quantiply/avro/JoinTest.jav
t;, "type" : "record", "fields": [{"name": "a", "type" :
> "int"}]},
>{"name": "B", "type" : "record", "fields": [{"name": "b", "type" : "
Thanks, Julian. Good point about needing aliasing for unique names in
SQL. I didn't know about array_agg...nice.
On Thu, Apr 9, 2015 at 12:35 PM, Julian Hyde wrote:
> Much of this is about mapping from logical fields (i.e. the fields you can
> reference in SQL) down to the Avro representation;
Yi Pan,
Thanks for your response. I'm thinking that I'll iterate over the fields
of the input schemas (similar to this
https://github.com/apache/samza/blob/samza-sql/samza-sql/src/main/java/org/apache/samza/sql/metadata/AvroSchemaConverter.java#L58-L62),
match them up with the output schema and t
Much of this is about mapping from logical fields (i.e. the fields you can
reference in SQL) down to the Avro representation; I’m no expert on that
mapping, so I’ll focus on the SQL stuff.
First, SQL doesn’t allow a record to have two fields of the same name, so you
wouldn’t be allowed to have
Hi, Roger,
Good question on that. I am actually not aware of any "automatic" way of
doing this in Avro. I have tried to add generic Schema and Data interface
in samza-sql branch to address the morphing of the schemas from input
streams to the output streams. The basic idea is to have wrapper Schem
Hi Milinda and others,
This is an Avro question but since you guys are working on Avro support for
stream SQL, I thought I'd ask you for help.
If I have a two records of type A and B as below and want to join them
similar to "SELECT *" in SQL to produce a record of type AB, is there an
simple way
