Re: Nested Field Expressions with Rows

2017-07-10 Thread Joshua Griffith
Indeed that worked. Thanks! > On Jul 10, 2017, at 11:57 AM, Fabian Hueske wrote: > > Hi, > > You have to add the implicit value in the main() method before you call > .map(rowFn) and not in the MapFunction. > > Best, Fabian > > > 2017-07-10 18:54 GMT+02:00 Joshua Griffith

Re: Nested Field Expressions with Rows

2017-07-10 Thread Fabian Hueske
Hi, You have to add the implicit value in the main() method before you call .map(rowFn) and not in the MapFunction. Best, Fabian 2017-07-10 18:54 GMT+02:00 Joshua Griffith : > Hello Fabian, > > Thank you for your response. I tried your recommendation but I’m getting > the same issue. Here’s th

Re: Nested Field Expressions with Rows

2017-07-10 Thread Joshua Griffith
I apologize, that was the wrong link. Here’s where the exception is thrown: https://github.com/apache/flink/blob/release-1.3.1-rc2/flink-core/src/main/java/org/apache/flink/api/common/operators/Keys.java#L329-L331

Re: Nested Field Expressions with Rows

2017-07-10 Thread Joshua Griffith
Hello Fabian, Thank you for your response. I tried your recommendation but I’m getting the same issue. Here’s the altered MakeRow MapFunction I tried: class MakeRow extends MapFunction[(Integer, Integer), Row] { implicit val rowType: TypeInformation[Row] = new RowTypeInfo( Array[Type

Re: Nested Field Expressions with Rows

2017-07-10 Thread Fabian Hueske
Hi Joshua, thanks for reporting this issue. You code is fine but IMO there is a bug in the Scala DataSet API. It simply does not respect the type information provided by the ResultTypeQueryable[Row] interface and defaults to a GenericType. I think this should be fix. I'll open a JIRA issue for th

Re: Nested Field Expressions with Rows

2017-07-10 Thread Joshua Griffith
Thank you for your response Nico. Below is a simple case where I’m trying to join on Row fields: package com.github.hadronzoo.rowerror import org.apache.flink.api.common.functions.MapFunction import org.apache.flink.api.common.typeinfo.{BasicTypeInfo, TypeInformation} import org.apache.flink.api

Re: Nested Field Expressions with Rows

2017-07-10 Thread Nico Kruber
Can you show a minimal example of the query you are trying to run? Maybe Timo or Fabian (cc'd) can help. Nico On Friday, 7 July 2017 23:09:09 CEST Joshua Griffith wrote: > Hello, > > When using nested field expressions like “Account.Id" with nested rows, I > get the following error, “This type

Nested Field Expressions with Rows

2017-07-07 Thread Joshua Griffith
Hello, When using nested field expressions like “Account.Id" with nested rows, I get the following error, “This type (GenericType) cannot be used as key.” Is there a way to make nested field expressions work with nested rows? Thanks, Joshua