Re: Question about Scala Case Class and List in Flink

2021-02-06 Thread Xavier
Thanks for ur suggestions! On Fri, Feb 5, 2021 at 11:16 PM Timo Walther wrote: > Dealing with types is not always easy in Flink. If you have further > issues, it might make sense to just pass them explicitly. We list all > types in: > > org.apache.flink.api.common.typeinfo.Types > >

Re: Question about Scala Case Class and List in Flink

2021-02-05 Thread Timo Walther
Dealing with types is not always easy in Flink. If you have further issues, it might make sense to just pass them explicitly. We list all types in: org.apache.flink.api.common.typeinfo.Types org.apache.flink.api.scala.typeutils.Types Regards, Timo On 05.02.21 16:04, Xavier wrote: Hi Timo,

Re: Question about Scala Case Class and List in Flink

2021-02-05 Thread Xavier
Hi Timo, Thank you for ur clarification, it is very useful to me, I am also combining the realization of map function, trying to do implicit conversion of case class, so that I can restore state from FS. On Fri, Feb 5, 2021 at 10:38 PM Timo Walther wrote: > Hi Xavier, > > the Scala API has

Re: Question about Scala Case Class and List in Flink

2021-02-05 Thread Timo Walther
Hi Xavier, the Scala API has special implicits in method such as `DataStream.map()` or `DataStream.keyBy()` to support Scala specifics like case classe. For Scala one needs to use the macro `createTypeInformation[CaseClass]` for Java we use reflection via `TypeInformation.of()`. But Scala and

Re: Question about Scala Case Class and List in Flink

2021-02-05 Thread Xavier
Hi Utopia, Have u fixed this problem? I also meet this problem, so I transferred the case class to Java POJO, then this problem was fixed. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Question about Scala Case Class and List in Flink

2020-04-24 Thread Averell
Hi Timo, This is my case class: /case class Box[T](meta: Metadata, value: T) { def function1: A=>B = {...} def method2(...):A = {...} }/ However, I still get that warning "/Class class data.package$Box cannot be used as a POJO type because not all fields are valid POJO fields, and

Re: Question about Scala Case Class and List in Flink

2020-01-15 Thread Timo Walther
Hi, Reg. 1: Scala case classes are supported in the Scala specific version of the DataStream API. If you are using case classes in the Java API you will get the INFO below because the Java API uses pure reflection extraction for analyzing POJOs. The Scala API tries to analyze Scala classes

Question about Scala Case Class and List in Flink

2020-01-14 Thread Utopia
Hi folks, I have two questions about types in Flink when using Scala: 1. scala case class: This my case class define: case class SensorReading(var id: String , var timestamp: Long, var temperature: Double) In documentation, Scala case class is supported: `Scala case classes (including Scala