Re: NotSerializableException: org.apache.flink.runtime.rest.messages.ResourceProfileInfo

2020-07-22 Thread Xintong Song
Hi Peter, Thanks for reporting this issue. >From the exception stack, it seems there's indeed a problem. However, I'm not able to reproduce this issue on my machine, and I guess that's why this is not discovered before the release. Could you help share some more details (and maybe screenshots) on

NotSerializableException: org.apache.flink.runtime.rest.messages.ResourceProfileInfo

2020-07-22 Thread Peter Westermann
I just started testing Flink 1.11.1 and noticed that the Task Managers section in the UI doesn’t load. The exception in the log is: j.i.NotSerializableException: org.apache.flink.runtime.rest.messages.ResourceProfileInfo \tat j.i.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184) \tat

Re: NotSerializableException: DropwizardHistogramWrapper inside AggregateFunction

2019-06-17 Thread Vijay Balakrishnan
gt;> SlidingTimeWindowReservoir(timeIntervalL, TimeUnit.MINUTES)); >>> org.apache.flink.metrics.Histogram minHistogram = new >>> DropwizardHistogramWrapper(minHist); >>> Map intervalHistMap = new >>> TreeMap<>(); >>> intervalHistMap.put

Re: NotSerializableException: DropwizardHistogramWrapper inside AggregateFunction

2019-06-07 Thread Fabian Hueske
ey, intervalHistMap); >> } >> > When trying to use it in the add() method of AggregateFunction, it fails > saying: > NotSerializableException: > org.apache.flink.dropwizard.metrics.DropwizardHistogramWrapper > > Tried to wrap DropwizardHistogramWrapper inside a serializable Object with > Co

NotSerializableException: DropwizardHistogramWrapper inside AggregateFunction

2019-06-06 Thread Vijay Balakrishnan
bsent(operationKey, intervalHistMap); > } > When trying to use it in the add() method of AggregateFunction, it fails saying: NotSerializableException: org.apache.flink.dropwizard.metrics.DropwizardHistogramWrapper Tried to wrap DropwizardHistogramWrapper inside a serializable Object with C

Re: NotSerializableException: jdk.nashorn.api.scripting.NashornScriptEngine

2016-11-03 Thread Greg Hogan
Hi Pedro, Which problem are you having, the NotSerializableException or not seeing open() called on a RichFunction? Greg On Wed, Nov 2, 2016 at 10:47 AM, PedroMrChaves wrote: > Hello, > > I'm having the exact same problem. > I'm using a filter function on a datastream.

Re: NotSerializableException: jdk.nashorn.api.scripting.NashornScriptEngine

2016-11-02 Thread PedroMrChaves
Hello, I'm having the exact same problem. I'm using a filter function on a datastream. My flink version is 1.1.3. What could be the problem? Regards, Pedro Chaves. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/NotSerializabl

Re: NotSerializableException

2016-06-15 Thread Ufuk Celebi
Here's the issue https://issues.apache.org/jira/browse/FLINK-4078 On Mon, Jun 13, 2016 at 12:27 PM, Aljoscha Krettek wrote: > Nope, I think there is neither a fix nor an open issue for this right now. > > On Mon, 13 Jun 2016 at 11:31 Maximilian Michels wrote: >> >> Is there an issue or a fix for

Re: NotSerializableException

2016-06-13 Thread Aljoscha Krettek
Nope, I think there is neither a fix nor an open issue for this right now. On Mon, 13 Jun 2016 at 11:31 Maximilian Michels wrote: > Is there an issue or a fix for proper use of the ClojureCleaner in > CoGroup.where()? > > On Fri, Jun 10, 2016 at 8:07 AM, Aljoscha Krettek > wrote: > > Hi, > > ye

Re: NotSerializableException

2016-06-13 Thread Maximilian Michels
Is there an issue or a fix for proper use of the ClojureCleaner in CoGroup.where()? On Fri, Jun 10, 2016 at 8:07 AM, Aljoscha Krettek wrote: > Hi, > yes, I was talking about a Flink bug. I forgot to mention the work-around > that Stephan mentioned. > > On Thu, 9 Jun 2016 at 20:38 Stephan Ewen wr

Re: NotSerializableException

2016-06-09 Thread Aljoscha Krettek
Hi, yes, I was talking about a Flink bug. I forgot to mention the work-around that Stephan mentioned. On Thu, 9 Jun 2016 at 20:38 Stephan Ewen wrote: > You can also make the KeySelector a static inner class. That should work > as well. > > On Thu, Jun 9, 2016 at 7:00 PM, Tarandeep Singh > wrote

Re: NotSerializableException

2016-06-09 Thread Stephan Ewen
You can also make the KeySelector a static inner class. That should work as well. On Thu, Jun 9, 2016 at 7:00 PM, Tarandeep Singh wrote: > Thank you Aljoscha and Fabian for your replies. > > @Aljoscha: when you said "cleaner is not used in CoGroup.where(). I'm > afraid this is a bug", I am assum

Re: NotSerializableException

2016-06-09 Thread Tarandeep Singh
Thank you Aljoscha and Fabian for your replies. @Aljoscha: when you said "cleaner is not used in CoGroup.where(). I'm afraid this is a bug", I am assuming you are referring to Flink engine itself. @Fabian: thanks for the optimization tip. This is how I have got it working (with a hack): In my da

Re: NotSerializableException

2016-06-09 Thread Aljoscha Krettek
Hi, the problem is that the KeySelector is an anonymous inner class and as such as a reference to the outer RecordFilterer object. Normally, this would be rectified by the closure cleaner but the cleaner is not used in CoGroup.where(). I'm afraid this is a bug. Best, Aljoscha On Thu, 9 Jun 2016

Re: NotSerializableException

2016-06-09 Thread Fabian Hueske
Hi Tarandeep, the exception suggests that Flink tries to serialize RecordsFilterer as a user function (this happens via Java Serialization). I said suggests because the code that uses RecordsFilterer is not included. To me it looks like RecordsFilterer should not be used as a user function. It is

NotSerializableException

2016-06-08 Thread Tarandeep Singh
Hi, I am getting NoSerializableException in this class-  public class RecordsFilterer { public DataSet> addFilterFlag(DataSet dataset, DataSet filteredIds, String fieldName) { return dataset.coGroup(filteredIds) .where(new KeySelector() { @Overri

Re: NotSerializableException: jdk.nashorn.api.scripting.NashornScriptEngine

2015-06-05 Thread Robert Metzger
That should not happen. Which function (map, join, ..) are you using? Are you using the the batch or the streaming API? Which version of Flink are you using? On Fri, Jun 5, 2015 at 11:35 AM, Ashutosh Kumar wrote: > Thanks Robert.I tried this . It does not throw NotSerializableExcept

Re: NotSerializableException: jdk.nashorn.api.scripting.NashornScriptEngine

2015-06-05 Thread Ashutosh Kumar
Thanks Robert.I tried this . It does not throw NotSerializableException exception.But the open method is not getting called. On Fri, Jun 5, 2015 at 1:58 PM, Robert Metzger wrote: > Hi, > > I guess you have a user function with a field for the scripting engine. > Can you chan

Re: NotSerializableException: jdk.nashorn.api.scripting.NashornScriptEngine

2015-06-05 Thread Robert Metzger
: > I am trying to use java script engine to execute some rules on data set. > But it is throwing > > NotSerializableException > for jdk.nashorn.api.scripting.NashornScriptEngine.Not sure how to resolve > this. > > Thanks > > Caused by: ja

NotSerializableException: jdk.nashorn.api.scripting.NashornScriptEngine

2015-06-05 Thread Ashutosh Kumar
I am trying to use java script engine to execute some rules on data set. But it is throwing NotSerializableException for jdk.nashorn.api.scripting.NashornScriptEngine.Not sure how to resolve this. Thanks Caused by: java.io.NotSerializableException: jdk.nashorn.api.scripting.NashornScriptEngine