Re: Dynamically Generated Classes - Cannot load user class

2018-10-24 Thread shkob1
OK I think i figured it out - not sure though exactly the reason: It seems that i need to have a stream type - Generic Type of the super class - rather than a Pojo of the concrete generated class. It seems like the operation definition otherwise cannot load the Pojo class on the task creation. So

Re: Dynamically Generated Classes - Cannot load user class

2018-10-23 Thread DDreyfus
Thinking out loud here: I can't tell where the class load is failing. The general model I've used with ByteBuddy in this scenario is very similar to yours. I subclass my superclass using ByteBuddy. I inject the new class into a JAR that will be shared by the task managers. I subclass the Flink

Re: Dynamically Generated Classes - Cannot load user class

2018-10-23 Thread shkob1
Update on this - if i just do empty mapping and drop the sql part, it works just fine. i wonder if there's any class loading that needs to be done when using SQL, not sure how i do that -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Dynamically Generated Classes - Cannot load user class

2018-10-23 Thread shkob1
After removing some operators (which i still need, but wanted to understand where my issues are) i get a slightly different stacktrace (though still same issue). my current operators are 1. a sql select with group by (returns retracted stream ) 2. filter (take only non retracted) 3. map (tuple

Re: Dynamically Generated Classes - Cannot load user class

2018-10-22 Thread Shahar Cizer Kobrinsky
operator fails? From: Hequn Cheng Sent: Monday, October 22, 2018 6:33:52 PM To: Shahar Cizer Kobrinsky Cc: user Subject: Re: Dynamically Generated Classes - Cannot load user class Hi shkob > i tried to use getRuntimeContext().getUserCodeClassLoader() as the loa

Re: Dynamically Generated Classes - Cannot load user class

2018-10-22 Thread Hequn Cheng
Hi shkob > i tried to use getRuntimeContext().getUserCodeClassLoader() as the loader to use for Byte Buddy - but doesnt seem to be enough. >From the log, it seems that the user class can not be found in the classloader. > Cannot load user class: commodel.MyGeneratedClass Have you ever tried

Dynamically Generated Classes - Cannot load user class

2018-10-22 Thread shkob1
Hey, I'm trying to run a job which uses a dynamically generated class (through Byte Buddy). think of me having a complex schema as yaml text and generating a class from it. Throughout the job i am using an artificial super class (MySuperClass) of the generated class (as for example i need to