Re: Problem while debugging a python job

[Mathias Peters]

Thanks. That did it.

best

Mathias


On 17.01.2018 13:11, Chesnay Schepler wrote:
> All dependencies of flink-python are set to /provided/ so that they
> aren't included in the flink-python jar (which would duplicate all
> classes already contained in flink-dist).
>
> You can either temporarily modify the dependencies and remove the
> /provided /scope, or create a simple test class that calls
> PythonPlanBinder.
>
> On 16.01.2018 19:21, Mathias Peters wrote:
>> Hi all,
>>
>> I'm trying to debug a python script with a flink job in using Intellij.
>> I'm using the current snapshot (1.5 cloned today). In former versions, I
>> could simply run org.apache.flink.python.api.PythonPlanBinder from
>> within the IDE. Atm, I'm getting NoClassDefFoundError s from classes of
>> the core module (e.g. FSDataOutputStream). I imported the fresh project
>> as desribed on your website and I ran mvn clean package several times.
>>
>> Is this a known issue or am I missing something?
>>
>> Thanks in advance and cheers
>>
>> Mathias
>>
>>
>

Problem while debugging a python job

[Mathias Peters]

Hi all,

I'm trying to debug a python script with a flink job in using Intellij.
I'm using the current snapshot (1.5 cloned today). In former versions, I
could simply run org.apache.flink.python.api.PythonPlanBinder from
within the IDE. Atm, I'm getting NoClassDefFoundError s from classes of
the core module (e.g. FSDataOutputStream). I imported the fresh project
as desribed on your website and I ran mvn clean package several times.

Is this a known issue or am I missing something?

Thanks in advance and cheers

Mathias

Re: Debugging Python-Api fails with NoClassDefFoundError

[Mathias Peters]

Yes, it is. Also, the project import in Idea has worked so far.

Cheers


On 04.01.2017 21:52, Ted Yu wrote:
> This class is in flink-core jar.
>
> Have you verified that the jar is on classpath ?
>
> Cheers
>
> On Wed, Jan 4, 2017 at 12:16 PM, Mathias Peters
> <mathias.pet...@gmx.org <mailto:mathias.pet...@gmx.org>> wrote:
>
> Hi,
>
> I just wanted to debug a custom python script using your python dataset
> api. Running the PythonPlanBinder in Intellij IDEA gives me the
> subjected error. I took a fresh clone, built it with mvn clean install
> -DskipTest, and imported everything in idea. Using an older version this
> worked fine, so assume no(t the usual noob) errors on my side 
>
> Submitting a python script via console works.
>
> The full stack trace looks like this:
>
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/flink/api/java/typeutils/TupleTypeInfoBase
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:264)
> at 
> com.intellij.rt.execution.application.AppMain.main(AppMain.java:122)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.flink.api.java.typeutils.TupleTypeInfoBase
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 3 more
>
>
> Thanks for the help.
>
> best
>
> Mathias
>

Debugging Python-Api fails with NoClassDefFoundError

[Mathias Peters]

Hi,

I just wanted to debug a custom python script using your python dataset
api. Running the PythonPlanBinder in Intellij IDEA gives me the
subjected error. I took a fresh clone, built it with mvn clean install
-DskipTest, and imported everything in idea. Using an older version this
worked fine, so assume no(t the usual noob) errors on my side 

Submitting a python script via console works.

The full stack trace looks like this:

Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/flink/api/java/typeutils/TupleTypeInfoBase
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:122)
Caused by: java.lang.ClassNotFoundException:
org.apache.flink.api.java.typeutils.TupleTypeInfoBase
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 3 more


Thanks for the help.

best

Mathias