Shuai Ma created ZEPPELIN-4692:
----------------------------------
Summary: zeppelin pyspark call custom jar not working while it
works well in pyspark shell
Key: ZEPPELIN-4692
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4692
Project: Zeppelin
Issue Type: Bug
Components: pySpark
Affects Versions: 0.8.2
Environment: *Env*:
Zeppelin: 0.8.2
Spark 2.4.4
Scala: 2.11.7
Python 3.7.2
Reporter: Shuai Ma
Attachments: image-2020-03-23-17-51-39-226.png,
image-2020-03-23-17-57-22-868.png, image-2020-03-23-18-04-59-789.png
*Problem description:*
i created a custom jar file my-test-1.0-SNAPSHOT.jar with following java code:
{code:java}
package com.mycompany.app;
import java.util.LinkedList; import java.util.List;
public class Stack {
public void my_open() { System.out.println("calling open file");
}
public void my_close() { System.out.println("calling close file");
}
}{code}
when i use pyspark shell, it works well.
pyspark --driver-class-path my-test-1.0-SNAPSHOT.jar
!image-2020-03-23-17-51-39-226.png!
but when i use pyspark in zeppelin, it works only for the first time, with
proper output "calling open file". But after then, as following shows the
method 'my_open' failed to execute with 'None' returned.
!image-2020-03-23-17-57-22-868.png!
*more actions:*
then i tried to use Scala in Zeppelin to do the same, it worked well.
!image-2020-03-23-18-04-59-789.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
