Problems using UDFs with PySpark on 0.6.1 / Spark 2.0

Hi all, I am experiencing problems with defining UDFs on Zeppelin 0.6.1 backed by spark 2.0. Code: %pyspark from pyspark.sql.functions import udf wrapped_udf = udf(lambda x: x) The call to udf fails with the following error message: Traceback (most recent call last): File "/var/folders/mr/79

Re: 0.6.1 and spark 2.0.0

Thanks Jeff. It worked > On Sep 16, 2016, at 04:01, Jianfeng (Jeff) Zhang > wrote: > > > Here’s how to disable timeline service. > > > Indicate to clients whether Timeline service is enabled > or not. > If enabled, the TimelineClient library used by end-users will post

Re: Zeppelin 0.61 interpreter config changes?

The ";" did not make any difference. Attached the only log file I see from today. Thanks, Abhi On Mon, Sep 19, 2016 at 1:44 AM, Prabhjyot Singh wrote: > Hi Abhi, > > I don't see the error attached. Also, just remove ";" from "show tables;" > and run the paragraph, it should work. > > On 19 Sep

Re: Problems using UDFs with PySpark on 0.6.1 / Spark 2.0

Hi, Thanks for reporting the problem. The issue is being tracked by https://issues.apache.org/jira/browse/ZEPPELIN-1411 and patch is available at https://github.com/apache/zeppelin/pull/1404. Hope we can merge this patch to master soon. Thanks! moon On Mon, Sep 19, 2016 at 2:58 AM Michael Borst

Binary for CDH 5.8.0

Is there a specific binary for CDH 5.8.0, hadoop 2.6. and Spark 1.6? Or, is the best method to compile the source code with appropriate switches? Thanks, Abhi -- Abhi Basu

Re: Binary for CDH 5.8.0

We don't have Hadoop distribution specific binary releases - compiling from source with switches would be the best route. On Mon, Sep 19, 2016 at 12:22 PM -0700, "Abhi Basu" <9000r...@gmail.com> wrote: Is there a specific binary for CDH 5.8.0, hadoop 2.6. and Spar