can't get JDBC type for array

2017-03-13 Thread Suresh Ayyavoo
Save below dataframe to database cause error "can't get JDBC type for array" root |-- accountID: array (nullable = true) ||-- element: string (containsNull = true) |-- completed_at: array (nullable = true) ||-- element: string (containsNull = true) |-- created_at: array

Re: Release on 0.7.1 and 0.7.2

2017-03-13 Thread Jun Kim
Cool! I look forward to it! 2017년 3월 14일 (화) 오후 12:31, moon soo Lee 님이 작성: > Sounds like a plan! > > > On Mon, Mar 13, 2017 at 8:22 PM Xiaohui Liu wrote: > > This is the right action. In fact, 0.7.0 release bin did not work for my > team. We almost started to

Re: Release on 0.7.1 and 0.7.2

2017-03-13 Thread moon soo Lee
Sounds like a plan! On Mon, Mar 13, 2017 at 8:22 PM Xiaohui Liu wrote: > This is the right action. In fact, 0.7.0 release bin did not work for my > team. We almost started to use 0.7.1-snapshot immediately after 0.7.0 > release. > > I guess many of us are taking the same

Re: Release on 0.7.1 and 0.7.2

2017-03-13 Thread Xiaohui Liu
This is the right action. In fact, 0.7.0 release bin did not work for my team. We almost started to use 0.7.1-snapshot immediately after 0.7.0 release. I guess many of us are taking the same route. But for new zeppelin users, starting with 0.7.0 will give them the wrong first impression. On

Re: How can i convert below DataFrame array to string

2017-03-13 Thread Suresh Ayyavoo
Thanks also below code helped df.select(concat_ws(",",$"result.accountID") as "accountID") On Tue, Mar 14, 2017 at 5:35 AM, Felix Cheung wrote: > Explode? > > https://spark.apache.org/docs/latest/api/python/pyspark.sql. >

Release on 0.7.1 and 0.7.2

2017-03-13 Thread Jongyoul Lee
Hi dev and users, As we released 0.7.0, most of users and dev reported a lot of bugs which were critical. For the reason, community including me started to prepare new minor release with umbrella issue[1]. Due to contributors' efforts, we have resolved some of issues and have reviewed almost

Re: How can i convert below DataFrame array to string

2017-03-13 Thread Felix Cheung
Explode? https://spark.apache.org/docs/latest/api/python/pyspark.sql.html?highlight=explode#pyspark.sql.functions.explode For Spark questions like this, try stackoverflow spark.apache.org/community.html From: Suresh

Install Zeppelin on Windows to connect to remote Hadoop cluster

2017-03-13 Thread Abhi Basu
Can you please point me to documentation to set up an install of Zeppelin on Windows to connect to remote Hadoop cluster? Thanks, Abhi -- Abhi Basu

Re: "spark ui" button in spark interpreter does not show Spark web-ui

2017-03-13 Thread Hyung Sung Shim
Hello. Thank you for sharing the problem. Could you file a jira issue for this? 2017년 3월 13일 (월) 오후 3:18, Meethu Mathew 님이 작성: > Hi, > > I have noticed the same problem > > Regards, > > > Meethu Mathew > > > On Mon, Mar 13, 2017 at 9:56 AM, Xiaohui Liu

Re: "spark ui" button in spark interpreter does not show Spark web-ui

2017-03-13 Thread Meethu Mathew
Hi, I have noticed the same problem Regards, Meethu Mathew On Mon, Mar 13, 2017 at 9:56 AM, Xiaohui Liu wrote: > Hi, > > We used 0.7.1-snapshot with our Mesos cluster, almost all our needed > features (ldap login, notebook acl control, livy/pyspark/rspark/scala, > etc.)