How can i convert below DataFrame array to string

[Suresh Ayyavoo]

Hi All,

How can i convert below DataFrame [accountID: array, completed_at:
array, created_at: array] to
[accountID: string, completed_at: string, created_at: string]

root

 |-- accountID: array (nullable = true)

 ||-- element: string (containsNull = true)

 |-- completed_at: array (nullable = true)

 ||-- element: string (containsNull = true)

 |-- created_at: array (nullable = true)

 ||-- element: string (containsNull = true)


root
|-- accountID: string (containsNull =true)
|-- completed_at: string (containsNull =true)
|--create_at : string (containsNull =true)


Thanks

"spark ui" button in spark interpreter does not show Spark web-ui

[Xiaohui Liu]

Hi,

We used 0.7.1-snapshot with our Mesos cluster, almost all our needed
features (ldap login, notebook acl control, livy/pyspark/rspark/scala,
etc.) work pretty well.

But one thing does not work for us is the 'spark ui' button does not
response to user clicks. No errors in browser side.

Anyone has met similar issues? Any suggestions about where I should check?

Regards
Xiaohui

Re: "spark ui" button in spark interpreter does not show Spark web-ui

[Meethu Mathew]

Hi,

I have noticed the same problem

Regards,
Meethu Mathew


On Mon, Mar 13, 2017 at 9:56 AM, Xiaohui Liu  wrote:

> Hi,
>
> We used 0.7.1-snapshot with our Mesos cluster, almost all our needed
> features (ldap login, notebook acl control, livy/pyspark/rspark/scala,
> etc.) work pretty well.
>
> But one thing does not work for us is the 'spark ui' button does not
> response to user clicks. No errors in browser side.
>
> Anyone has met similar issues? Any suggestions about where I should check?
>
> Regards
> Xiaohui
>