How can i convert below DataFrame array to string
Hi All, How can i convert below DataFrame [accountID: array, completed_at: array, created_at: array] to [accountID: string, completed_at: string, created_at: string] root |-- accountID: array (nullable = true) ||-- element: string (containsNull = true) |-- completed_at: array (nullable = true) ||-- element: string (containsNull = true) |-- created_at: array (nullable = true) ||-- element: string (containsNull = true) root |-- accountID: string (containsNull =true) |-- completed_at: string (containsNull =true) |--create_at : string (containsNull =true) Thanks
"spark ui" button in spark interpreter does not show Spark web-ui
Hi, We used 0.7.1-snapshot with our Mesos cluster, almost all our needed features (ldap login, notebook acl control, livy/pyspark/rspark/scala, etc.) work pretty well. But one thing does not work for us is the 'spark ui' button does not response to user clicks. No errors in browser side. Anyone has met similar issues? Any suggestions about where I should check? Regards Xiaohui
Re: "spark ui" button in spark interpreter does not show Spark web-ui
Hi, I have noticed the same problem Regards, Meethu Mathew On Mon, Mar 13, 2017 at 9:56 AM, Xiaohui Liu wrote: > Hi, > > We used 0.7.1-snapshot with our Mesos cluster, almost all our needed > features (ldap login, notebook acl control, livy/pyspark/rspark/scala, > etc.) work pretty well. > > But one thing does not work for us is the 'spark ui' button does not > response to user clicks. No errors in browser side. > > Anyone has met similar issues? Any suggestions about where I should check? > > Regards > Xiaohui >