[jira] [Created] (ZEPPELIN-4177) org.apache.commons:commons-lang3 dependency Hell with Spark 2.4.x
antonkulaga created ZEPPELIN-4177: - Summary: org.apache.commons:commons-lang3 dependency Hell with Spark 2.4.x Key: ZEPPELIN-4177 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4177 Project: Zeppelin Issue Type: Improvement Affects Versions: 0.8.1 Reporter: antonkulaga I get a dependency Hell when I try to load any csv with Spark 2.4.3 ``` sparkSession.read .option("sep", "\t") .option("comment", "#") .option("inferSchema", true) .option("header", true) .option("ignoreLeadingWhiteSpace", true) .option("ignoreTrailingWhiteSpace", true) .option("ignoreTrailingWhiteSpace", true) .option("maxColumns", 15) .csv(pathToTheFile) ``` I managed to find a workaround by adding "org.apache.commons:commons-lang3:3.8.1 to the spark interpreter dependencies, however the true fix will be updating Zeppelin org.apache.commons:commons-lang3 dependency to a newer one. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] zeppelin issue #3206: [ZEPPELIN-3810] Support Spark 2.4
Github user antonkulaga commented on the issue: https://github.com/apache/zeppelin/pull/3206 Looking forward to seeing it merged and Zeppelin 0.9.0 released, Spark 2.4 fixes some very nasty bugs ---
[jira] [Created] (ZEPPELIN-3857) Spark 2.4.0 and Scala 2.12
antonkulaga created ZEPPELIN-3857: - Summary: Spark 2.4.0 and Scala 2.12 Key: ZEPPELIN-3857 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3857 Project: Zeppelin Issue Type: Improvement Reporter: antonkulaga Spark 2.4.0 was released. Together with many new features and bug fixes it also brings long anticipated Scala 2.12 support. Many great Scala libraries already dropped Scala 2.11 support and people were suffering because of the inability to use them together with spark inside zeppelin, with Spark 2.4.0 support if will finally be possible to solve this problem -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3757) Syntax highlightning for %html
antonkulaga created ZEPPELIN-3757: - Summary: Syntax highlightning for %html Key: ZEPPELIN-3757 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3757 Project: Zeppelin Issue Type: New Feature Components: front-end Reporter: antonkulaga As the choice of visualization plugins is not large it is quite common to write custom html and javascript code with d3js and other javascript libraries. However, it is very hard to edit such code as %html is highlighted as scala string, it will be great to have HTML and javascript code highlighting for %html strings -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3756) Scala-js support
antonkulaga created ZEPPELIN-3756: - Summary: Scala-js support Key: ZEPPELIN-3756 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3756 Project: Zeppelin Issue Type: New Feature Components: front-end Reporter: antonkulaga It will be great to have Scala-js so users will be able to write both backend data processing and frontend visualization code in a same language -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] zeppelin issue #3034: [WIP] ZEPPELIN-3552. Support Scala 2.12 of SparkInterp...
Github user antonkulaga commented on the issue: https://github.com/apache/zeppelin/pull/3034 Spark 2.4 will officially support Scala 2.12, so it will be great if Zeppelin will support it together with Spark. And also, there are some libs that are Scala 2.12 only ---
[jira] [Created] (ZEPPELIN-3728) "error: illegal start of" on line breaks
antonkulaga created ZEPPELIN-3728: - Summary: "error: illegal start of" on line breaks Key: ZEPPELIN-3728 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3728 Project: Zeppelin Issue Type: Bug Affects Versions: 0.8.0 Environment: Zeppelin 0.8.0, latest Ubuntu Reporter: antonkulaga It is exceptionally annoying that I cannot split long lines of code like: """ val table = spark.read.format("jdbc").option("url", "jdbc:postgresql://db/sequencing").option("dbtable", "samples").option("user", "postgres").option("password", "changeme").load() """ into something more readable like """ val table = spark.read .format("jdbc") .option("url", "jdbc:postgresql://db/sequencing") .option("dbtable", "samples") .option("user", "postgres") .option("password", "changeme") .load() """ because Zeppelin throws me with a huge ammount of errors like: "table: org.apache.spark.sql.DataFrameReader = org.apache.spark.sql.DataFrameReader@1332d108 :1: error: illegal start of definition .format("jdbc") ^" Our team is migrating a lot of code from Jupyter (apache-torree based) notebooks (where everything is ok with line breaks) to zeppelin and this line breaks issue causes a lot of pain... -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] zeppelin issue #2900: Alluxio
Github user antonkulaga commented on the issue: https://github.com/apache/zeppelin/pull/2900 @apc999 could you please update the client to 1.8.0 ? ---