Drop Java 7 support? (re-open ZEPPELIN-621?)
Hi all Right now Zeppelin is compiled for Java 7 as minimal version. But it already EOL for a long time, so it makes sense to stop supporting it. There are several reasons for it: - Spark 2.2.0 that is used by Zeppelin (at least in master) supports only Java 8+ - Switch to Java 8 will allow to write more clear code for Java part of the Zeppelin code. This switch was already discussed as https://issues.apache.org/jira/browse/ZEPPELIN-621, but it was more than 2 years ago. What do you think? -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Drop Java 7 support? (re-open ZEPPELIN-621?)
I've opened the PR for it: https://github.com/apache/zeppelin/pull/3029 On Mon, Jun 18, 2018 at 6:49 AM, Jongyoul Lee wrote: > +1, too. > > On Mon, Jun 18, 2018 at 11:33 AM, Jeff Zhang wrote: > > > +1 > > > > Alex Ott 于2018年6月18日周一 上午2:01写道： > > > > > Hi all > > > > > > Right now Zeppelin is compiled for Java 7 as minimal version. > > > But it already EOL for a long time, so it makes sense to stop > supporting > > > it. > > > > > > There are several reasons for it: > > > > > >- Spark 2.2.0 that is used by Zeppelin (at least in master) supports > > >only Java 8+ > > >- Switch to Java 8 will allow to write more clear code for Java part > > of > > >the Zeppelin code. > > > > > > This switch was already discussed as > > > https://issues.apache.org/jira/browse/ZEPPELIN-621, but it was more > > than 2 > > > years ago. > > > > > > What do you think? > > > > > > -- > > > With best wishes,Alex Ott > > > http://alexott.net/ > > > Twitter: alexott_en (English), alexott (Russian) > > > > > > > > > -- > 이종열, Jongyoul Lee, 李宗烈 > http://madeng.net > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
PRs for documentation?
Hi all I have a question - should I file JIRA for documentation fixes/improvements? For example, I opened PR some time ago ( https://github.com/apache/zeppelin/pull/2997) that fixes multiple problems and improves documentation. But it still not merged... (conflict occur afterwards - I'll rebase soon) -- With best wishes, Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: PRs for documentation?
Hello Jeff I know that problem with OSS projects - it's always not enough time :-( My changes are quite small, mostly formatting, and it would be nice to get them into 0.8 branch, as some documentation is really looks not accurate because of incorrect formatting. Regarding this one - should I open a separate PR against 0.8 to make it into release? On Wed, Jun 20, 2018 at 1:32 AM, Jianfeng (Jeff) Zhang < jzh...@hortonworks.com> wrote: > > It is not necessary to create ticket for document change if it is trivial > change, otherwise you still need to create ticket. > > Regarding the review, I am sorry that there¹s no much bandwidth to review > for committers, if there¹s no response in 3 days, please ping someone or > send mail in dev mail list. > > > > Best Regard, > Jeff Zhang > > > > > > On 6/19/18, 9:50 PM, "Alex Ott" wrote: > > >Hi all > > > >I have a question - should I file JIRA for documentation > >fixes/improvements? > >For example, I opened PR some time ago ( > >https://github.com/apache/zeppelin/pull/2997) that fixes multiple > problems > >and improves documentation. But it still not merged... (conflict occur > >afterwards - I'll rebase soon) > > > >-- > >With best wishes, Alex Ott > >http://alexott.net/ > >Twitter: alexott_en (English), alexott (Russian) > > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [DISCUSS] Adopt google-java-format
I personally think that this is great idea! I constantly hit by checkstyle :-) Jongyoul Lee at "Tue, 21 Aug 2018 15:57:28 +0900" wrote: JL> Hi devs, JL> We are using checkstyle and its maven plugin to check style. It looks JL> reasonable but I got a checkstyle violation since it's different from JL> IntelliJ's formatter setting of formatting lambda function. JL> Thus, how about adopting google-java-format in your IDE and its maven JL> plugin to fix formatter issues? JL> See https://github.com/google/google-java-format and JL> https://github.com/coveo/fmt-maven-plugin JL> It's, strictly, not a checker, but formatter as it changes wrong formats JL> when building it. JL> WDYT? -- With best wishes, Alex Ott http://alexott.blogspot.com/http://alexott.net/ http://alexott-ru.blogspot.com/ Skype: alex.ott
Can somebody review ZEPPELIN-4305 ?
Hi all After the merge with master today, the Zeppelin stopped working because of ZEPPELIN-4305 - can somebody review the changes & merge? Thank you -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
scio?
Hi all when trying to compile Zeppelin yesterday, I've noticed that Scio is hardcoded to use Scala 2.10 (and it's name also contains the Scala version), so Zeppelin doesn't compile with Scala 2.11 profile, although there is a Scio version for Scala 2.11. It also explicitly sets Java version to Java 7. I can't check JIRA right now - it's in maintenance - do we have a JIRA for improving Scio & Beam support? I can make initial change to make Scio not dependent on the Scala 2.10, and remove Java 7 configuration. What do you think? -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
[DISCUSS] Drop Scala 2.10 support
Hi all Scala 2.10 was released ~7 years ago, and latest release in that series was ~2 years ago. Right now most of the new products are built only for 2.11 & 2.12, so maybe it makes sense to remove support of Scala 2.10 in Zeppelin 0.9? Also, giving the fact that 2.11 was released almost 5 years ago - should be 2.12 a default target? -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [DISCUSS] Drop Scala 2.10 support
I'll create a JIRA to track it, and then we can look how we can make it... On Tue, Sep 10, 2019 at 3:31 PM Jeff Zhang wrote: > Thanks for raising this discussion, @Alex. I agree to drop supporting of > scala 2.10. > But I will prefer to make scala 2.11 as default. Because most of the > interpreter depends on scala 2.11. Although some interpreters support scala > 2.12 too, but scala 2.11 is still the most popular one I believe. Take > spark as example, spark 2.4.4 is the latest release of spark, its default > scala is still 2.11. > > One concern of dropping scala 2.10 is that it might break some interpreter, > such as beam, scalding, scio, I am not sure how much work needs to be done > to support scala 2.11 for these interpreters. And I am afraid the > maintainer of these interpreters are not active in community now. > > > > > > > Alex Ott 于2019年9月10日周二 下午7:47写道： > > > Hi all > > > > Scala 2.10 was released ~7 years ago, and latest release in that series > was > > ~2 years ago. > > Right now most of the new products are built only for 2.11 & 2.12, so > maybe > > it makes sense to remove support of Scala 2.10 in Zeppelin 0.9? > > > > Also, giving the fact that 2.11 was released almost 5 years ago - should > be > > 2.12 a default target? > > > > -- > > With best wishes,Alex Ott > > http://alexott.net/ > > Twitter: alexott_en (English), alexott (Russian) > > > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Debugging network(?) problems
Hi all I'm trying to make Ignite interpreter working correctly (it doesn't support Scala 2.10, only Scala 2.11), but having the troubles running it - unit tests are executed without problems, but when I run it in Zeppelin, I'm always getting following error: java.lang.RuntimeException: org.apache.thrift.transport.TTransportException at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:122) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:225) at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:497) at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:77) at org.apache.zeppelin.scheduler.Job.run(Job.java:172) at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:121) at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:187) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) Although I see that interpreter is starting without errors. First I thought that it happens because of the incorrect IP address for starting interpreter, but it fails with the same even if I bind it to localhost. Any tips that can help with debugging it? -- With best wishes, Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Debugging network(?) problems
Hi Jeff It was something strange with Ignite itself, or more precisely - with default configuration. When it's used, the process is exited with code 0 when trying to establish JDBC connection. I was able to run interpreter with another JDBC connection string, just to make sure that my changes are done correctly (PR will follow in few minutes). But we'll need to followup with better defaults, but it should be a separate JIRA. On Fri, Oct 4, 2019 at 9:14 AM Jeff Zhang wrote: > What do you see in the interpreter log ? I do see some network issue when I > enable my VPN > > Alex Ott 于2019年10月3日周四 下午11:29写道： > > > Hi all > > > > I'm trying to make Ignite interpreter working correctly (it doesn't > support > > Scala 2.10, only Scala 2.11), but having the troubles running it - unit > > tests are executed without problems, but when I run it in Zeppelin, I'm > > always getting following error: > > > > java.lang.RuntimeException: > org.apache.thrift.transport.TTransportException > > at > > > > > org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:122) > > at > > > > > org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:225) > > at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:497) at > > org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:77) at > > org.apache.zeppelin.scheduler.Job.run(Job.java:172) at > > > > > org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:121) > > at > > > > > org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:187) > > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > > > > Although I see that interpreter is starting without errors. > > > > First I thought that it happens because of the incorrect IP address for > > starting interpreter, but it fails with the same even if I bind it to > > localhost. > > > > Any tips that can help with debugging it? > > > > -- > > With best wishes,Alex Ott > > http://alexott.net/ > > Twitter: alexott_en (English), alexott (Russian) > > > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: KSQL interpreter
Hello Andrea I've started KSQL interpreter for a long time - it's linked to corresponding JIRA (ZEPPELIN-3548): https://github.com/alexott/zeppelin/tree/ZEPPELIN-3548-KSQL although it doesn't support OutputStream yet Andrea Santurbano at "Sun, 6 Oct 2019 22:08:52 +0200" wrote: AS> Hi guys, AS> I'm building a KQL interpreter. KSQL is the streaming SQL engine that AS> enables real-time data processing against Apache Kafka topics. AS> I created an interpreter that leverages the InterpreterOutputStream class AS> in order to stream the result from the backend to the frontend, but I get AS> the following representation in the frontend: AS> https://imgur.com/a/J7unk25 AS> What am I doing wrong? AS> Following the Interpreter implementation: AS> https://github.com/conker84/zeppelin/blob/kafka/kafka/src/main/java/org/apache/zeppelin/kafka/KafkaKSQLInterpreter.java AS> Thanks a lot AS> Andrea -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: KSQL interpreter
If you have time next week, let's discuss how we could merge things together... On Fri, Oct 11, 2019 at 6:34 PM Alex Ott wrote: > Hello Andrea > > I've started KSQL interpreter for a long time - it's linked to > corresponding JIRA (ZEPPELIN-3548): > https://github.com/alexott/zeppelin/tree/ZEPPELIN-3548-KSQL > > although it doesn't support OutputStream yet > > Andrea Santurbano at "Sun, 6 Oct 2019 22:08:52 +0200" wrote: > AS> Hi guys, > AS> I'm building a KQL interpreter. KSQL is the streaming SQL engine that > AS> enables real-time data processing against Apache Kafka topics. > AS> I created an interpreter that leverages the InterpreterOutputStream > class > AS> in order to stream the result from the backend to the frontend, but I > get > AS> the following representation in the frontend: > > AS> https://imgur.com/a/J7unk25 > > AS> What am I doing wrong? > > AS> Following the Interpreter implementation: > > AS> > https://github.com/conker84/zeppelin/blob/kafka/kafka/src/main/java/org/apache/zeppelin/kafka/KafkaKSQLInterpreter.java > > AS> Thanks a lot > > AS> Andrea > > > -- > With best wishes,Alex Ott > http://alexott.net/ > Twitter: alexott_en (English), alexott (Russian) > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Automatic update of the Helium registry doesn't work?
Hi all I've noticed that Helium registry ( https://s3.amazonaws.com/helium-package/helium.json) is still listing zeppelin-leaflet 1.0.4 as the latest, although 1.0.5 was released 5 months ago (https://www.npmjs.com/package/zeppelin-leaflet) with some improvements regarding omitting the points that have null value for one of the coordinates. As I understood from documentation, registry should be regenerated automatically on publish of the new versions, but this doesn't happen. How we can enforce it? -- With best wishes, Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Automatic update of the Helium registry doesn't work?
I've created https://issues.apache.org/jira/browse/ZEPPELIN-4433 to perform one time update of the helium registry & https://issues.apache.org/jira/browse/ZEPPELIN-4434 for setting up automated process for keeping it up to date. On Sun, Nov 3, 2019 at 4:43 PM moon soo Lee wrote: > cc ahyoung. Could you take a look?? And, any good idea how we can we move > helium.json and related code zeppelin project source tree? > > > On Sun, Nov 3, 2019 at 06:01 Jeff Zhang wrote: > > > + Moon > > > > I think helium.json on S3 is maintained by ZEPL, Moon should know the > > details. > > > > > > Alex Ott 于2019年11月3日周日 下午6:52写道： > > > > > Hi all > > > > > > I've noticed that Helium registry ( > > > https://s3.amazonaws.com/helium-package/helium.json) is still listing > > > zeppelin-leaflet 1.0.4 as the latest, although 1.0.5 was released 5 > > months > > > ago (https://www.npmjs.com/package/zeppelin-leaflet) with some > > > improvements > > > regarding omitting the points that have null value for one of the > > > coordinates. > > > > > > As I understood from documentation, registry should be regenerated > > > automatically on publish of the new versions, but this doesn't happen. > > > > > > How we can enforce it? > > > > > > -- > > > With best wishes,Alex Ott > > > http://alexott.net/ > > > Twitter: alexott_en (English), alexott (Russian) > > > > > > > > > -- > > Best Regards > > > > Jeff Zhang > > > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [DISCUSS] Drop support for Windows
Imho, having solid Docker support should solve the problem, as Windows is supported platform for Docker. Another possibility, but requires testing, is to use Windows Linux Subsystem... On Sun, Nov 10, 2019 at 2:38 PM Jeff Zhang wrote: > Hi Folks, > > I notice user encounter issues when running Zeppelin on Windows from time > to time. And actually we don't have CI for running Zeppelin on Windows, no > one know what the current status of Zeppelin on Windows. And I don't think > community have bandwidth to make sure Zeppelin running properly on Windows, > So I would like to suggest to officially drop support for Windows from 0.9. > Let me know your concerns. Thanks > > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Update apache shiro to 1.4.2
I've created ZEPPELIN-4472 for this On Mon, Dec 2, 2019 at 4:25 PM Jeff Zhang wrote: > I think it make sense to upgrade shiro, could you create a ticket for it. > And welcome to create a PR to make contribution to Zeppelin. > > 한병익 于2019年12月2日周一 下午9:38写道： > > > According to Apache Shiro official page's security-reports, there has > > vulnerability when using the default “Remember Me” configuration, cookies > > could be susceptible to a padding attack. > > > > Now, Zeppelin uses Apache Shiro version 1.3.2. I think it should be > > updated to 1.4.2. > > > > cf) https://shiro.apache.org/security-reports.html > > > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [DISCUSS] Create a preview for Zeppelin 0.9.0 before making RC
That's a great idea! Both tarball and docker would be useful On Mon, 16 Dec 2019, 15:24 Jeff Zhang, wrote: > Hi Folks, > > We have already done lots of works on 0.9.0, I think we should consider > about make a release for 0.9.0. But since Zeppelin is a very complicated > project considering its rich features, the regular process of testing it > for 3 days for each RC is too short in my opinion, so I suggest to create a > preview for each major release. Then the community has more time to test it > and we have more time to fix bugs and ensure the release quality. What do > you think ? > > > -- > Best Regards > > Jeff Zhang >
Re: [ANNOUNCE] Welcome Alex Ott as New Committer
Thank Thank you for introduction Jeff, and thank you all for greetings! I'm looking forward to make more contribution to this very interesting project! Prabhjyot Singh at "Sat, 11 Jan 2020 14:17:57 +0530" wrote: PS> Hello Alex, PS> Hearty Greetings and a very warm welcome to you. PS> On Sat, Jan 11, 2020, 2:16 PM Xun Liu wrote: PS> Hi, Alex Ott. PS> PS> Congratulations on becoming a committer of Apache Zeppelin !! PS> :-) PS> PS> On Sat, Jan 11, 2020 at 4:38 PM Jongyoul Lee wrote: PS> PS> That's really great!! PS> PS> I appreciate his activities against Apache Zeppelin and I'm really happy as PS> I have already known how difficult to contribute an opensource continuously. PS> PS> Please keep helping make Apache Zeppelin healthy. PS> PS> Regards, PS> JL PS> PS> 2020년 1월 7일 (화) 오후 6:48, Jeff Zhang 님이 작성: PS> >> The Project Management Committee (PMC) for Apache Zeppelin >> has invited Alex Ott to become a committer and we are very pleased >> to announce that he has accepted. >> >> We greatly appreciate all of Alex's hard work and generous contributions to >> the project. We look forward to continued involvement in the project. >> >> Congratulations & Welcome aboard Alex ! >> >> >> -- >> Best Regards >> >> Jeff Zhang >> PS> -- PS> 이종열, Jongyoul Lee, 李宗烈 PS> http://madeng.net -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [DISCUSS] Cut branch for 0.9 release
Hello Jeff What would be the policy for including newer stuff (committed into master after branch is cut) into 0.9? I really want to finish porting of Cassandra interpreter to new drivers as it will bring more functionality to our users. But it may take maybe 2 weeks more to finish it. Jeff Zhang at "Sun, 19 Jan 2020 23:56:29 +0800" wrote: JZ> Hi Folks, JZ> We have done lots of for 0.9 release in the last one year or on, I think it JZ> is time to prepare 0.9.0 release, so I suggest to cut a new branch for 0.9 JZ> release. Let me know your thoughts, and please create tickets targets for JZ> 0.9 under this umbrella ticket. JZ> As discussed before, we would create a preview for 0.9 first to ensure the JZ> quality of such major release. JZ> https://issues.apache.org/jira/browse/ZEPPELIN-4535 -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [DISCUSS] Cut branch for 0.9 release
Hi Jeff I'm planning to continue to work on it during next days, and will report status after that... On Thu, Feb 13, 2020 at 11:19 AM Jeff Zhang wrote: > Hi Alex, > > What is your progress of the Cassandra interpreter improvement ? Anyone > else please comment if you have any concerns. > > > Jeff Zhang 于2020年1月26日周日 下午8:07写道： > > > Hi Alex, > > > > We haven't officially define that, here' my understanding. > > After release branch is cut, only bug fix for zeppelin core modules > > (zeppelin-interpreter,zeppelin-zengine,zeppelin-server) should go to the > > release branch. > > Bug fix and improvement PR for interpreter modules also could go to > > release branch. > > For you case, the improvement for cassandra interpreter could still go to > > release branch after it is cut. > > > > Alex Ott 于2020年1月25日周六 下午7:16写道： > > > >> Hello Jeff > >> > >> What would be the policy for including newer stuff (committed into > master > >> after branch is cut) into 0.9? > >> > >> I really want to finish porting of Cassandra interpreter to new drivers > as > >> it will bring more functionality to our users. But it may take maybe 2 > >> weeks more to finish it. > >> > >> Jeff Zhang at "Sun, 19 Jan 2020 23:56:29 +0800" wrote: > >> JZ> Hi Folks, > >> > >> JZ> We have done lots of for 0.9 release in the last one year or on, I > >> think it > >> JZ> is time to prepare 0.9.0 release, so I suggest to cut a new branch > >> for 0.9 > >> JZ> release. Let me know your thoughts, and please create tickets > >> targets for > >> JZ> 0.9 under this umbrella ticket. > >> JZ> As discussed before, we would create a preview for 0.9 first to > >> ensure the > >> JZ> quality of such major release. > >> > >> JZ> https://issues.apache.org/jira/browse/ZEPPELIN-4535 > >> > >> > >> > >> -- > >> With best wishes,Alex Ott > >> http://alexott.net/ > >> Twitter: alexott_en (English), alexott (Russian) > >> > > > > > > -- > > Best Regards > > > > Jeff Zhang > > > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Autolink references in Github repo?
Hi all one question - who owns the Zeppelin repository at Github, or have administrative rights? It would be nice to configure Autolink references for Zeppelin repo to automatically create links to Jira for PRs, etc. I have very good experience of using them for my private projects... -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Autolink references in Github repo?
Ok. Thank you - I'll file Infra ticket On Mon, 2 Mar 2020, 03:37 moon soo Lee, wrote: > Hi, > > I don't have admin rights to GitHub repo but ASF Infra does. > Usually, configuration change on Github repo can be done by filing issues > to ASF infra https://issues.apache.org/jira/projects/INFRA. > > Let me know if anything else I can help here. > > Thanks! > moon > > > > On Sun, Mar 1, 2020 at 6:19 PM Jeff Zhang wrote: > > > + Moon > > > > Moon should have the admin right > > > > Alex Ott 于2020年3月2日周一 上午1:39写道： > > > >> Hi all > >> > >> one question - who owns the Zeppelin repository at Github, or have > >> administrative rights? It would be nice to configure Autolink references > >> for Zeppelin repo to automatically create links to Jira for PRs, etc. I > >> have very good experience of using them for my private projects... > >> > >> -- > >> With best wishes,Alex Ott > >> http://alexott.net/ > >> Twitter: alexott_en (English), alexott (Russian) > >> > > > > > > -- > > Best Regards > > > > Jeff Zhang > > >
Re: Autolink references in Github repo?
I've created https://issues.apache.org/jira/browse/INFRA-19934 for that On Mon, Mar 2, 2020 at 6:31 AM Alex Ott wrote: > Ok. Thank you - I'll file Infra ticket > > On Mon, 2 Mar 2020, 03:37 moon soo Lee, wrote: > >> Hi, >> >> I don't have admin rights to GitHub repo but ASF Infra does. >> Usually, configuration change on Github repo can be done by filing issues >> to ASF infra https://issues.apache.org/jira/projects/INFRA. >> >> Let me know if anything else I can help here. >> >> Thanks! >> moon >> >> >> >> On Sun, Mar 1, 2020 at 6:19 PM Jeff Zhang wrote: >> >> > + Moon >> > >> > Moon should have the admin right >> > >> > Alex Ott 于2020年3月2日周一 上午1:39写道： >> > >> >> Hi all >> >> >> >> one question - who owns the Zeppelin repository at Github, or have >> >> administrative rights? It would be nice to configure Autolink >> references >> >> for Zeppelin repo to automatically create links to Jira for PRs, etc. I >> >> have very good experience of using them for my private projects... >> >> >> >> -- >> >> With best wishes,Alex Ott >> >> http://alexott.net/ >> >> Twitter: alexott_en (English), alexott (Russian) >> >> >> > >> > >> > -- >> > Best Regards >> > >> > Jeff Zhang >> > >> > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Autolink references in Github repo?
the auto-linking was configured, and works now - you can see it at comment to https://github.com/apache/zeppelin/pull/3634 - unfortunately it works only for newly created/edited PRs On Sat, Mar 7, 2020 at 12:12 AM Jeff Zhang wrote: > Thanks Alex > > Alex Ott 于2020年3月7日周六 上午3:01写道： > >> I've created https://issues.apache.org/jira/browse/INFRA-19934 for that >> >> On Mon, Mar 2, 2020 at 6:31 AM Alex Ott wrote: >> >>> Ok. Thank you - I'll file Infra ticket >>> >>> On Mon, 2 Mar 2020, 03:37 moon soo Lee, wrote: >>> >>>> Hi, >>>> >>>> I don't have admin rights to GitHub repo but ASF Infra does. >>>> Usually, configuration change on Github repo can be done by filing >>>> issues >>>> to ASF infra https://issues.apache.org/jira/projects/INFRA. >>>> >>>> Let me know if anything else I can help here. >>>> >>>> Thanks! >>>> moon >>>> >>>> >>>> >>>> On Sun, Mar 1, 2020 at 6:19 PM Jeff Zhang wrote: >>>> >>>> > + Moon >>>> > >>>> > Moon should have the admin right >>>> > >>>> > Alex Ott 于2020年3月2日周一 上午1:39写道： >>>> > >>>> >> Hi all >>>> >> >>>> >> one question - who owns the Zeppelin repository at Github, or have >>>> >> administrative rights? It would be nice to configure Autolink >>>> references >>>> >> for Zeppelin repo to automatically create links to Jira for PRs, >>>> etc. I >>>> >> have very good experience of using them for my private projects... >>>> >> >>>> >> -- >>>> >> With best wishes,Alex Ott >>>> >> http://alexott.net/ >>>> >> Twitter: alexott_en (English), alexott (Russian) >>>> >> >>>> > >>>> > >>>> > -- >>>> > Best Regards >>>> > >>>> > Jeff Zhang >>>> > >>>> >>> >> >> -- >> With best wishes,Alex Ott >> http://alexott.net/ >> Twitter: alexott_en (English), alexott (Russian) >> > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [DISCUSS] Release for 0.9.0-preview-1
+1^10 Fred Dai at "Mon, 16 Mar 2020 09:06:49 -0700" wrote: FD> +1 👍 FD> On Mon, Mar 16, 2020 at 8:27 AM moon soo Lee wrote: >> Definitely +1 >> >> On Mon, Mar 16, 2020 at 8:02 AM Prabhjyot Singh >> wrote: >> >> > Yes, +1, we have put in a lot of features. We should do it soon. >> > >> > On Mon, Mar 16, 2020, 8:28 PM Yadong Xie wrote: >> > >> >> Big +1 >> >> >> >> Eric Pugh 于2020年3月16日周一 下午10:54写道： >> >> >> >> > Big +1 from me. >> >> > >> >> > >> >> > > On Mar 16, 2020, at 10:45 AM, Jeff Zhang wrote: >> >> > > >> >> > > Hi Folks, >> >> > > >> >> > > I'd like to start the discussion of releasing of 0.9.0-preview-1. As >> >> we >> >> > discussed before releasing a preview version first is suitable for a >> >> major >> >> > release based on our previous experience[1]. The last major release >> >> 0.8.0 >> >> > is in 2018, I do believe we should release 0.9 to allow more people >> try >> >> > that and gather feedback. What do you think ? >> >> > > >> >> > > >> >> > > [1] >> >> > >> >> >> https://lists.apache.org/thread.html/3812fd7dab53e1fed4140c826fc69fa5b718636371b6c7c677b4ae88%40%3Cdev.zeppelin.apache.org%3E >> >> > < >> >> > >> >> >> https://lists.apache.org/thread.html/3812fd7dab53e1fed4140c826fc69fa5b718636371b6c7c677b4ae88%40%3Cdev.zeppelin.apache.org%3E >> >> > > >> >> > > >> >> > > -- >> >> > > Best Regards >> >> > > >> >> > > Jeff Zhang >> >> > >> >> > ___ >> >> > Eric Pugh | Founder & CEO | OpenSource Connections, LLC | >> 434.466.1467 | >> >> > http://www.opensourceconnections.com < >> >> > http://www.opensourceconnections.com/> | My Free/Busy < >> >> > http://tinyurl.com/eric-cal> >> >> > Co-Author: Apache Solr Enterprise Search Server, 3rd Ed < >> >> > >> >> >> https://www.packtpub.com/big-data-and-business-intelligence/apache-solr-enterprise-search-server-third-edition-raw >> >> > >> >> > >> >> > This e-mail and all contents, including attachments, is considered to >> be >> >> > Company Confidential unless explicitly stated otherwise, regardless of >> >> > whether attachments are marked as such. >> >> > >> >> > >> >> >> > >> -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [VOTE] Release Apache Zeppelin 0.9.0-preview1 (RC1)
+1 from me (with note about netinst) I checked following: - downloaded all tgz artifacts & checked the checksums - run full distribution - tested spark & cassandra interpreters - built from source code The only failing thing is netinst package - you can't install interpreters from network as it looks for 0.9.0, and they aren't published. We need to emphasize this in the release announcement. On Mon, Mar 23, 2020 at 4:15 PM Jeff Zhang wrote: > Hi folks, > > I propose the following RC to be released for the Apache Zeppelin > 0.9.0-preview1 release. > > > The commit id is a74365c0813b451db1bc78def7d1ad1279429224 : > > https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=commit;h=a74365c0813b451db1bc78def7d1ad1279429224 > > This corresponds to the tag: v0.9.0-preview1-rc1 : > > https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=shortlog;h=refs/tags/v0.9.0-preview1-rc1 > > The release archives (tgz), signature, and checksums are here > > https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.9.0-preview1-rc1/ > > The release candidate consists of the following source distribution archive > zeppelin-v0.9.0-preview1.tgz > > In addition, the following supplementary binary distributions are provided > for user convenience at the same location > zeppelin-0.9.0-preview1-bin-all.tgz > > > The maven artifacts are here > > https://repository.apache.org/content/repositories/orgapachezeppelin-1276/org/apache/zeppelin/ > > You can find the KEYS file here: > https://dist.apache.org/repos/dist/release/zeppelin/KEYS > > Release notes available at > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12342692&styleName=&projectId=12316221 > > Vote will be open for next 72 hours (close at 7am 26/March PDT). > > [ ] +1 approve > [ ] 0 no opinion > [ ] -1 disapprove (and reason why) > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [ANNOUNCE] Apache Zeppelin 0.9.0-preview1 released
Wow - that's great! My congratulations to everyone! one question - who owns the ApacheZeppelin account on Twitter? Maybe make sense to write about release there as well? Jeff Zhang at "Sun, 29 Mar 2020 12:22:44 +0800" wrote: JZ> The Apache Zeppelin community is pleased to announce the availability of JZ> the 0.9.0-preview1 release. JZ> Zeppelin is a collaborative data analytics and visualization tool for JZ> distributed, general-purpose data processing system such as Apache Spark, JZ> Apache Flink, etc. JZ> This is another major release after the last major release 0.8.0 JZ> The community put significant effort into improving Apache Zeppelin since the last release. 568 tickets are resolved. JZ> We encourage you to download the latest release from JZ> http://zeppelin.apache.org/download.html JZ> Release note is available at JZ> http://zeppelin.apache.org/releases/zeppelin-release-0.9.0-preview1.html JZ> We welcome your help and feedback. For more information on the project and JZ> how to get involved, visit our website at http://zeppelin.apache.org/ JZ> Thank you all users and contributors who have helped to improve Apache JZ> Zeppelin. JZ> Here's some highlights of this major release JZ> 1. Java 8 Support (Remote JDK 7 Support) https://issues.apache.org/jira/browse/ZEPPELIN-621 JZ> 2. Plugin mechanism (https://jira.apache.org/jira/browse/ZEPPELIN-3196) JZ> 3. Paragraph level properties (https://jira.apache.org/jira/browse/ZEPPELIN-3348) JZ> 4. KSQL Interpreter (https://jira.apache.org/jira/browse/ZEPPELIN-3548) JZ> 5. Hazelcast Jet Interpreter (https://jira.apache.org/jira/browse/ZEPPELIN-3654) JZ> 6. Allow to specify saving resourceName as paragraph property (https://jira.apache.org/jira/browse/ZEPPELIN-3617) JZ> 7. Support Spark 2.4.x & Scala 2.12 (https://jira.apache.org/jira/browse/ZEPPELIN-3810) JZ> 8. Support Spark 3.0 https://issues.apache.org/jira/browse/ZEPPELIN-4510 JZ> 9. Add terminal interpreter (https://jira.apache.org/jira/browse/ZEPPELIN-4131) JZ> 10. Kotlin support for Spark interpreter (https://jira.apache.org/jira/browse/ZEPPELIN-4323) JZ> 11. Support more types of output for IPythonInterpreter (https://jira.apache.org/jira/browse/ZEPPELIN-4265) JZ> 12. K8S support https://issues.apache.org/jira/browse/ZEPPELIN-3840 JZ> 13. Bi-directional communication between ZeppelinServer & Interpreter process https://issues.apache.org/jira/browse/ZEPPELIN-2035 JZ> 14. Shaded zeppelin interpreter, so that we won’t hit the class not found issue in Spark interpreter https://issues.apache.org/jira/browse/ZEPPELIN-3689 JZ> 15. Zeppelin server cluster mode (HA) https://issues.apache.org/jira/browse/ZEPPELIN-3471 JZ> 16. Note file structure name is restructured. https://issues.apache.org/jira/browse/ZEPPELIN-2619 JZ> 17. Support Shiny App https://issues.apache.org/jira/browse/ZEPPELIN-4525 JZ> 18. Support Jupyter Interpreter https://issues.apache.org/jira/browse/ZEPPELIN-4480 JZ> 19. Support importing ipython notebook to Zeppelin https://issues.apache.org/jira/browse/ZEPPELIN-3033 JZ> 20. New Angular UI Preview https://issues.apache.org/jira/browse/ZEPPELIN-4321 JZ> Regards, JZ> The Apache Zeppelin community -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Docker images
Hi all I see on https://hub.docker.com/r/apache/zeppelin/tags that latest images are tagged as apache/zeppelin:0.9.0 - shouldn't we try to fix the tags to say that it's 0.9.0-preview1? -- With best wishes, Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Zeppelin Draft board report for April 2020
Looks great for me - do we have statistics on closed JIRA tickets? moon soo Lee at "Mon, 6 Apr 2020 09:21:26 -0700" wrote: msL> Thank Jeff for the draft. msL> Looks great to me. msL> On Mon, Apr 6, 2020 at 9:08 AM Jeff Zhang wrote: >> Hi Folks, >> >> >> Here's draft of Zeppelin Report, let me know if you have concerns. Thanks >> >> >> >> >> ## Description: >> >> - Apache Zeppelin is a collaborative data analytics and visualization >> tool >> >> for general-purpose data processing systems. >> >> >> >> ## Activity: >> >> - Zeppelin 0.9.0-preview1 is released in March, this is first time we have >> preview major release. Because based on our experience, it is always not >> possible do enough test and verification in 3 day's voting period because >> of the complexity of zeppelin. So we would like to make preview release for >> each major release. >> >> >> >> >> ## Health report: >> >> - +12 new code contributors since last report. 307 total >> >> ## PMC changes: >> >> - Currently 11 PMC members. >> >> - Last PMC addition was Jeff Zhang on Thu Jan 25 2018 >> >> ## Committer base changes: >> >> - Currently 19 committers. >> >> - Last committer addition was Alex Ott at Jan 1 2020 >> >> ## Releases: >> >> - 0.9.0-preview1 was released on March 26, 2020 >> >> - 0.8.2 was released on Wed Sep 29 2019 >> >> - 0.8.1 was released on Wed Jan 23 2019 >> >> - 0.8.0 was released on Wed Jul 18 2018 >> >> - 0.7.3 was released on Wed Sep 20 2017 >> >> - 0.7.2 was released on Mon Jun 12 2017 >> >> - 0.7.1 was released on Fri Mar 31 2017 >> >> - 0.7.0 was released on Sun Feb 05 2017 >> >> - 0.6.2 was released on Fri Oct 14 2016 >> >> - 0.6.1 was released on Aug 15 2016 >> >> - 0.6.0 was released on Jul 02 2016 >> >> - 0.5.6-incubating was released on Jan 22 2016 >> >> - 0.5.5-incubating was released on Nov 18 2015 >> >> - 0.5.0-incubating was released on Jul 23 2015 >> >> ## Mailing list activity: >> >> - us...@zeppelin.apache.org: >> >> - 122 emails sent to list ( 151 in previous quarter) >> >> - dev@zeppelin.apache.org: >> >> - 934 emails sent to list ( 923 in previous quarter) >> >> ## JIRA activity: >> >> - 175 JIRA tickets created in the last 3 months >> >> >> >> -- >> Best Regards >> >> Jeff Zhang >> -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [ANNOUNCE] Welcome Yadong Xie, Hsuan Lee as New Committer
Welcome Hsuan Lee and Yadong Xie- I'm looking forward working more closely with you! On Wed, Apr 29, 2020 at 4:03 PM Jeff Zhang wrote: > > The Project Management Committee (PMC) for Apache Zeppelin > has invited Yadong Xie and Hsuan Lee to become a committer and we are > very pleased > to announce that they have accepted. > > We greatly appreciate all of Yadong Xie and Hsuan Lee's hard work and > generous contributions to the project, especially on the new angular UI > implementation. We look forward to continued involvement in the project. > > Congratulations & Welcome aboard Yadong Xie and Hsuan Lee ! > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Broken HTML in Cassandra interpreter
Hi all I just created a https://issues.apache.org/jira/browse/ZEPPELIN-4787, but I'm not sure that I know how to fix it - the HTML output of Cassandra interpreter heavily relies on the navigation elements, and maybe changes in UI broke it. The HTML code is generated from such template: https://github.com/apache/zeppelin/blob/master/cassandra/src/main/resources/scalate/dropDownMenuForCluster.ssp Who can help me with that? It works in 0.8.2, but broken in 0.9.0-preview1 as well... -- With best wishes, Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Broken HTML in Cassandra interpreter
Hello Jeff Sorry, I forgot to mention that I attached screenshot to the Jira. The problem is that symbols that should be in the dropdown menu, are now are visible directly on the screen, etc. I suspect that the previous code relied on the internals of specific UI implementation, and after UI changes everything is broken, like this (fetching data from Cassandra itself works just fine): [image: Снимок экрана 2020-05-01 в 12.51.31.png] On Sat, May 2, 2020 at 9:52 AM Jeff Zhang wrote: > Hi Alex, > > Could you provide more info about how it is broken ? It looks like > cassandra interpreter need cassandra cluster first, is it possible to > reproduce it without cassandra cluster ? > > Alex Ott 于2020年5月1日周五 下午7:00写道： > > > Hi all > > > > I just created a https://issues.apache.org/jira/browse/ZEPPELIN-4787, > but > > I'm not sure that I know how to fix it - the HTML output of Cassandra > > interpreter heavily relies on the navigation elements, and maybe changes > in > > UI broke it. The HTML code is generated from such template: > > > > > https://github.com/apache/zeppelin/blob/master/cassandra/src/main/resources/scalate/dropDownMenuForCluster.ssp > > > > Who can help me with that? It works in 0.8.2, but broken in > 0.9.0-preview1 > > as well... > > > > -- > > With best wishes,Alex Ott > > http://alexott.net/ > > Twitter: alexott_en (English), alexott (Russian) > > > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Broken HTML in Cassandra interpreter
Hi all It looks like that something wrong with my setup - when I'm compiling the code manually, it has this problem, when I download the same release, everything works fine... Any suggestions on what I could look for? I've tried to compile from the completely different user, but result it the same :-( On Sat, May 2, 2020 at 9:56 AM Alex Ott wrote: > Hello Jeff > > Sorry, I forgot to mention that I attached screenshot to the Jira. > The problem is that symbols that should be in the dropdown menu, are now > are visible directly on the screen, etc. I suspect that the previous code > relied on the internals of specific UI implementation, and after UI changes > everything is broken, like this (fetching data from Cassandra itself works > just fine): > > [image: Снимок экрана 2020-05-01 в 12.51.31.png] > > On Sat, May 2, 2020 at 9:52 AM Jeff Zhang wrote: > >> Hi Alex, >> >> Could you provide more info about how it is broken ? It looks like >> cassandra interpreter need cassandra cluster first, is it possible to >> reproduce it without cassandra cluster ? >> >> Alex Ott 于2020年5月1日周五 下午7:00写道： >> >> > Hi all >> > >> > I just created a https://issues.apache.org/jira/browse/ZEPPELIN-4787, >> but >> > I'm not sure that I know how to fix it - the HTML output of Cassandra >> > interpreter heavily relies on the navigation elements, and maybe >> changes in >> > UI broke it. The HTML code is generated from such template: >> > >> > >> https://github.com/apache/zeppelin/blob/master/cassandra/src/main/resources/scalate/dropDownMenuForCluster.ssp >> > >> > Who can help me with that? It works in 0.8.2, but broken in >> 0.9.0-preview1 >> > as well... >> > >> > -- >> > With best wishes,Alex Ott >> > http://alexott.net/ >> > Twitter: alexott_en (English), alexott (Russian) >> > >> >> >> -- >> Best Regards >> >> Jeff Zhang >> > > > -- > With best wishes,Alex Ott > http://alexott.net/ > Twitter: alexott_en (English), alexott (Russian) > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Broken HTML in Cassandra interpreter
Just tested another setup - took 0.9.0 preview, replaced only interpreter and Scalatre templates - and everything works just fine: [image: Снимок экрана 2020-05-02 в 16.21.35.png] But when I compare with version compiled on my machine, I see following, and there is an error about "mode-undefined.js" not found - there is no such error in 0.9.0-preview1 [image: Снимок экрана 2020-05-02 в 16.10.45.png] On Sat, May 2, 2020 at 3:03 PM Alex Ott wrote: > Hi all > > It looks like that something wrong with my setup - when I'm compiling the > code manually, it has this problem, when I download the same release, > everything works fine... > > Any suggestions on what I could look for? I've tried to compile from the > completely different user, but result it the same :-( > > On Sat, May 2, 2020 at 9:56 AM Alex Ott wrote: > >> Hello Jeff >> >> Sorry, I forgot to mention that I attached screenshot to the Jira. >> The problem is that symbols that should be in the dropdown menu, are now >> are visible directly on the screen, etc. I suspect that the previous code >> relied on the internals of specific UI implementation, and after UI changes >> everything is broken, like this (fetching data from Cassandra itself works >> just fine): >> >> [image: Снимок экрана 2020-05-01 в 12.51.31.png] >> >> On Sat, May 2, 2020 at 9:52 AM Jeff Zhang wrote: >> >>> Hi Alex, >>> >>> Could you provide more info about how it is broken ? It looks like >>> cassandra interpreter need cassandra cluster first, is it possible to >>> reproduce it without cassandra cluster ? >>> >>> Alex Ott 于2020年5月1日周五 下午7:00写道： >>> >>> > Hi all >>> > >>> > I just created a https://issues.apache.org/jira/browse/ZEPPELIN-4787, >>> but >>> > I'm not sure that I know how to fix it - the HTML output of Cassandra >>> > interpreter heavily relies on the navigation elements, and maybe >>> changes in >>> > UI broke it. The HTML code is generated from such template: >>> > >>> > >>> https://github.com/apache/zeppelin/blob/master/cassandra/src/main/resources/scalate/dropDownMenuForCluster.ssp >>> > >>> > Who can help me with that? It works in 0.8.2, but broken in >>> 0.9.0-preview1 >>> > as well... >>> > >>> > -- >>> > With best wishes,Alex Ott >>> > http://alexott.net/ >>> > Twitter: alexott_en (English), alexott (Russian) >>> > >>> >>> >>> -- >>> Best Regards >>> >>> Jeff Zhang >>> >> >> >> -- >> With best wishes,Alex Ott >> http://alexott.net/ >> Twitter: alexott_en (English), alexott (Russian) >> > > > -- > With best wishes,Alex Ott > http://alexott.net/ > Twitter: alexott_en (English), alexott (Russian) > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Broken HTML in Cassandra interpreter
done, I always forget about this... On Sat, May 2, 2020 at 4:40 PM Jeff Zhang wrote: > Hi Alex, > > Apache mail list doesn't support inline display image attachment, could you > put them on the jira ? > > Alex Ott 于2020年5月2日周六 下午10:23写道： > > > Just tested another setup - took 0.9.0 preview, replaced only interpreter > > and Scalatre templates - and everything works just fine: > > [image: Снимок экрана 2020-05-02 в 16.21.35.png] > > But when I compare with version compiled on my machine, I see following, > > and there is an error about "mode-undefined.js" not found - there is no > > such error in 0.9.0-preview1 > > > > [image: Снимок экрана 2020-05-02 в 16.10.45.png] > > > > > > > > > > On Sat, May 2, 2020 at 3:03 PM Alex Ott wrote: > > > >> Hi all > >> > >> It looks like that something wrong with my setup - when I'm compiling > the > >> code manually, it has this problem, when I download the same release, > >> everything works fine... > >> > >> Any suggestions on what I could look for? I've tried to compile from the > >> completely different user, but result it the same :-( > >> > >> On Sat, May 2, 2020 at 9:56 AM Alex Ott wrote: > >> > >>> Hello Jeff > >>> > >>> Sorry, I forgot to mention that I attached screenshot to the Jira. > >>> The problem is that symbols that should be in the dropdown menu, are > now > >>> are visible directly on the screen, etc. I suspect that the previous > code > >>> relied on the internals of specific UI implementation, and after UI > changes > >>> everything is broken, like this (fetching data from Cassandra itself > works > >>> just fine): > >>> > >>> [image: Снимок экрана 2020-05-01 в 12.51.31.png] > >>> > >>> On Sat, May 2, 2020 at 9:52 AM Jeff Zhang wrote: > >>> > >>>> Hi Alex, > >>>> > >>>> Could you provide more info about how it is broken ? It looks like > >>>> cassandra interpreter need cassandra cluster first, is it possible to > >>>> reproduce it without cassandra cluster ? > >>>> > >>>> Alex Ott 于2020年5月1日周五 下午7:00写道： > >>>> > >>>> > Hi all > >>>> > > >>>> > I just created a > https://issues.apache.org/jira/browse/ZEPPELIN-4787, > >>>> but > >>>> > I'm not sure that I know how to fix it - the HTML output of > Cassandra > >>>> > interpreter heavily relies on the navigation elements, and maybe > >>>> changes in > >>>> > UI broke it. The HTML code is generated from such template: > >>>> > > >>>> > > >>>> > https://github.com/apache/zeppelin/blob/master/cassandra/src/main/resources/scalate/dropDownMenuForCluster.ssp > >>>> > > >>>> > Who can help me with that? It works in 0.8.2, but broken in > >>>> 0.9.0-preview1 > >>>> > as well... > >>>> > > >>>> > -- > >>>> > With best wishes,Alex Ott > >>>> > http://alexott.net/ > >>>> > Twitter: alexott_en (English), alexott (Russian) > >>>> > > >>>> > >>>> > >>>> -- > >>>> Best Regards > >>>> > >>>> Jeff Zhang > >>>> > >>> > >>> > >>> -- > >>> With best wishes,Alex Ott > >>> http://alexott.net/ > >>> Twitter: alexott_en (English), alexott (Russian) > >>> > >> > >> > >> -- > >> With best wishes,Alex Ott > >> http://alexott.net/ > >> Twitter: alexott_en (English), alexott (Russian) > >> > > > > > > -- > > With best wishes,Alex Ott > > http://alexott.net/ > > Twitter: alexott_en (English), alexott (Russian) > > > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
DISCUSS: New preview version?
Hi all 0.9.0-preview1 was released ~2 months ago, and since that time we've got many fixes, improvements, and new functionality. Maybe it makes sense to cut a new preview, so people can test it before we cut 0.9.0? -- With best wishes, Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Data formatting...
Hi all Yesterday I submitted the PR for Cassandra interpreter that introduces the options for customization of formatting of numbers & time-related types: https://github.com/apache/zeppelin/pull/3790 And now I'm thinking that such customizations could be useful in other interpreters as well, like, JDBC, z.show implementations in Spark & Flink, etc. Theoretically, it would be possible to extract this formatting code & share between interpreters. What do you think? -- With best wishes, Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Data formatting...
Hi all related question. I was thinking, maybe I over-complicate the implementation, and maybe I should use something like this instead: %cassandra(locale=ruRU, timeFormat="E, d MMM yy", floatPrecision = 5, outputFormat=cql) but it's parsed into 'd MMM yy"': 'd MMM yy"', 'floatPrecision': '5', 'timeFormat': '"E', 'locale': 'ruRU', 'outputFormat': 'cql' Who can point me where the parsing of the local context happens? Maybe it makes sense to add support for quoted values? On Mon, Jun 8, 2020 at 9:49 AM Alex Ott wrote: > Hi all > > Yesterday I submitted the PR for Cassandra interpreter that introduces the > options for customization of formatting of numbers & time-related types: > https://github.com/apache/zeppelin/pull/3790 > > And now I'm thinking that such customizations could be useful in other > interpreters as well, like, JDBC, z.show implementations in Spark & Flink, > etc. > Theoretically, it would be possible to extract this formatting code & > share between interpreters. What do you think? > > -- > With best wishes,Alex Ott > http://alexott.net/ > Twitter: alexott_en (English), alexott (Russian) > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Data formatting...
Thank you Jeff! I'll create a ticket, implement it & then rebase my changes on top of it - it will simplify the code of my PR as well On Tue, Jun 9, 2020 at 12:44 AM Jeff Zhang wrote: > Hi Alex, > > The parsing logic is here, agree that we should put them into > paragraph local properties and improve the parsing logic. > > > https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/ParagraphTextParser.java > > Alex Ott 于2020年6月9日周二 上午12:45写道： > > > Hi all > > > > related question. I was thinking, maybe I over-complicate the > > implementation, and maybe I should use something like this instead: > > > > %cassandra(locale=ruRU, timeFormat="E, d MMM yy", floatPrecision = 5, > > outputFormat=cql) > > > > but it's parsed into > > > > 'd MMM yy"': 'd MMM yy"', 'floatPrecision': '5', 'timeFormat': '"E', > > 'locale': 'ruRU', 'outputFormat': 'cql' > > > > Who can point me where the parsing of the local context happens? Maybe it > > makes sense to add support for quoted values? > > > > On Mon, Jun 8, 2020 at 9:49 AM Alex Ott wrote: > > > > > Hi all > > > > > > Yesterday I submitted the PR for Cassandra interpreter that introduces > > the > > > options for customization of formatting of numbers & time-related > types: > > > https://github.com/apache/zeppelin/pull/3790 > > > > > > And now I'm thinking that such customizations could be useful in other > > > interpreters as well, like, JDBC, z.show implementations in Spark & > > Flink, > > > etc. > > > Theoretically, it would be possible to extract this formatting code & > > > share between interpreters. What do you think? > > > > > > -- > > > With best wishes,Alex Ott > > > http://alexott.net/ > > > Twitter: alexott_en (English), alexott (Russian) > > > > > > > > > -- > > With best wishes,Alex Ott > > http://alexott.net/ > > Twitter: alexott_en (English), alexott (Russian) > > > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Best practices for unit/integration test
Hi all I was debugging multiple issues over the last day, and I've noticed that it's very hard to debug asserts like this: assertEquals(InterpreterResult.Code.SUCCESS, interpreterResult.code()); because it doesn't say what is the reason for it, just a difference. It would be much simpler to debug if we add the InterpreterResult as a first argument, so you can see exception, and stacktrace, like this: assertEquals(interpreterResult.toString(), InterpreterResult.Code.SUCCESS, interpreterResult.code()); P.S. I maybe can go through most of the tests and fix that - do we need to have JIRA for such changes? -- With best wishes, Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Data formatting...
Ok, PR for parsing change is sent: https://github.com/apache/zeppelin/pull/3799 On Tue, Jun 9, 2020 at 8:24 AM Alex Ott wrote: > Thank you Jeff! > > I'll create a ticket, implement it & then rebase my changes on top of it - > it will simplify the code of my PR as well > > On Tue, Jun 9, 2020 at 12:44 AM Jeff Zhang wrote: > >> Hi Alex, >> >> The parsing logic is here, agree that we should put them into >> paragraph local properties and improve the parsing logic. >> >> >> https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/ParagraphTextParser.java >> >> Alex Ott 于2020年6月9日周二 上午12:45写道： >> >> > Hi all >> > >> > related question. I was thinking, maybe I over-complicate the >> > implementation, and maybe I should use something like this instead: >> > >> > %cassandra(locale=ruRU, timeFormat="E, d MMM yy", floatPrecision = 5, >> > outputFormat=cql) >> > >> > but it's parsed into >> > >> > 'd MMM yy"': 'd MMM yy"', 'floatPrecision': '5', 'timeFormat': '"E', >> > 'locale': 'ruRU', 'outputFormat': 'cql' >> > >> > Who can point me where the parsing of the local context happens? Maybe >> it >> > makes sense to add support for quoted values? >> > >> > On Mon, Jun 8, 2020 at 9:49 AM Alex Ott wrote: >> > >> > > Hi all >> > > >> > > Yesterday I submitted the PR for Cassandra interpreter that introduces >> > the >> > > options for customization of formatting of numbers & time-related >> types: >> > > https://github.com/apache/zeppelin/pull/3790 >> > > >> > > And now I'm thinking that such customizations could be useful in other >> > > interpreters as well, like, JDBC, z.show implementations in Spark & >> > Flink, >> > > etc. >> > > Theoretically, it would be possible to extract this formatting code & >> > > share between interpreters. What do you think? >> > > >> > > -- >> > > With best wishes,Alex Ott >> > > http://alexott.net/ >> > > Twitter: alexott_en (English), alexott (Russian) >> > > >> > >> > >> > -- >> > With best wishes,Alex Ott >> > http://alexott.net/ >> > Twitter: alexott_en (English), alexott (Russian) >> > >> >> >> -- >> Best Regards >> >> Jeff Zhang >> > > > -- > With best wishes,Alex Ott > http://alexott.net/ > Twitter: alexott_en (English), alexott (Russian) > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [Announce] New Zeppelin Committer: Philipp Dallig
That's great news! Welcome aboard Philipp! On Fri, Jun 26, 2020 at 8:23 AM Jeff Zhang wrote: > > The Project Management Committee (PMC) for Apache Zeppelin > has invited Philipp Dallig to become a committer and we are very pleased > to announce that he has accepted. > > We greatly appreciate all of Philipp Dallig's hard work and generous > contributions to the project. We look forward to continued involvement in > the project. > > Congratulations & Welcome aboard Philipp Dallig ! > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC1)
I'm hitting https://issues.apache.org/jira/browse/ZEPPELIN-4787 in Cassandra interpreter, need to investigate why this happens - is it result of the Cassandra interpreter refactoring, or something else... Everything was fine in the preview1, and many templates weren't affected by refactoring, but are broken now. I would prefer to fix this for preview, but I need 1-2 days for investigation On Fri, Jul 17, 2020 at 5:25 PM Jeff Zhang wrote: > > Hi folks, > > I propose the following RC to be released for the Apache Zeppelin > 0.9.0-preview2 release. > > > The commit id is a74365c0813b451db1bc78def7d1ad1279429224 : > https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=commit;h=dd2058395ad4cf08fb6bdc901ec0c426c5095a94 > > This corresponds to the tag: v0.9.0-preview1-rc2 : > https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=shortlog;h=refs/tags/v0.9.0-preview2-rc1 > > The release archives (tgz), signature, and checksums are here > https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.9.0-preview2-rc1/ > > The release candidate consists of the following source distribution archive > zeppelin-v0.9.0-preview2.tgz > > In addition, the following supplementary binary distributions are provided > for user convenience at the same location zeppelin-0.9.0-preview2-bin-all.tgz > > > The maven artifacts are here > https://repository.apache.org/content/repositories/orgapachezeppelin-1279/org/apache/zeppelin/ > > You can find the KEYS file here: > https://dist.apache.org/repos/dist/release/zeppelin/KEYS > > Release notes available at > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12342692&styleName=&projectId=12316221 > > Vote will be open for next 72 hours (close at 8am 20/July PDT). > > [ ] +1 approve > [ ] 0 no opinion > [ ] -1 disapprove (and reason why) > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC1)
Hello Jeff I'm really not sure what has changed - templates weren't modified for a long time, basically, since their initial commit. I'm thinking about several things: - something happened because of the additional security, like, I see errors in the web console in Firefox that we can't load some javascript because of the nosniff policy - we're returning text/html for that javascript, and it's blocked - something happened if we updated any UI dependency - ARIA support is broken in browsers... - ... Anyway, I will need to go through the commits since preview1 to understand what has changed there, and what could give this behavior On Sat, Jul 18, 2020 at 3:43 PM Jeff Zhang wrote: > Thanks for the feedback, @Alex Ott , We can wait for > your fix, and everyone else can continue to test the preview2. > > > Alex Ott 于2020年7月18日周六 下午6:13写道： > >> I'm hitting https://issues.apache.org/jira/browse/ZEPPELIN-4787 in >> Cassandra interpreter, need to investigate why this happens - is it result >> of the Cassandra interpreter refactoring, or something else... Everything >> was fine in the preview1, and many templates weren't affected by >> refactoring, but are broken now. >> >> I would prefer to fix this for preview, but I need 1-2 days for >> investigation >> >> >> On Fri, Jul 17, 2020 at 5:25 PM Jeff Zhang wrote: >> >> > >> > Hi folks, >> > >> > I propose the following RC to be released for the Apache Zeppelin >> 0.9.0-preview2 release. >> > >> > >> > The commit id is a74365c0813b451db1bc78def7d1ad1279429224 : >> https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=commit;h=dd2058395ad4cf08fb6bdc901ec0c426c5095a94 >> > >> > This corresponds to the tag: v0.9.0-preview1-rc2 : >> https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=shortlog;h=refs/tags/v0.9.0-preview2-rc1 >> > >> > The release archives (tgz), signature, and checksums are here >> https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.9.0-preview2-rc1/ >> > >> > The release candidate consists of the following source distribution >> archive zeppelin-v0.9.0-preview2.tgz >> > >> > In addition, the following supplementary binary distributions are >> provided >> > for user convenience at the same location >> zeppelin-0.9.0-preview2-bin-all.tgz >> > >> > >> > The maven artifacts are here >> https://repository.apache.org/content/repositories/orgapachezeppelin-1279/org/apache/zeppelin/ >> > >> > You can find the KEYS file here: >> https://dist.apache.org/repos/dist/release/zeppelin/KEYS >> > >> > Release notes available at >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12342692&styleName=&projectId=12316221 >> > >> > Vote will be open for next 72 hours (close at 8am 20/July PDT). >> > >> > [ ] +1 approve >> > [ ] 0 no opinion >> > [ ] -1 disapprove (and reason why) >> > >> > >> > -- >> > Best Regards >> > >> > Jeff Zhang >> > >> >> >> -- >> With best wishes,Alex Ott >> http://alexott.net/ >> Twitter: alexott_en (English), alexott (Russian) >> > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC1)
Hi Jeff I didn't identify the root cause (I'm not a HTML/JavaScript developer), but I fixed the issue. PR is open: https://github.com/apache/zeppelin/pull/3858 - it's primarily HTML templates changes, so it could be merged quite fast, and then we can cut new RC. On Sat, Jul 18, 2020 at 3:43 PM Jeff Zhang wrote: > Thanks for the feedback, @Alex Ott , We can wait for > your fix, and everyone else can continue to test the preview2. > > > Alex Ott 于2020年7月18日周六 下午6:13写道： > >> I'm hitting https://issues.apache.org/jira/browse/ZEPPELIN-4787 in >> Cassandra interpreter, need to investigate why this happens - is it result >> of the Cassandra interpreter refactoring, or something else... Everything >> was fine in the preview1, and many templates weren't affected by >> refactoring, but are broken now. >> >> I would prefer to fix this for preview, but I need 1-2 days for >> investigation >> >> >> On Fri, Jul 17, 2020 at 5:25 PM Jeff Zhang wrote: >> >> > >> > Hi folks, >> > >> > I propose the following RC to be released for the Apache Zeppelin >> 0.9.0-preview2 release. >> > >> > >> > The commit id is a74365c0813b451db1bc78def7d1ad1279429224 : >> https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=commit;h=dd2058395ad4cf08fb6bdc901ec0c426c5095a94 >> > >> > This corresponds to the tag: v0.9.0-preview1-rc2 : >> https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=shortlog;h=refs/tags/v0.9.0-preview2-rc1 >> > >> > The release archives (tgz), signature, and checksums are here >> https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.9.0-preview2-rc1/ >> > >> > The release candidate consists of the following source distribution >> archive zeppelin-v0.9.0-preview2.tgz >> > >> > In addition, the following supplementary binary distributions are >> provided >> > for user convenience at the same location >> zeppelin-0.9.0-preview2-bin-all.tgz >> > >> > >> > The maven artifacts are here >> https://repository.apache.org/content/repositories/orgapachezeppelin-1279/org/apache/zeppelin/ >> > >> > You can find the KEYS file here: >> https://dist.apache.org/repos/dist/release/zeppelin/KEYS >> > >> > Release notes available at >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12342692&styleName=&projectId=12316221 >> > >> > Vote will be open for next 72 hours (close at 8am 20/July PDT). >> > >> > [ ] +1 approve >> > [ ] 0 no opinion >> > [ ] -1 disapprove (and reason why) >> > >> > >> > -- >> > Best Regards >> > >> > Jeff Zhang >> > >> >> >> -- >> With best wishes,Alex Ott >> http://alexott.net/ >> Twitter: alexott_en (English), alexott (Russian) >> > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC1)
Hi Jeff
I've found another issue in both rc1 & rc2 - if you don't specify the
SPARK_HOME, then the default Spark interpreter doesn't start with following
error if I execute the code for reading from Cassandra:
%spark
import org.apache.spark.sql.cassandra._
val data = spark.read.cassandraFormat("test", "test").load()
z.show(data)
org.apache.zeppelin.interpreter.InterpreterException:
java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStream
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:760)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:668)
at org.apache.zeppelin.scheduler.Job.run(Job.java:172)
at
org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
at
org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:39)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NoClassDefFoundError:
org/apache/hadoop/fs/FSDataInputStream
at org.apache.spark.SparkConf.loadFromSystemProperties(SparkConf.scala:76)
at org.apache.spark.SparkConf.(SparkConf.scala:71)
at org.apache.spark.SparkConf.(SparkConf.scala:58)
at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:80)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
... 8 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.fs.FSDataInputStream
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 13 more
ERROR
This works just fine in the preview1, without any additional configuration.
I remember that we had something around this already reported, but I can't
find JIRA
What do you think?
On Mon, Jul 20, 2020 at 3:54 PM Jeff Zhang wrote:
> Sorry, the blocker issue in spark interpreter is this one,
> https://issues.apache.org/jira/browse/ZEPPELIN-4962
>
>
> Jeff Zhang 于2020年7月20日周一 下午9:53写道：
>
>> Thanks Alex, I also found another blocker issue in spark interpreter.
>> https://issues.apache.org/jira/browse/ZEPPELIN-4912
>>
>> Folks,
>> I'd like to cancel this RC, and will prepare another RC after these 2
>> blocker issues.
>>
>>
>>
>> Alex Ott 于2020年7月20日周一 下午6:44写道：
>>
>>> Hi Jeff
>>>
>>> I didn't identify the root cause (I'm not a HTML/JavaScript developer),
>>> but I fixed the issue. PR is open:
>>> https://github.com/apache/zeppelin/pull/3858 - it's primarily HTML
>>> templates changes, so it could be merged quite fast, and then we can cut
>>> new RC.
>>>
>>>
>>> On Sat, Jul 18, 2020 at 3:43 PM Jeff Zhang wrote:
>>>
>>>> Thanks for the feedback, @Alex Ott , We can wait
>>>> for your fix, and everyone else can continue to test the preview2.
>>>>
>>>>
>>>> Alex Ott 于2020年7月18日周六 下午6:13写道：
>>>>
>>>>> I'm hitting https://issues.apache.org/jira/browse/ZEPPELIN-4787 in
>>>>> Cassandra interpreter, need to investigate why this happens - is it
>>>>> result
>>>>> of the Cassandra interpreter refactoring, or something else...
>>>>> Everything
>>>>> was fine in the preview1, and many templates weren't affected by
>>>>> refactoring, but are broken now.
>>>>>
>>>>> I would prefer to fix this for preview, but I need 1-2 days for
>>>>> investigation
>>>>>
>>>>>
>>>>> On Fri, Jul 17, 2020 at 5:25 PM Jeff Zhang wrote:
>>>>>
>>>>> >
>>>>> > Hi folks,
>>>>> >
>>>>> > I propose the following RC to be released for the Apache Zeppelin
>>>>> 0.9.0-preview2 release.
>>>>> >
>>>>> >
>>>>> > The commit id is a74365c0813b451db1bc78def7d1ad1279429224 :
>>>>> https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=commit;h=dd2058395ad4cf08fb6bdc901ec0c426c5095a94
>>>>> >
>>>>> > This corresponds to the tag: v0.9.0-preview1-rc2 :
>>>>> https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=shortlog;h=refs/tags/v0.9.0-prev
Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC1)
I didn't compile it myself, I just use binaries that Jeff created for
preview2. My point is that it worked out of box in preview1, and previous
versions, and should continue be the same, otherwise it's a very breaking
change that requires that people know about that...
On Tue, Jul 21, 2020 at 11:41 AM Philipp Dallig
wrote:
> Hi Alex,
> It seems that Hadoop classes are missing. Do you include Hadoop jars with
> "-P include-hadoop"?
> I think it's related to
> https://github.com/apache/zeppelin/commit/6fa79a9fc743f2b4321ac9e8713b3380bb4d64c9#diff-600376dffeb79835ede4a0b285078036.
>
>
> Philipp
>
>
> Am 21.07.20 um 11:28 schrieb Alex Ott:
>
> Hi Jeff
>
> I've found another issue in both rc1 & rc2 - if you don't specify the
> SPARK_HOME, then the default Spark interpreter doesn't start with following
> error if I execute the code for reading from Cassandra:
>
> %spark
>
> import org.apache.spark.sql.cassandra._
> val data = spark.read.cassandraFormat("test", "test").load()
> z.show(data)
>
>
>
> org.apache.zeppelin.interpreter.InterpreterException:
> java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStream
> at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:760)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:668)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:172)
> at
> org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
> at
> org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:39)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.NoClassDefFoundError:
> org/apache/hadoop/fs/FSDataInputStream
> at org.apache.spark.SparkConf.loadFromSystemProperties(SparkConf.scala:76)
> at org.apache.spark.SparkConf.(SparkConf.scala:71)
> at org.apache.spark.SparkConf.(SparkConf.scala:58)
> at
> org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:80)
> at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
> ... 8 more
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.fs.FSDataInputStream
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 13 more
> ERROR
>
> This works just fine in the preview1, without any additional
> configuration. I remember that we had something around this already
> reported, but I can't find JIRA
>
> What do you think?
>
>
>
> On Mon, Jul 20, 2020 at 3:54 PM Jeff Zhang wrote:
>
>> Sorry, the blocker issue in spark interpreter is this one,
>> https://issues.apache.org/jira/browse/ZEPPELIN-4962
>>
>>
>> Jeff Zhang 于2020年7月20日周一 下午9:53写道：
>>
>>> Thanks Alex, I also found another blocker issue in spark interpreter.
>>> https://issues.apache.org/jira/browse/ZEPPELIN-4912
>>>
>>> Folks,
>>> I'd like to cancel this RC, and will prepare another RC after these 2
>>> blocker issues.
>>>
>>>
>>>
>>> Alex Ott 于2020年7月20日周一 下午6:44写道：
>>>
>>>> Hi Jeff
>>>>
>>>> I didn't identify the root cause (I'm not a HTML/JavaScript developer),
>>>> but I fixed the issue. PR is open:
>>>> https://github.com/apache/zeppelin/pull/3858 - it's primarily HTML
>>>> templates changes, so it could be merged quite fast, and then we can cut
>>>> new RC.
>>>>
>>>>
>>>> On Sat, Jul 18, 2020 at 3:43 PM Jeff Zhang wrote:
>>>>
>>>>> Thanks for the feedback, @Alex Ott , We can wait
>>>>> for your fix, and everyone else can continue to test the preview2.
>>>>>
>>>>>
>>>>> Alex Ott 于2020年7月18日周六 下午6:13写道：
>>>>>
>>>>>> I'm hitting https://issues.apache.org/jira/browse/ZEPPELIN-4787 in
>>>>>> Cassandra interpreter, need to investigate why this happens - is it
>>>>>> result
>>>>>> of the Cassandra interpreter refactoring, or somet
Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC2)
+1 from me. What's done: - checked the checksum - run spark samples - tested cassandra interpreter - installed some plugins from helium registry On Thu, Jul 23, 2020 at 5:04 PM Jeff Zhang wrote: > > Hi folks, > > I propose the following RC to be released for the Apache Zeppelin > 0.9.0-preview2 release. > > > The commit id is 31b9ed51f946fed934885d8fbb29e9c183552e70 : > https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=commit;h=31b9ed51f946fed934885d8fbb29e9c183552e70 > > This corresponds to the tag: v0.9.0-preview2-rc2 : > https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=shortlog;h=refs/tags/v0.9.0-preview2-rc2 > > The release archives (tgz), signature, and checksums are here > https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.9.0-preview2-rc2/ > > The release candidate consists of the following source distribution archive > zeppelin-v0.9.0-preview2.tgz > > In addition, the following supplementary binary distributions are provided > for user convenience at the same location > zeppelin-0.9.0-preview2-bin-all.tgz > > > The maven artifacts are here > https://repository.apache.org/content/repositories/orgapachezeppelin-1283/org/apache/zeppelin/ > > You can find the KEYS file here: > https://dist.apache.org/repos/dist/release/zeppelin/KEYS > > Release notes available at > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12342692&styleName=&projectId=12316221 > > Vote will be open for next 72 hours (close at 8am 26/July PDT). > > [ ] +1 approve > [ ] 0 no opinion > [ ] -1 disapprove (and reason why) > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: K8s docker images
Hi Philipp That would be nice to do finally :-) from my side I'm ok with having only the latest one. Thank you for moving it forward! On Wed, Jul 29, 2020 at 1:11 PM Philipp Dallig wrote: > Hi Zeppelin developer, > > I would like to move forward the provision of docker images for Kubernetes. > > Right now we have three open PR: > > - https://github.com/apache/zeppelin/pull/3380 > - https://github.com/apache/zeppelin/pull/3769 > - https://github.com/apache/zeppelin/pull/3859 > > I would like to close PR 3380 and PR 3769 in favour for PR 3859. I also > want to close ZEPPELIN-4154 and create a new JIRA ticket for PR 3859. > > As written in PR 3859 I agree with Alex Ott that multiple interpreter > images are difficult to handle. > > Can I move forward in this matter, what are your thoughts? > > Best Regards > > Philipp Dallig > > > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Documentation for 0.9.0-preview 2
Hi I see that we have URL in documentation pointing to preview2: https://zeppelin.apache.org/docs/0.9.0-preview2/, but the banner still says "0.9.0-preview1" - how this could be changed? -- With best wishes, Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [ANNOUNCE] Apache Zeppelin 0.9.0-preview2 released
Hi all I wrote a small blog post about changes in the Cassandra interpreter that went into preview2: https://alexott.blogspot.com/2020/07/new-functionality-of-cassandra.html On Thu, Jul 30, 2020 at 10:59 AM Jeff Zhang wrote: > Hi Folks, > > The Apache Zeppelin community is pleased to announce the availability of the > 0.9.0-preview2 release. > Zeppelin is a collaborative data analytics and visualization tool for > distributed, general-purpose data processing system such as Apache Spark, > Apache Flink, etc. > > This is another preview release after the last preview release of 0.9.0 > The community put significant effort into improving Apache Zeppelin since the > last release. > > We encourage you to download the latest release > fromhttp://zeppelin.apache.org/download.html > > We welcome your help and feedback. For more information on the project and > how to get involved, visit our website at http://zeppelin.apache.org/ > > Thank you all users and contributors who have helped to improve Apache > Zeppelin. > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [Proposal] Zeppelin Client API (Zeppelin SDK)
Idea is very good - I think that we'll need to get several iterations of API refinement, but current approach looks promising. On Fri, Jul 24, 2020 at 5:54 PM Jeff Zhang wrote: > Hi Folks, > > I'd like to discuss this proposal with you about the zeppelin client api > (zeppelin sdk). > The background is that now Zeppelin’s main usage scenario is interactive > data analysis. Although it provides rest api, it is not easy for an > external system (e.g. scheduler system) to integrate Zeppelin for the > scenario where zeppelin is used as a backend job service. So I propose to > introduce a new module: Zeppelin client api (Zeppelin SDK), whose purpose > is to provide easy api for external systems to integrate zeppelin. > > I have created a google doc for the details, welcome any comments and > feedback. > > > https://docs.google.com/document/d/1bLLKKxleZlZpP9EFJlLLkJKwDBps-RNvzNwh3LFZWZ4/edit?usp=sharing > > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: [VOTE] Release Apache Zeppelin 0.9.0 (RC1)
+1 from me: checked the checksum for -bin-all, run tests for Cassandra interpreter. On Sun, Dec 20, 2020 at 9:26 AM Jeff Zhang wrote: > > Hi folks, > > I propose the following RC to be released for the Apache Zeppelin > 0.9.0 release. > > The commit id is 9b839b5ae34ce42a350a78ec40e762ddf904a480 : > > https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=commit;h=9b839b5ae34ce42a350a78ec40e762ddf904a480 > > This corresponds to the tag: v0.9.0-rc1 : > > https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=shortlog;h=refs/tags/v0.9.0-rc1 > > The release archives (tgz), signature, and checksums are here > https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.9.0-rc1/ > > The release candidate consists of the following source distribution archive > zeppelin-v0.9.0.tgz > > In addition, the following supplementary binary distributions are provided > for user convenience at the same location > zeppelin-0.9.0-bin-all.tgz > > > The maven artifacts are here > https://repository.apache.org/content/repositories/orgapachezeppelin-1285 > > You can find the KEYS file here: > https://dist.apache.org/repos/dist/release/zeppelin/KEYS > > Release notes available at > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12342692&styleName=&projectId=12316221 > > Vote will be open for next 72 hours (close at 1 am 23/Dec PDT). > > [ ] +1 approve > [ ] 0 no opinion > [ ] -1 disapprove (and reason why) > > -- > Best Regards > > Jeff Zhang > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
Re: Interpreter maintenance
Cassandra interpreter should just work with new dependency - there are enough tests to catch up problems during upgrade. Also, new versions of the driver don't bring a lot of things related to interpreter, so old version of the driver should just work. On Sun, Jan 2, 2022 at 3:43 PM Jongyoul Lee wrote: > Hello, > > I made a proposal for maintaining interpreters for the future. > - > https://cwiki.apache.org/confluence/display/ZEPPELIN/Interpreter+Maintenance > > Please check it and leave your comments freely on the thread of this > email, comments on the wiki, and the threads of the slack channel. > > References > - https://the-asf.slack.com/archives/C4RDKR51R/p1632495099017000 > - https://lists.apache.org/thread/cxzsortyypgh4mnydzxfnljfnwnv2t5c > > > Regards, > Jongyoul Lee > > -- > 이종열, Jongyoul Lee, 李宗烈 > http://madeng.net > -- With best wishes,Alex Ott http://alexott.net/ Twitter: alexott_en (English), alexott (Russian)
[jira] [Created] (ZEPPELIN-3443) Incorrect regex for 'DESCRIBE MATERIALIZED VIEW' in CQL Interpreter
Alex Ott created ZEPPELIN-3443:
--
Summary: Incorrect regex for 'DESCRIBE MATERIALIZED VIEW' in CQL
Interpreter
Key: ZEPPELIN-3443
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3443
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.7.3
Reporter: Alex Ott
Almost all regular expressions, except for {{DESCRIBE MATERIALIZED VIEW}} in
the CQL interpreter allow to have an optional space before closing {{;}}
character.
There is some code that uses these spaces before {{;}} character, so the
command fails when you copy/past commands.
I'll send PR to fix this trivial problem
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ZEPPELIN-3548) KSQL Interpreter for Zeppelin
Alex Ott created ZEPPELIN-3548: -- Summary: KSQL Interpreter for Zeppelin Key: ZEPPELIN-3548 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3548 Project: Zeppelin Issue Type: New Feature Affects Versions: 0.9.0 Reporter: Alex Ott KSQL provides access to data in Apache Kafka via SQL-like queries, allowing to access streaming data without explicit coding (https://www.confluent.io/product/ksql/). Having access to this data from Zeppelin would benefit many people working with streaming data. I'm starting to work on this integration, and will send PR as soon as will get working version of interpreter. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ZEPPELIN-4304) Allow to override useNativeGit property of the gitcommitid plugin
Alex Ott created ZEPPELIN-4304:
--
Summary: Allow to override useNativeGit property of the
gitcommitid plugin
Key: ZEPPELIN-4304
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4304
Project: Zeppelin
Issue Type: Improvement
Affects Versions: 0.9.0
Reporter: Alex Ott
the git commit id plugin exposes the {{useNativeGit}} property to control, if
it should use JGit ({{false}}), or native Git executable. Right now, Zeppelin
project explicitly set it to {{false}}, enforcing the JGit implementation.
The problem is that JGit doesn't work with {{git worktree}} checkouts that are
very handy to work with the several trees in parallel.
It would be nice to expose property that could be overridden from the
command-line, without modification of the {{pom.xml}}.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Created] (ZEPPELIN-4305) LocalStorageConfig.atomicWriteToFile incorrectly works with several mount points
Alex Ott created ZEPPELIN-4305:
--
Summary: LocalStorageConfig.atomicWriteToFile incorrectly works
with several mount points
Key: ZEPPELIN-4305
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4305
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.9.0
Reporter: Alex Ott
The hotfix made on 24th July, changed the code of that function to
{noformat}
file.getParentFile().mkdirs();
Files.move(tempFile.toPath(), destinationFilePath,
StandardCopyOption.ATOMIC_MOVE);
{noformat}
but this generates {{AtomicMoveNotSupportedException}} when temporary directory
is on separate disk as destination directory (like in my case, where {{/home}}
is on separate disk):
{noformat}
java.nio.file.AtomicMoveNotSupportedException:
/tmp/interpreter.json2988796503687403554.tmp ->
/home/ott/work/zeppelin/zeppelin-ksql/conf/interpreter.json: Invalid
cross-device link
at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:394)
at
sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
at java.nio.file.Files.move(Files.java:1395)
at
org.apache.zeppelin.storage.LocalConfigStorage.atomicWriteToFile(LocalConfigStorage.java:126)
at
org.apache.zeppelin.storage.LocalConfigStorage.save(LocalConfigStorage.java:59)
at
org.apache.zeppelin.interpreter.InterpreterSettingManager.saveToFile(InterpreterSettingManager.java:311)
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Created] (ZEPPELIN-4329) Fix problems with Scio interpreter when using non-default Scala profile
Alex Ott created ZEPPELIN-4329: -- Summary: Fix problems with Scio interpreter when using non-default Scala profile Key: ZEPPELIN-4329 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4329 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott Scio interpreter has a hardcoded Scala version in it's ID, so when we're using Scala 2.11 profile, the dependent modules, like, Beam aren't compiled. Also, Scio interpreter explicitly set Java version to 7, instead of using the project's settings. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ZEPPELIN-4330) Drop Scala 2.10 support
Alex Ott created ZEPPELIN-4330: -- Summary: Drop Scala 2.10 support Key: ZEPPELIN-4330 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4330 Project: Zeppelin Issue Type: Improvement Components: zeppelin-server Affects Versions: 0.9.0 Reporter: Alex Ott Right now, the default profile uses Scala 2.10 - this version was originally released ~7 years ago and latest release was done ~2 years ago. Also, many of the projects, stopped to release artifacts compiled for Scala 2.10. To improve support of newer versions of components we need to remove support of Scala 2.10, and use Scala 2.11 as default Scala version. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ZEPPELIN-4331) Update dependencies for the Cassandra interpreter
Alex Ott created ZEPPELIN-4331: -- Summary: Update dependencies for the Cassandra interpreter Key: ZEPPELIN-4331 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4331 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott Currently, the Cassandra interpreter uses very old version of the Datastax Java driver. It's recommended to update dependencies to get fixes & improvements available in the latest versions of the driver. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (ZEPPELIN-4359) Interpreter list is incorrect after recent changes in interpreter names
Alex Ott created ZEPPELIN-4359:
--
Summary: Interpreter list is incorrect after recent changes in
interpreter names
Key: ZEPPELIN-4359
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4359
Project: Zeppelin
Issue Type: Bug
Reporter: Alex Ott
After recent changes in the interpreter artifact names, the list of Maven
coordinates in the {{interpreter-list}} is incorrect.
P.S. I'll submit the PR after fixing names for Ignite interpreter
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4360) Ignite Interpreter requires Scala 2.11
Alex Ott created ZEPPELIN-4360:
--
Summary: Ignite Interpreter requires Scala 2.11
Key: ZEPPELIN-4360
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4360
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.9.0
Reporter: Alex Ott
The {{ignite-scalar}} library is compiled with Scala 2.11, so when the Zeppelin
is compiled with Scala 2.10, interpreter is broken.
Here is dependency in {{ignite-scalar:2.3.0}}:
{noformat}
org.scala-lang
scala-library
2.11.7
compile
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4377) Interpreter doesn't start if interpreter ID contains space
Alex Ott created ZEPPELIN-4377:
--
Summary: Interpreter doesn't start if interpreter ID contains space
Key: ZEPPELIN-4377
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4377
Project: Zeppelin
Issue Type: Bug
Components: zeppelin-interpreter
Reporter: Alex Ott
I was experimenting with JDBC interpreter for DSE's AlwaysOn SQL Service, and
created a new interpreter in UI that had the name "JDBC (AOSS)". When I did use
this interpreter in the notebook, the process didn't start because of the space
in the command:
{noformat}
java.lang.RuntimeException:
/Users/ott/work/zeppelin/zeppelin-head/bin/interpreter.sh: eval: line 231:
syntax error near unexpected token `('
/Users/ott/work/zeppelin/zeppelin-head/bin/interpreter.sh: eval: line 231:
`/Users/ott/.jenv/versions/1.8/bin/java -Dfile.encoding=UTF-8
-Dlog4j.configuration=file:///Users/ott/work/zeppelin/zeppelin-head/conf/log4j.properties
-Dzeppelin.log.file=/Users/ott/work/zeppelin/zeppelin-head/logs/zeppelin-interpreter-AOSS
(JDBC)-ott-thorium.local.log -Xms1024m -Xmx1024m -XX:MaxPermSize=512m -cp
:/Users/ott/work/zeppelin/zeppelin-head/local-repo/AOSS
(JDBC)/*:/Users/ott/work/zeppelin/zeppelin-head/interpreter/jdbc/*:/Users/ott/work/zeppelin/zeppelin-head/zeppelin-interpreter/target/lib/*::/Users/ott/work/zeppelin/zeppelin-head/zeppelin-interpreter/target/classes:/Users/ott/work/zeppelin/zeppelin-head/zeppelin-interpreter/target/test-classes:/Users/ott/work/zeppelin/zeppelin-head/zeppelin-zengine/target/test-classes
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer 10.151.0.177
55431 :'
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4378) Change Cassandra interpreter to use Java Driver 4.x
Alex Ott created ZEPPELIN-4378: -- Summary: Change Cassandra interpreter to use Java Driver 4.x Key: ZEPPELIN-4378 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4378 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott Assignee: Alex Ott DataStax drivers team released the new major version of the driver at the begin of 2019th - version 4. The new version makes driver more modular, brings more functionality and stability. The existing driver (3.x) is put into maintenance mode, so it won't receive new functionality - only bug fixes. The new driver also deprecates very outdated versions of Cassandra (older than 2.1). It would be nice to discuss the possibility of migrating Cassandra interpreter to a new driver. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4393) Cassandra interpreter doesn't support '--' comments
Alex Ott created ZEPPELIN-4393:
--
Summary: Cassandra interpreter doesn't support '--' comments
Key: ZEPPELIN-4393
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4393
Project: Zeppelin
Issue Type: Improvement
Components: Interpreters
Affects Versions: 0.9.0
Reporter: Alex Ott
Assignee: Alex Ott
CQL supports multiple variants of the up-to-end-of-line comments, including the
'--' in addition to '//'
(https://docs.datastax.com/en/dse/5.1/cql/cql/cql_using/cqlSyntax.html#Codecomments),
but Cassandra interpreter doesn't support this variant of the comment,
generating {{Error parsing input:}} error.
it would be nice to add a support for this kind of comment as well
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4433) Helium registry is not up to date...
Alex Ott created ZEPPELIN-4433: -- Summary: Helium registry is not up to date... Key: ZEPPELIN-4433 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4433 Project: Zeppelin Issue Type: Improvement Components: helium Affects Versions: 0.8.2, 0.9.0 Reporter: Alex Ott The https://s3.amazonaws.com/helium-package/helium.json wasn't regenerated for a long time. For example, it still listing zeppelin-leaflet 1.0.4 as the latest, although 1.0.5 was released 5 months ago (https://www.npmjs.com/package/zeppelin-leaflet) with some improvements regarding omitting the points that have null value for one of the coordinates. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4434) Setup a process for keeping helium registry up to date
Alex Ott created ZEPPELIN-4434: -- Summary: Setup a process for keeping helium registry up to date Key: ZEPPELIN-4434 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4434 Project: Zeppelin Issue Type: Improvement Components: helium Reporter: Alex Ott Related to ZEPPELIN-4433 - we need to have an automated process for keeping helium.json up to date with latest releases of packages for Helium. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4444) Execution of DDL statements could lead to the schema disagreement in Cassandra
Alex Ott created ZEPPELIN-: -- Summary: Execution of DDL statements could lead to the schema disagreement in Cassandra Key: ZEPPELIN- URL: https://issues.apache.org/jira/browse/ZEPPELIN- Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.8.2, 0.9.0 Reporter: Alex Ott When executing DDL statements (CREATE/ALTER/DROP) it's possible get schema disagreement in Cassandra, especially for big/geo-distributed clusters. Java drivers has a special handling of such statements, with increased timeout, but it's still possible that next DDL statement will be executed before all nodes agree on the schema version. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4472) Upgrade shiro to latest version (1.4.2) to fix existing CVEs
Alex Ott created ZEPPELIN-4472: -- Summary: Upgrade shiro to latest version (1.4.2) to fix existing CVEs Key: ZEPPELIN-4472 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4472 Project: Zeppelin Issue Type: Improvement Components: security Reporter: Alex Ott -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4700) Cleanup Maven warnings
Alex Ott created ZEPPELIN-4700:
--
Summary: Cleanup Maven warnings
Key: ZEPPELIN-4700
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4700
Project: Zeppelin
Issue Type: Improvement
Components: build
Affects Versions: 0.9.0
Reporter: Alex Ott
Assignee: Alex Ott
When using Maven, it generates a lot of messages like this:
{noformat}
[WARNING] Some problems were encountered while building the effective model for
org.apache.zeppelin:zeppelin-jupyter-interpreter-shaded:jar:0.9.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for
org.apache.maven.plugins:maven-shade-plugin is missing. @ line 61, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.zeppelin:spark-interpreter:jar:0.9.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found
duplicate declaration of plugin
com.googlecode.maven-download-plugin:download-maven-plugin @ line 411, column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found
duplicate declaration of plugin org.apache.maven.plugins:maven-resources-plugin
@ line 591, column 15
...
{noformat}
that would be nice to fix...
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4701) some zeppelin-web-angular files doesn't have license header
Alex Ott created ZEPPELIN-4701: -- Summary: some zeppelin-web-angular files doesn't have license header Key: ZEPPELIN-4701 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4701 Project: Zeppelin Issue Type: Improvement Components: front-end Affects Versions: 0.9.0 Reporter: Alex Ott The new rat plugin (0.13) is able to detect missing license in the TypeScript files, and following TS files doesn't have it, failing the build with newer version of plugin: * zeppelin-web-angular/e2e/src/app.e2e-spec.ts * zeppelin-web-angular/e2e/src/app.po.ts * zeppelin-web-angular/src/app/pages/workspace/published/published.module.ts * zeppelin-web-angular/src/app/services/shortcut.service.ts -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4706) Investigate why upgrade of Maven plugins fail the tests
Alex Ott created ZEPPELIN-4706: -- Summary: Investigate why upgrade of Maven plugins fail the tests Key: ZEPPELIN-4706 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4706 Project: Zeppelin Issue Type: Improvement Components: build Affects Versions: 0.9.0 Reporter: Alex Ott as part of ZEPPELIN-4700, it was attempted to bump versions of surefire & other plugins, but this lead to failure of multiple Spark tests (https://travis-ci.org/github/alexott/zeppelin/builds/668604896). After reverting surefire plugin back to 2.17 (from 2.22.2), these tests are passing (https://travis-ci.org/github/alexott/zeppelin/builds/668812389). it would be useful to understand what causes this behavior as it could be a sign of flaky tests. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4756) Cassandra: by default show "no results" message folded
Alex Ott created ZEPPELIN-4756: -- Summary: Cassandra: by default show "no results" message folded Key: ZEPPELIN-4756 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4756 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott Assignee: Alex Ott When the CQL command doesn't produce results, we show "no results" table that includes list of the tried hosts, coordinator, achieved consistency level, etc. But this information occupies significant amount of the screen space without bringing useful information. It would be useful to make the template foldable, fold it by default (based on the value of the setting in interpreter). P.S. This should be done after merging of the ZEPPELIN-4378 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4757) Fix startup script errors/warnings
Alex Ott created ZEPPELIN-4757:
--
Summary: Fix startup script errors/warnings
Key: ZEPPELIN-4757
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4757
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.9.0
Reporter: Alex Ott
Assignee: Alex Ott
When starting {{zeppelin.sh}} on the Mac OS I got following error messages &
warnings:
{noformat}
bin/zeppelin.sh: line 27: getent: command not found
Container ENTRYPOINT failed to add passwd entry for anonymous UID
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was
removed in 8.0
{noformat}
it would be nice to fix them before release.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4758) Additional cleanup for Java 8 support
Alex Ott created ZEPPELIN-4758:
--
Summary: Additional cleanup for Java 8 support
Key: ZEPPELIN-4758
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4758
Project: Zeppelin
Issue Type: Bug
Components: build
Affects Versions: 0.9.0
Reporter: Alex Ott
Right now, there are a number of places where we get messages similar to this:
{noformat}
[WARNING] OpenJDK 64-Bit Server VM warning: ignoring option PermSize=64m;
support was removed in 8.0
[WARNING] OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
support was removed in 8.0
{noformat}
it would be useful to remove outdated configuration options, etc. for cleaner
support of Java 8
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4772) Use local configuration for Quartz scheduler
Alex Ott created ZEPPELIN-4772:
--
Summary: Use local configuration for Quartz scheduler
Key: ZEPPELIN-4772
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4772
Project: Zeppelin
Issue Type: Bug
Components: zeppelin-server
Reporter: Alex Ott
right now, check for updates of quart scheduler is configured via system
property, but it could be configured via "local" property passed during
creation of scheduler, like this:
{noformat}
Properties schedulerProperties = new Properties();
schedulerProperties.setProperty(StdSchedulerFactory.PROP_SCHED_SKIP_UPDATE_CHECK,
"true");
return new StdSchedulerFactory(schedulerProperties).getScheduler();
{noformat}
but during ZEPPELIN-4695 it was tried and lead to failing tests. We need to
investigate why this happens.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4787) HTML output in Cassandra interpreter is broken
Alex Ott created ZEPPELIN-4787: -- Summary: HTML output in Cassandra interpreter is broken Key: ZEPPELIN-4787 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4787 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott Attachments: Снимок экрана 2020-05-01 в 12.51.31.png HTML output Cassandra interpreter in current master produces mangled view, like on attached screenshot. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4789) Interpreter for PlantUML
Alex Ott created ZEPPELIN-4789: -- Summary: Interpreter for PlantUML Key: ZEPPELIN-4789 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4789 Project: Zeppelin Issue Type: New Feature Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott [PlantUML|https://plantuml.com/] is a tool for creating different diagrams (UML, etc.) using the text markup. It would be useful to add a support for PlantUML to Zeppelin to create diagrams in documents. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4791) Java version check in common.sh on generates an error on MacOS
Alex Ott created ZEPPELIN-4791: -- Summary: Java version check in common.sh on generates an error on MacOS Key: ZEPPELIN-4791 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4791 Project: Zeppelin Issue Type: Bug Affects Versions: 0.9.0 Reporter: Alex Ott -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4792) Help needs to be updated in Cassandra interpreter
Alex Ott created ZEPPELIN-4792: -- Summary: Help needs to be updated in Cassandra interpreter Key: ZEPPELIN-4792 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4792 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott HELP wasn't updated in Cassandra interpreter during migration to the new Java driver. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4793) Can't visualize graph data in Zeppelin
Alex Ott created ZEPPELIN-4793:
--
Summary: Can't visualize graph data in Zeppelin
Key: ZEPPELIN-4793
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4793
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.9.0
Reporter: Alex Ott
When trying to answer [following question on
SO|https://stackoverflow.com/questions/61570214/how-to-visualize-graph-with-network-in-zeppelin],
I've found a problem with visualization of network data, although generated
data looks correct. It even don't work with following graph, although work fine
if I don't specify {{edges}}:
{noformat}
%spark
print(s"""
%network {
"nodes": [{"id":"a","label":"person","data":{"name":"Alice","age":34}},
{"id":"b","label":"person","data":{"name":"Bob","age":36}},
{"id":"c","label":"person","data":{"name":"Charlie","age":30}},
{"id":"d","label":"person","data":{"name":"David","age":29}},
{"id":"e","label":"person","data":{"name":"Esther","age":32}},
{"id":"f","label":"person","data":{"name":"Fanny","age":36}},
{"id":"g","label":"person","data":{"name":"Gabby","age":60}}],
"edges": [{"source":"a", "target":"b", "id":"ab"}]
}
""")
{noformat}
In web console shows following error:
{noformat}
Graph drawing error TypeError: "d.source is undefined"
start vendor.f209b9124a2273d7.js:97
value visualization-d3network.js:149
l result.controller.js:684
V result.controller.js:231
oe result.controller.js:730
renderDefaultDisplay result.controller.js:347
n result.controller.js:226
j vendor.f209b9124a2273d7.js:38
f vendor.f209b9124a2273d7.js:36
c vendor.f209b9124a2273d7.js:36
result.controller.js:701:18
l result.controller.js:701
V result.controller.js:231
oe result.controller.js:730
renderDefaultDisplay result.controller.js:347
n result.controller.js:226
j vendor.f209b9124a2273d7.js:38
f vendor.f209b9124a2273d7.js:36
c vendor.f209b9124a2273d7.js:36
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4796) Better representation of string-like data in Cassandra interpreter
Alex Ott created ZEPPELIN-4796: -- Summary: Better representation of string-like data in Cassandra interpreter Key: ZEPPELIN-4796 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4796 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott Assignee: Alex Ott With a new driver, columns with string-like data are formatted with single quotes around them, that make data representation look not very good (if they are actual columns, not collections, etc.). It would be useful to allow to control. should we output data in CQL syntax, or strip the single quotes around data - that would be useful for plotting, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4815) Expand Zeppelin on K8S documentation with more configuration examples
Alex Ott created ZEPPELIN-4815: -- Summary: Expand Zeppelin on K8S documentation with more configuration examples Key: ZEPPELIN-4815 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4815 Project: Zeppelin Issue Type: Improvement Components: documentation Affects Versions: 0.9.0 Reporter: Alex Ott Important aspects of the running on kubernetes in production is configuration of different security properties, especially for accessing to external systems - passwords, key/trust stores, etc. It would be very useful to expand Kubernetes-related documentation with more examples showing how to do this. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4817) Simplify support of DataStax Astra to Cassandra interpreter
Alex Ott created ZEPPELIN-4817: -- Summary: Simplify support of DataStax Astra to Cassandra interpreter Key: ZEPPELIN-4817 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4817 Project: Zeppelin Issue Type: New Feature Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott DataStax Astra is a cloud version of Apache Cassandra. It could be used right now, but the process is quite convoluted, as you need to extract & convert certificates, and other information used for connection. Java driver for Cassandra [provides simplified way for configuration that could be used instead|https://docs.datastax.com/en/developer/java-driver/4.6/manual/cloud/] - to use it, we just need to add one configuration parameter to interpreter configuration, and use it. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4818) Additional refactoring of Cassandra interpreter for new driver versions
Alex Ott created ZEPPELIN-4818: -- Summary: Additional refactoring of Cassandra interpreter for new driver versions Key: ZEPPELIN-4818 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4818 Project: Zeppelin Issue Type: Improvement Reporter: Alex Ott Newer version of Java driver for Cassandra bring a number of improvements, like, configuration via OptionsMap, etc. - some of them could simplify the code of the interpreter, or make it more stable. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4821) Spark interpreter uses incorrect property name for Spark master
Alex Ott created ZEPPELIN-4821: -- Summary: Spark interpreter uses incorrect property name for Spark master Key: ZEPPELIN-4821 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4821 Project: Zeppelin Issue Type: Bug Components: spark Affects Versions: 0.9.0 Reporter: Alex Ott -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4824) Interpreter API should provide a method for updating of one setting in specific interpreter
Alex Ott created ZEPPELIN-4824: -- Summary: Interpreter API should provide a method for updating of one setting in specific interpreter Key: ZEPPELIN-4824 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4824 Project: Zeppelin Issue Type: Improvement Components: rest-api Affects Versions: 0.9.0 Reporter: Alex Ott It would be useful to add a REST API endpoint to set value of specific property to a given value. Right now we need to submit the whole properties parameters if we want to update. We also need to be able to merge the new setting with previous parameters, like, don't overwrite description if no description was provided in submission, etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4841) KSQL interpreter doesn't work with Confluent 5.5.0
Alex Ott created ZEPPELIN-4841:
--
Summary: KSQL interpreter doesn't work with Confluent 5.5.0
Key: ZEPPELIN-4841
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4841
Project: Zeppelin
Issue Type: Improvement
Components: Interpreters
Affects Versions: 0.9.0
Reporter: Alex Ott
KSQL Interpreter is broken in the 0.9.0-preview1.
When executing with KSQL on Confluent 5.5.0
{noformat}
%ksql
select * from tweets_txt EMIT CHANGES;
{noformat}
I'm getting following error:
{noformat}
java.lang.RuntimeException:
com.fasterxml.jackson.databind.exc.MismatchedInputException: Cannot deserialize
instance of `java.util.LinkedHashMap` out of START_ARRAY token
at [Source: (String)"[{"header":{"queryId":"none","schema":"`ROWTIME` BIGINT,
`ROWKEY` STRING, `LANG` STRING, `ID` BIGINT, `TEXT` STRING, `EVENT_TS`
STRING"}},"; line: 1, column: 1]
at
org.apache.zeppelin.ksql.KSQLRestService$1.onMessage(KSQLRestService.java:140)
at
org.apache.zeppelin.ksql.BasicKSQLHttpClient.connectAsync(BasicKSQLHttpClient.java:101)
at
org.apache.zeppelin.ksql.KSQLRestService.executeSelect(KSQLRestService.java:128)
at
org.apache.zeppelin.ksql.KSQLRestService.executeQuery(KSQLRestService.java:70)
at
org.apache.zeppelin.ksql.KSQLInterpreter.executeQuery(KSQLInterpreter.java:119)
at
org.apache.zeppelin.ksql.KSQLInterpreter.interpret(KSQLInterpreter.java:108)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:110)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:684)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:577)
at org.apache.zeppelin.scheduler.Job.run(Job.java:172)
at
org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
at
org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:39)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.fasterxml.jackson.databind.exc.MismatchedInputException: Cannot
deserialize instance of `java.util.LinkedHashMap` out of START_ARRAY token
at [Source: (String)"[{"header":{"queryId":"none","schema":"`ROWTIME` BIGINT,
`ROWKEY` STRING, `LANG` STRING, `ID` BIGINT, `TEXT` STRING, `EVENT_TS`
STRING"}},"; line: 1, column: 1]
at
com.fasterxml.jackson.databind.exc.MismatchedInputException.from(MismatchedInputException.java:63)
at
com.fasterxml.jackson.databind.DeserializationContext.reportInputMismatch(DeserializationContext.java:1343)
at
com.fasterxml.jackson.databind.DeserializationContext.handleUnexpectedToken(DeserializationContext.java:1139)
at
com.fasterxml.jackson.databind.DeserializationContext.handleUnexpectedToken(DeserializationContext.java:1093)
at
com.fasterxml.jackson.databind.deser.std.StdDeserializer._deserializeFromEmpty(StdDeserializer.java:600)
at
com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:360)
at
com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:29)
at
com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4013)
at
com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3004)
at
org.apache.zeppelin.ksql.KSQLRestService$1.onMessage(KSQLRestService.java:132)
... 14 more
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4860) Non-determenistic results in SparqlJenaEngineTest
Alex Ott created ZEPPELIN-4860:
--
Summary: Non-determenistic results in SparqlJenaEngineTest
Key: ZEPPELIN-4860
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4860
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.9.0
Reporter: Alex Ott
flaky test in SparqlJenaEngineTest
{noformat}
Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 2.564 sec <<<
FAILURE! - in org.apache.zeppelin.sparql.SparqlJenaEngineTest
testRemoteEndpoint(org.apache.zeppelin.sparql.SparqlJenaEngineTest) Time
elapsed: 0.814 sec <<< FAILURE!
org.junit.ComparisonFailure:
expected:<...ksw.com/schemas/virt[rdf#QuadMapFormat]>
> but was:<...ksw.com/schemas/virt[cxml#FacetCategoryPattern]>
>
at org.junit.Assert.assertEquals(Assert.java:115)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.zeppelin.sparql.SparqlJenaEngineTest.testRemoteEndpoint(SparqlJenaEngineTest.java:174)
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4861) R-related tests are failing because r-sources is not allowed
Alex Ott created ZEPPELIN-4861:
--
Summary: R-related tests are failing because r-sources is not
allowed
Key: ZEPPELIN-4861
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4861
Project: Zeppelin
Issue Type: Bug
Components: build
Affects Versions: 0.9.0
Reporter: Alex Ott
{noformat}
Disallowing sources: r-source
To add unlisted APT sources, follow instructions in
https://docs.travis-ci.com/user/installing-dependencies#Installing-Packages-with-the-APT-Addon
0.42s$ curl -sSL
"keyserver.ubuntu.com/pks/lookup?op=get&search=0x51716619E084DAB9" | sudo -E
apt-key add -
OK
0.01s$ echo "deb http://cran.rstudio.com/bin/linux/ubuntu trusty/" | sudo tee
-a ${TRAVIS_ROOT}/etc/apt/sources.list >/dev/null
0.40s$ curl -sSL "https://build.travis-ci.org/files/gpg/r-packages-trusty.asc";
| sudo -E apt-key add -
OK
0.01s$ echo "deb http://cran.rstudio.com/bin/linux/ubuntu trusty/" | sudo tee
-a ${TRAVIS_ROOT}/etc/apt/sources.list >/dev/null
0.51s
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4864) Cleanup Travis-CI config
Alex Ott created ZEPPELIN-4864:
--
Summary: Cleanup Travis-CI config
Key: ZEPPELIN-4864
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4864
Project: Zeppelin
Issue Type: Improvement
Affects Versions: 0.9.0
Reporter: Alex Ott
Travis-CI config contains a number of configuration options still related to
trusty, while the builds are done with xenial:
{noformat}
- r-source
- sourceline: 'deb http://cran.rstudio.com/bin/linux/ubuntu trusty/'
key_url:
'keyserver.ubuntu.com/pks/lookup?op=get&search=0x51716619E084DAB9'
- r-packages-trusty
- mysql-5.7-trusty
{noformat}
It makes sense to cleanup that stuff
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4870) Improve parsing of the paragraph properties
Alex Ott created ZEPPELIN-4870:
--
Summary: Improve parsing of the paragraph properties
Key: ZEPPELIN-4870
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4870
Project: Zeppelin
Issue Type: Improvement
Components: zeppelin-zengine
Affects Versions: 0.9.0
Reporter: Alex Ott
Right now, local paragraph properties doesn't support parsing of the values
that contain comma, even if it's put into the quotes:
for example, the following:
{noformat}
%cassandra(locale=ruRU, timeFormat="E, d MMM yy", floatPrecision = 5,
outputFormat=cql)
{noformat}
is parsed into:
{noformat}
'd MMM yy"': 'd MMM yy"', 'floatPrecision': '5', 'timeFormat': '"E', 'locale':
'ruRU', 'outputFormat': 'cql'
{noformat}
It would be really useful to have the ability to parse such "quoted" values
even if they contain comma, or other special characters.
The code is here:
https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/ParagraphTextParser.java
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4871) Update Livy interpreter to 0.7.0
Alex Ott created ZEPPELIN-4871: -- Summary: Update Livy interpreter to 0.7.0 Key: ZEPPELIN-4871 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4871 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott Current version of Livy is 0.7.0, but we're still using 0.5.0. Maybe also consider to use programmatic API instead of direct use of HTTP API: https://livy.apache.org/docs/latest/programmatic-api.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4904) Provide tutorial for Cassandra Interpreter
Alex Ott created ZEPPELIN-4904: -- Summary: Provide tutorial for Cassandra Interpreter Key: ZEPPELIN-4904 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4904 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott Assignee: Alex Ott It would be useful to provide out of box a tutorial for Cassandra interpreter... -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4938) Cassandra: add support for newer CQL commands
Alex Ott created ZEPPELIN-4938: -- Summary: Cassandra: add support for newer CQL commands Key: ZEPPELIN-4938 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4938 Project: Zeppelin Issue Type: Improvement Components: Interpreters Affects Versions: 0.9.0 Reporter: Alex Ott Assignee: Alex Ott Right now, the paragraph parser could be too restrictive when analyzing the CQL statement, and this could prevent the use of the Cassandra interpreter with some implementations, like, DataStax's DSE Search, etc. It would be useful to make the parser less restrictive... -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4939) Cassandra: More cleanup on interpreter
Alex Ott created ZEPPELIN-4939: -- Summary: Cassandra: More cleanup on interpreter Key: ZEPPELIN-4939 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4939 Project: Zeppelin Issue Type: Improvement Reporter: Alex Ott we need to do more cleanup after migrating interpreter to a new driver. For example, remove references to Cassandra 2.0 & 1.2 from documentation & help -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4959) Serving of javascript as text/html is blocked by nosniff security option
Alex Ott created ZEPPELIN-4959: -- Summary: Serving of javascript as text/html is blocked by nosniff security option Key: ZEPPELIN-4959 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4959 Project: Zeppelin Issue Type: Bug Affects Versions: 0.9.0 Reporter: Alex Ott Attachments: Снимок экрана 2020-07-18 в 13.20.08.png When testing 0.9.0 preview2, I've noticed following error in the web console: !Снимок экрана 2020-07-18 в 13.20.08.png! it may necessary to check that web server correctly set Content-Type header to prevent such blocking -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ZEPPELIN-4964) Cassandra: add formatte for decimal data type
Alex Ott created ZEPPELIN-4964: -- Summary: Cassandra: add formatte for decimal data type Key: ZEPPELIN-4964 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4964 Project: Zeppelin Issue Type: Improvement Components: Interpreters Reporter: Alex Ott Assignee: Alex Ott In addition to the formatters for float and double types, it would be useful to add formatter for decimal data type as well -- This message was sent by Atlassian Jira (v8.3.4#803005)
