Re: Build broken, GitHub issues, snapshot missing?

2017-12-11 Thread Jeff Chung 
I had trouble building zeppelin too.  My coworker could get it to build on
his Mac though.  However even after it built, when I ran my notebook it was
looking for files in /zeppelin/build/spark*.  I moved over the files from
spark-dependencies/target/spark* into that directory, but now get a
NullPointerException from the TSocket.  I would also like to get a working
build with the latest.


Virus-free.
www.avast.com

<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

On Fri, Dec 8, 2017 at 7:46 AM,  wrote:

> Hi
>
> Numerous issues trying to get Zeppelin built.
>
> Basically the build from source instructions are not working for me.
>
> Multiple "The requested profile does not exist" errors for basic stuff.
> -Pspark-2.0 etc
>
> There is no 0.8.0 snapshot or build anywhere? The links to it are all
> broken.
>
> We can not open GitHub issues for Zeppelin? I didn't see where.
>
> Is there a nightly Build? Or any working build with latest?
>
> Get Outlook for Android 
>
>

Re: Build broken, GitHub issues, snapshot missing?

2017-12-11 Thread Paul Brenner 
We were able to build 0.8 in the past without problems. However, when we tried 
following the exact same steps on an identical VM last month we ran into the 
same issues Darren is facing. Hard to say if it is the exact same problem, but 
eventually I chased down this thread which seemed related to my troubles… 
https://github.com/eirslett/frontend-maven-plugin/issues/562 ( 
https://share.polymail.io/v1/z/b/NWEyZWMyZTA0Nzcx/-iEFfexYqrjucotO0Kl0u_QKDWu3U5M1fgPEmHPZd1W44O6G0_kd3rRw3JwnXQNnOl4Qa-3bwsnAUfmbv11Ur08cRy57JHVIHm8I1uJ8LmxI9Qp-hfjfEOVKY16-dcI51OpgXuCkn74VlmHLrCAEjvMPfun-CuUrYFAcu1p_KFrn_l9z1waQb-OfrdBj1mkioAG6EcVTa47Kyj7GSZN_Q6SuPbWNeuG4EmFhL4EKmHJW
 )

and is unresolved.

We eventually gave up and just stuck with 0.72. I’m just chiming in to say that 
we would also love a 0.8 snapshot.

( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) ( 
http://www.placeiq.com/ ) Paul Brenner ( https://twitter.com/placeiq ) ( 
https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) ( 
https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) ( 
https://www.linkedin.com/company/placeiq ) ( 
https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033  

( 
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
 ) ( 
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
 ) ( 
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
 ) ( 
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
 ) ( 
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
 ) ( 
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
 ) ( 
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
 ) ( 
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
 ) ( 
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
 ) ( 
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
 ) ( 
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
 ) ( 
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
 ) ( 
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
 ) ( 
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ 
) ( 
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
 ) ( 
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
 ) PlaceIQ:Landmark by PlaceIQ ( 
https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/
 )

On Mon, Dec 11, 2017 at 12:24 PM Jeff Chung < Jeff Chung ( Jeff Chung 
 ) > wrote:

> 
> I had trouble building zeppelin too.  My coworker could get it to build on
> his Mac though.  However even after it built, when I ran my notebook it
> was looking for files in /zeppelin/build/spark*.  I moved over the files
> from spark-dependencies/target/spark* into that directory, but now get a
> NullPointerException from the TSocket.  I would also like to get a working
> build with the latest.  
> 
> 
> 
> (
> https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=icon
> ) Virus-free. www.avast.com (
> https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=link
> )
> 
> ( #DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2 )
> 
> On Fri, Dec 8, 2017 at 7:46 AM, < dar...@ontrenet.com > wrote:
> 
>> Hi
>> 
>> 
>> Numerous issues trying to get Zeppelin built.
>> 
>> 
>> Basically the build from source instructions are not working for me.
>> 
>> 
>> Multiple "The requested profile does not exist" errors for basic stuff.
>> -Pspark-2.0 etc
>> 
>> 
>> There is no 0.8.0 snapshot or build anywhere? The links to it are all
>> broken.
>> 
>> 
>> We can not open GitHub issues for Zeppelin? I didn't see where.
>> 
>> 
>> Is there a nightly Build? Or any working build with latest?
>> 
>> 
>> Get Outlook for Android ( https://aka.ms/ghei36 )
>> 
>> 
>> 
> 
> 
>

Re: IPython is available, use IPython for PySparkInterpreter

2017-12-11 Thread Ruslan Dautkhanov 
Makes sense

Thank you Jeff !

On Sun, Dec 10, 2017 at 11:24 PM Jeff Zhang  wrote:

>
> I am afraid currently there's no way to make ipython as default of
> %pyspark, but you can use %ipyspark to use ipython without this warning
> message.
>
> But making ipython as default is on my plan, for now I try to keep
> backward compatibility as much as possible, so only use ipython when it is
> available, otherwise still use the old python interpreter implementation.
> I will change ipython as default and the original python implementation as
> fallback when ipython interpreter become much more mature.
>
>
>
>
> Ruslan Dautkhanov 于2017年12月11日周一 下午1:20写道：
>
>> Getting "IPython is available, use IPython for PySparkInterpreter"
>> warning after starting pyspark interpreter.
>>
>> How do I default %pyspark to ipython?
>>
>> Tried to change to
>> "class": "org.apache.zeppelin.spark.PySparkInterpreter",
>> to
>> "class": "org.apache.zeppelin.spark.IPySparkInterpreter",
>> in interpreter.json but this gets overwritten back to PySparkInterpreter.
>>
>> Also tried to change to zeppelin.pyspark.python to ipython with no luck
>> too.
>>
>> Is there is a documented way to default pyspark interpreter to ipython?
>> Glanced over PR-2474 but can't quickly get what I am missing.
>>
>>
>> Thanks.
>>
>>
>>

Re: zeppelin build fails with DependencyConvergence error

2017-12-11 Thread Ruslan Dautkhanov 
Looks like master branch of Zeppelin still has compatibility issue with
Cloudera dependencies.

When built using

mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1
-Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e

maven fails on jackson convergence error - see below email for more
details.
Looks like there was a change in Zeppelin that upgraded Jackson's version?
So now it conflicts with older jackson library as referenced by cloudera
repo.

workaround: Zeppelin builds fine with pom change [1] - the question is now
would somebody expect Zeppelin would still be functioning correctly with
these exclusions?



[1]

--- a/zeppelin-zengine/pom.xml
> +++ b/zeppelin-zengine/pom.xml
> @@ -364,6 +364,30 @@
>com.google.guava
>guava
>  
> +
> +  com.fasterxml.jackson.core
> +  jackson-core
> +
> +
> +  com.fasterxml.jackson.core
> +  jackson-annotations
> +
> +
> +  com.fasterxml.jackson.core
> +  jackson-databind
> +
> +
> +  org.codehaus.jackson
> +  jackson-mapper-asl
> +
> +
> +  org.codehaus.jackson
> +  jackson-core-asl
> +
> +
> +  org.apache.zookeeper
> +  zookeeper
> +
>
>  
>



On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov 
wrote:

> Building from a current Zeppelin snapshot fails with
> zeppelin build fails with org.apache.maven.plugins.
> enforcer.DependencyConvergence
> see details below.
>
> Build command
> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10
> -Psparkr -pl '!*..excluded certain modules..*' -e
>
> maven 3.5.0
>> jdk 1.8.0_141
>> RHEL 7.3
>> npm.x86_64   1:3.10.10-1.6.11.1.1.el7
>> nodejs.x86_641:6.11.1-1.el7 @epel
>> latest zeppelin snapshot
>
>
> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen this
> problem before.
>
> Thanks,
> Ruslan
>
>
>
> [INFO] Scanning for projects...
> [WARNING]
> [WARNING] Some problems were encountered while building the effective
> model for org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.
> 8.0-SNAPSHOT
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin 
> com.googlecode.maven-download-plugin:download-maven-plugin
> @ line 940, column 15
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin 
> com.googlecode.maven-download-plugin:download-maven-plugin
> @ line 997, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective
> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
> @ line 467, column 15
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin 
> org.apache.maven.plugins:maven-surefire-plugin
> @ line 475, column 15
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin 
> org.apache.maven.plugins:maven-compiler-plugin
> @ line 486, column 15
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
> @ line 496, column 15
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin 
> org.apache.maven.plugins:maven-surefire-plugin
> @ line 504, column 15
> [WARNING]
> [WARNING] It is highly recommended to fix these problems because they
> threaten the stability of your build.
> [WARNING]
> [WARNING] For this reason, future Maven versions might no longer support
> building such malformed projects.
> [WARNING]
> [WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT
> uses prerequisites which is only intended for maven-plugin projects but not
> for non maven-plugin projects. For such purposes you should use the
> maven-enforcer-plugin. See https://maven.apache.org/
> enforcer/enforcer-rules/requireMavenVersion.html
>
>
> ... [skip]
>
> [INFO] 
> 
> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
> [INFO] 
> 
> [INFO]
> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @
> zeppelin-zengine ---
> [INFO]
> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @
> zeppelin-zengine ---
> [INFO]
> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @
> zeppelin-zengine ---
> [INFO]
> [INFO]
> [INFO] --- maven-resources-plugin:2