I tried your pip package at https://dist.apache.org/repos/dist/dev/incubator/toree/0.1.0/rc5/toree-pip/ using the `make test-release` target and it worked fine. I ran the magics test notebook and everything worked except there is an issue when calling the %SparkR magic. It ends up in an infinite loop printing
Warning message: In rm(".sparkRcon", envir = .sparkREnv) : object '.sparkRcon' not found Error in sparkR.connect() : could not find function "connExists" Execution halted 17/02/15 23:15:51 [ERROR] o.a.t.k.i.s.SparkRProcessHandler - null process exited: 1 Loading required package: methods Attaching package: ‘SparkR’ The following objects are masked from ‘package:stats’: cov, filter, lag, na.omit, predict, sd, var The following objects are masked from ‘package:base’: colnames, colnames<-, endsWith, intersect, rank, rbind, sample, startsWith, subset, summary, table, transform On Thu, Feb 16, 2017 at 9:03 AM Corey Stubbs <cas5...@gmail.com> wrote: > I was able to run from the pip package just fine. > > On Wed, Feb 15, 2017 at 4:50 PM Chip Senkbeil <chip.senkb...@gmail.com> > wrote: > > > By master, I mean the 0.1.x branch. Was trying to get the next vote > > started. > > > > On Wed, Feb 15, 2017, 4:44 PM Chip Senkbeil <chip.senkb...@gmail.com> > > wrote: > > > > > Just built master, got all of the artifacts ready, blah blah blah. > Tested > > > by installing the artifact from > > > > > > https://dist.apache.org/repos/dist/dev/incubator/toree/0.1.0/rc5/toree-pip/ > > and > > > now it's failing with not being able to bind to an ephemeral port for > the > > > sparkDriver. Can someone help me take a look at this? I just installed > > like > > > usual via `pip install apache-toree-0.1.0.tar.gz` and pointed to spark > > > distributions I downloaded (1.6.1 and 1.6.3) when running `jupyter > toree > > > install --spark_home=...`. When launching a kernel, it fails with... > > > > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [WARN] o.a.s.u.Utils - Service 'sparkDriver' could > not > > > bind on port 0. Attempting port 1. > > > 17/02/15 16:41:29 [ERROR] o.a.s.SparkContext - Error initializing > > > SparkContext. > > > java.net.BindException: Can't assign requested address: Service > > > 'sparkDriver' failed after 16 retries! > > > at sun.nio.ch.Net.bind0(Native Method) > > > at sun.nio.ch.Net.bind(Net.java:433) > > > at sun.nio.ch.Net.bind(Net.java:425) > > > at > > > sun.nio.ch > > .ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) > > > at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) > > > at > > > > > > io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:125) > > > at > > > > > > io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:485) > > > at > > > > > > io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1089) > > > at > > > > > > io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:430) > > > at > > > > > > io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:415) > > > at > > > > > > io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:903) > > > at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:198) > > > at > io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:348) > > > at > > > > > > io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) > > > at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) > > > at > > > > > > io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) > > > at java.lang.Thread.run(Thread.java:745) > > > > > >