Thanks Josh. Leaving now so I can't give it a shot, but will report results in a couple of hours. Thanks a lot!
Pozdrawiam, Jacek Jacek Laskowski | https://medium.com/@jaceklaskowski/ Mastering Apache Spark ==> https://jaceklaskowski.gitbooks.io/mastering-apache-spark/ Follow me at https://twitter.com/jaceklaskowski On Mon, Jan 11, 2016 at 9:24 AM, Josh Rosen <joshro...@databricks.com> wrote: > I've got a hotfix which should address it: > https://github.com/apache/spark/pull/10693 > > > > On Sun, Jan 10, 2016 at 11:50 PM, Jacek Laskowski <ja...@japila.pl> wrote: >> >> Hi, >> >> It appears that the last commit [1] broke the build. Is anyone working >> on it? I can when told so. >> >> ➜ spark git:(master) ✗ ./build/mvn -Pyarn -Phadoop-2.6 >> -Dhadoop.version=2.7.1 -Dscala-2.11 -Phive -Phive-thriftserver >> -DskipTests clean install >> ... >> [info] Compiling 8 Scala sources and 1 Java source to >> /Users/jacek/dev/oss/spark/external/flume/target/scala-2.11/classes... >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeInputDStream.scala:33: >> object jboss is not a member of package org >> [error] import org.jboss.netty.handler.codec.compression._ >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeInputDStream.scala:31: >> object jboss is not a member of package org >> [error] import org.jboss.netty.channel.{ChannelPipeline, >> ChannelPipelineFactory, Channels} >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeInputDStream.scala:32: >> object jboss is not a member of package org >> [error] import >> org.jboss.netty.channel.socket.nio.NioServerSocketChannelFactory >> [error] ^ >> [warn] Class org.jboss.netty.channel.ChannelFactory not found - >> continuing with a stub. >> [warn] Class org.jboss.netty.channel.ChannelFactory not found - >> continuing with a stub. >> [warn] Class org.jboss.netty.channel.ChannelPipelineFactory not found >> - continuing with a stub. >> [warn] Class org.jboss.netty.handler.execution.ExecutionHandler not >> found - continuing with a stub. >> [warn] Class org.jboss.netty.channel.ChannelFactory not found - >> continuing with a stub. >> [warn] Class org.jboss.netty.handler.execution.ExecutionHandler not >> found - continuing with a stub. >> [warn] Class org.jboss.netty.channel.group.ChannelGroup not found - >> continuing with a stub. >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeInputDStream.scala:149: >> not found: type NioServerSocketChannelFactory >> [error] val channelFactory = new >> NioServerSocketChannelFactory(Executors.newCachedThreadPool(), >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeInputDStream.scala:196: >> not found: type ChannelPipelineFactory >> [error] class CompressionChannelPipelineFactory extends >> ChannelPipelineFactory { >> [error] ^ >> [error] Class org.jboss.netty.channel.ChannelFactory not found - >> continuing with a stub. >> [error] Class org.jboss.netty.channel.ChannelPipelineFactory not found >> - continuing with a stub. >> [error] Class org.jboss.netty.handler.execution.ExecutionHandler not >> found - continuing with a stub. >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeInputDStream.scala:197: >> not found: type ChannelPipeline >> [error] def getPipeline(): ChannelPipeline = { >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeInputDStream.scala:198: >> not found: value Channels >> [error] val pipeline = Channels.pipeline() >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeInputDStream.scala:199: >> not found: type ZlibEncoder >> [error] val encoder = new ZlibEncoder(6) >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumePollingInputDStream.scala:29: >> object jboss is not a member of package org >> [error] import >> org.jboss.netty.channel.socket.nio.NioClientSocketChannelFactory >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumePollingInputDStream.scala:73: >> not found: type NioClientSocketChannelFactory >> [error] new NioClientSocketChannelFactory(channelFactoryExecutor, >> channelFactoryExecutor) >> [error] ^ >> [warn] Class org.jboss.netty.channel.ChannelFuture not found - >> continuing with a stub. >> [warn] Class org.jboss.netty.channel.ChannelFactory not found - >> continuing with a stub. >> [warn] Class org.jboss.netty.channel.ChannelFactory not found - >> continuing with a stub. >> [warn] Class org.jboss.netty.channel.ChannelFactory not found - >> continuing with a stub. >> [warn] Class org.jboss.netty.channel.ChannelFactory not found - >> continuing with a stub. >> [warn] Class org.jboss.netty.channel.ChannelUpstreamHandler not found >> - continuing with a stub. >> [error] Class org.jboss.netty.channel.ChannelFactory not found - >> continuing with a stub. >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeTestUtils.scala:33: >> object jboss is not a member of package org >> [error] import org.jboss.netty.channel.ChannelPipeline >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeTestUtils.scala:34: >> object jboss is not a member of package org >> [error] import org.jboss.netty.channel.socket.SocketChannel >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeTestUtils.scala:35: >> object jboss is not a member of package org >> [error] import >> org.jboss.netty.channel.socket.nio.NioClientSocketChannelFactory >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeTestUtils.scala:36: >> object jboss is not a member of package org >> [error] import org.jboss.netty.handler.codec.compression.{ZlibDecoder, >> ZlibEncoder} >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeTestUtils.scala:107: >> not found: type NioClientSocketChannelFactory >> [error] extends NioClientSocketChannelFactory { >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeTestUtils.scala:79: >> overloaded method constructor NettyTransceiver with alternatives: >> [error] (x$1: java.net.InetSocketAddress,x$2: >> >> org.jboss.netty.channel.ChannelFactory)org.apache.avro.ipc.NettyTransceiver >> <and> >> [error] (x$1: java.net.InetSocketAddress,x$2: >> Long)org.apache.avro.ipc.NettyTransceiver >> [error] cannot be applied to (java.net.InetSocketAddress, >> FlumeTestUtils.this.CompressionChannelFactory) >> [error] new NettyTransceiver(testAddress, new >> CompressionChannelFactory(6)) >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeTestUtils.scala:109: >> not found: type SocketChannel >> [error] override def newChannel(pipeline: ChannelPipeline): >> SocketChannel = { >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeTestUtils.scala:109: >> not found: type ChannelPipeline >> [error] override def newChannel(pipeline: ChannelPipeline): >> SocketChannel = { >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeTestUtils.scala:110: >> not found: type ZlibEncoder >> [error] val encoder = new ZlibEncoder(compressionLevel) >> [error] ^ >> [error] >> /Users/jacek/dev/oss/spark/external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeTestUtils.scala:113: >> value newChannel is not a member of AnyRef >> [error] super.newChannel(pipeline) >> [error] ^ >> [warn] 13 warnings found >> [error] 24 errors found >> [error] Compile failed at Jan 11, 2016 8:43:02 AM [0.602s] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Reactor Summary: >> [INFO] >> [INFO] Spark Project Parent POM ........................... SUCCESS [ >> 5.427 s] >> [INFO] Spark Project Test Tags ............................ SUCCESS [ >> 4.430 s] >> [INFO] Spark Project Launcher ............................. SUCCESS [ >> 8.698 s] >> [INFO] Spark Project Networking ........................... SUCCESS [ >> 16.379 s] >> [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ >> 8.800 s] >> [INFO] Spark Project Unsafe ............................... SUCCESS [ >> 11.254 s] >> [INFO] Spark Project Core ................................. SUCCESS [02:04 >> min] >> [INFO] Spark Project GraphX ............................... SUCCESS [ >> 16.071 s] >> [INFO] Spark Project Streaming ............................ SUCCESS [ >> 35.991 s] >> [INFO] Spark Project Catalyst ............................. SUCCESS [01:34 >> min] >> [INFO] Spark Project SQL .................................. SUCCESS [01:08 >> min] >> [INFO] Spark Project ML Library ........................... SUCCESS [01:18 >> min] >> [INFO] Spark Project Tools ................................ SUCCESS [ >> 5.614 s] >> [INFO] Spark Project Hive ................................. SUCCESS [ >> 40.699 s] >> [INFO] Spark Project Docker Integration Tests ............. SUCCESS [ >> 2.102 s] >> [INFO] Spark Project REPL ................................. SUCCESS [ >> 6.258 s] >> [INFO] Spark Project YARN Shuffle Service ................. SUCCESS [ >> 6.547 s] >> [INFO] Spark Project YARN ................................. SUCCESS [ >> 12.898 s] >> [INFO] Spark Project Hive Thrift Server ................... SUCCESS [ >> 9.361 s] >> [INFO] Spark Project Assembly ............................. SUCCESS [ >> 40.149 s] >> [INFO] Spark Project External Twitter ..................... SUCCESS [ >> 7.137 s] >> [INFO] Spark Project External Flume Sink .................. SUCCESS [ >> 6.203 s] >> [INFO] Spark Project External Flume ....................... FAILURE [ >> 1.010 s] >> [INFO] Spark Project External Flume Assembly .............. SKIPPED >> >> [1] >> https://github.com/apache/spark/commit/3ab0138b0fe0f9208b4b476855294a7c729583b7 >> >> Pozdrawiam, >> Jacek >> >> Jacek Laskowski | https://medium.com/@jaceklaskowski/ >> Mastering Apache Spark >> ==> https://jaceklaskowski.gitbooks.io/mastering-apache-spark/ >> Follow me at https://twitter.com/jaceklaskowski >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >> For additional commands, e-mail: dev-h...@spark.apache.org >> > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
