Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15436
@zsxwing I'm getting failures like
```
ERROR
test_flume_polling_multiple_hosts
(pyspark.streaming.tests.FlumePollingStreamTests) ... Traceback (most recent
call last):
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/streaming/tests.py",
line 1367, in _testMultipleTimes
f()
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/streaming/tests.py",
line 1387, in _testFlumePollingMultipleHosts
port = self._utils.startSingleSink()
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/lib/py4j-0.10.3-src.zip/py4j/java_gateway.py",
line 1133, in __call__
answer, self.gateway_client, self.target_id, self.name)
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/lib/py4j-0.10.3-src.zip/py4j/protocol.py",
line 319, in get_return_value
format(target_id, ".", name), value)
Py4JJavaError: An error occurred while calling o24677.startSingleSink.
: java.lang.NoClassDefFoundError:
org/jboss/netty/channel/ChannelPipelineFactory
at
org.apache.spark.streaming.flume.sink.SparkSink.start(SparkSink.scala:90)
at
org.apache.spark.streaming.flume.PollingFlumeTestUtils.startSingleSink(PollingFlumeTestUtils.scala:68)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
```
I wonder if you encountered this and this is why you had to add Netty 3
back into the overall assembly? I'm still debugging why it isn't finding this
from the flume assembly.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
