[SPARK-13807] De-duplicate `Python*Helper` instantiation code in PySpark 
streaming

This patch de-duplicates code in PySpark streaming which loads the 
`Python*Helper` classes. I also changed a few `raise e` statements to simply 
`raise` in order to preserve the full exception stacktrace when re-throwing.

Here's a link to the whitespace-change-free diff: 
https://github.com/apache/spark/compare/master...JoshRosen:pyspark-reflection-deduplication?w=0

Author: Josh Rosen <joshro...@databricks.com>

Closes #11641 from JoshRosen/pyspark-reflection-deduplication.


Project: http://git-wip-us.apache.org/repos/asf/bahir/repo
Commit: http://git-wip-us.apache.org/repos/asf/bahir/commit/c66dcf7e
Tree: http://git-wip-us.apache.org/repos/asf/bahir/tree/c66dcf7e
Diff: http://git-wip-us.apache.org/repos/asf/bahir/diff/c66dcf7e

Branch: refs/heads/master
Commit: c66dcf7e38420893fe9c1d9fb4ed66b8d6f589ac
Parents: 41ae1d2
Author: Josh Rosen <joshro...@databricks.com>
Authored: Fri Mar 11 11:18:51 2016 -0800
Committer: Shixiong Zhu <shixi...@databricks.com>
Committed: Fri Mar 11 11:18:51 2016 -0800

----------------------------------------------------------------------
 streaming-mqtt/python/mqtt.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/bahir/blob/c66dcf7e/streaming-mqtt/python/mqtt.py
----------------------------------------------------------------------
diff --git a/streaming-mqtt/python/mqtt.py b/streaming-mqtt/python/mqtt.py
index 3a515ea..388e952 100644
--- a/streaming-mqtt/python/mqtt.py
+++ b/streaming-mqtt/python/mqtt.py
@@ -48,7 +48,7 @@ class MQTTUtils(object):
         except Py4JJavaError as e:
             if 'ClassNotFoundException' in str(e.java_exception):
                 MQTTUtils._printErrorMsg(ssc.sparkContext)
-            raise e
+            raise
 
         return DStream(jstream, ssc, UTF8Deserializer())
 

Reply via email to