[ https://issues.apache.org/jira/browse/PIG-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925105#comment-15925105 ]
liyunzhang_intel edited comment on PIG-5177 at 3/17/17 6:47 AM: ---------------------------------------------------------------- [~szita]: LGTM Add more comment like "in spark mode, we need to load the script by Thread.currentThread().getContextClassLoader ..." before following kind of code {code} if (udfFileStream == null) { udfFileStream = Thread.currentThread().getContextClassLoader().getResourceAsStream(filePath+getUserFileExtension()); } {code} was (Author: kellyzly): {~szita]: LGTM Add more comment like "in spark mode, we need to load the script by Thread.currentThread().getContextClassLoader ..." before following kind of code {code} if (udfFileStream == null) { udfFileStream = Thread.currentThread().getContextClassLoader().getResourceAsStream(filePath+getUserFileExtension()); } {code} > Scripting and StreamingPythonUDFs fail with Spark exec type > ----------------------------------------------------------- > > Key: PIG-5177 > URL: https://issues.apache.org/jira/browse/PIG-5177 > Project: Pig > Issue Type: Sub-task > Components: spark > Reporter: Adam Szita > Assignee: Adam Szita > Fix For: spark-branch > > Attachments: PIG-5177.0.patch, PIG-5177.1.patch, PIG-5177.2.patch, > PIG-5177.3.patch > > > We are thrown an exception because the Python script file is not found on the > backend side (on spark executors). -- This message was sent by Atlassian JIRA (v6.3.15#6346)