[ https://issues.apache.org/jira/browse/PIG-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190308#comment-14190308 ]
Praveen Rachabattuni commented on PIG-4232: ------------------------------------------- Could you check if modifying POUserFunc and POForEach be avoided by initializing UDFContext before these objects are used. You might use jobConf to initialise the UDFContext like Rohini was suggesting. > UDFContext is not initialized in executors when running on Spark cluster > ------------------------------------------------------------------------ > > Key: PIG-4232 > URL: https://issues.apache.org/jira/browse/PIG-4232 > Project: Pig > Issue Type: Sub-task > Components: spark > Reporter: Praveen Rachabattuni > Assignee: liyunzhang_intel > Attachments: PIG-4232.patch, PIG-4232_1.patch > > > UDFContext is used in lot of features across pig code base. For example its > used in PigStorage to pass columns information between the frontend and the > backend code. > https://github.com/apache/pig/blob/spark/src/org/apache/pig/builtin/PigStorage.java#L246-L247 -- This message was sent by Atlassian JIRA (v6.3.4#6332)