[jira] [Commented] (PIG-4208) Make merge-sparse join work with Spark
[
https://issues.apache.org/jira/browse/PIG-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950656#comment-14950656
]
Xuefu Zhang commented on PIG-4208:
--
Yeah, I saw similar changes in other places. I was just trying to understand
where PH_PIGGYBANK_JAR might be defined and how it's different from
$ENV{PH_PIG}/contrib/piggybank/java.
+1 to the patch.
> Make merge-sparse join work with Spark
> --
>
> Key: PIG-4208
> URL: https://issues.apache.org/jira/browse/PIG-4208
> Project: Pig
> Issue Type: Sub-task
> Components: spark
>Reporter: Praveen Rachabattuni
>Assignee: Abhishek Agarwal
> Fix For: spark-branch
>
> Attachments: PIG-4208.patch
>
>
> Related e2e tests: MergeSparseJoin_[1-6]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (PIG-4208) Make merge-sparse join work with Spark
[ https://issues.apache.org/jira/browse/PIG-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950358#comment-14950358 ] Abhishek Agarwal commented on PIG-4208: --- It is a fix for the MergeSparse E2E tests. Spark was not able to load the piggybank classes from the directory. This change solves that. > Make merge-sparse join work with Spark > -- > > Key: PIG-4208 > URL: https://issues.apache.org/jira/browse/PIG-4208 > Project: Pig > Issue Type: Sub-task > Components: spark >Reporter: Praveen Rachabattuni >Assignee: Abhishek Agarwal > Fix For: spark-branch > > Attachments: PIG-4208.patch > > > Related e2e tests: MergeSparseJoin_[1-6] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (PIG-4208) Make merge-sparse join work with Spark
[ https://issues.apache.org/jira/browse/PIG-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944451#comment-14944451 ] Xuefu Zhang commented on PIG-4208: -- Hi [~abhishek.agarwal], thanks for working on this. Could you please explain your change and why it's required? Thanks. > Make merge-sparse join work with Spark > -- > > Key: PIG-4208 > URL: https://issues.apache.org/jira/browse/PIG-4208 > Project: Pig > Issue Type: Sub-task > Components: spark >Reporter: Praveen Rachabattuni >Assignee: Abhishek Agarwal > Fix For: spark-branch > > Attachments: PIG-4208.patch > > > Related e2e tests: MergeSparseJoin_[1-6] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (PIG-4208) Make merge-sparse join work with Spark
[ https://issues.apache.org/jira/browse/PIG-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285486#comment-14285486 ] Praveen Rachabattuni commented on PIG-4208: --- [~abhishek.agarwal] Sure, that would be great. Please make sure to get unit tests related merge-sparse join passed. https://builds.apache.org/job/Pig-spark/lastCompletedBuild/testReport/ > Make merge-sparse join work with Spark > -- > > Key: PIG-4208 > URL: https://issues.apache.org/jira/browse/PIG-4208 > Project: Pig > Issue Type: Sub-task > Components: spark >Reporter: Praveen Rachabattuni > > Related e2e tests: MergeSparseJoin_[1-6] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (PIG-4208) Make merge-sparse join work with Spark
[ https://issues.apache.org/jira/browse/PIG-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285428#comment-14285428 ] Abhishek Agarwal commented on PIG-4208: --- since it is still unassigned, can I take it up? > Make merge-sparse join work with Spark > -- > > Key: PIG-4208 > URL: https://issues.apache.org/jira/browse/PIG-4208 > Project: Pig > Issue Type: Sub-task > Components: spark >Reporter: Praveen Rachabattuni > > Related e2e tests: MergeSparseJoin_[1-6] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
