[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333410#comment-15333410
]
Srikanth Sundarrajan commented on PIG-4903:
---
For spark mode, we should support yarn-client, mesos
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1595#comment-1595
]
liyunzhang_intel commented on PIG-4903:
---
[~sriksun]:
{quote}
would this print a 0/1 on the console
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1585#comment-1585
]
Srikanth Sundarrajan commented on PIG-4903:
---
Sorry to nitpick [~kellyzly], would this print a 0/1
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329687#comment-15329687
]
Rohini Palaniswamy commented on PIG-4903:
-
Agree with Srikanth. Please look for -x or -exectype and
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1532#comment-1532
]
Srikanth Sundarrajan commented on PIG-4903:
---
Looks largely ok, except the following:
{code}
+
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325646#comment-15325646
]
Srikanth Sundarrajan commented on PIG-4903:
---
Makes sense to keep it consistent. Should we then
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324836#comment-15324836
]
Rohini Palaniswamy commented on PIG-4903:
-
Can we have user explicitly specify spark_local mode
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324640#comment-15324640
]
Srikanth Sundarrajan commented on PIG-4903:
---
Yes [~rohini], By default (particularly if
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322904#comment-15322904
]
Rohini Palaniswamy commented on PIG-4903:
-
bq. By default running pig -x spark will run this in
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321850#comment-15321850
]
Srikanth Sundarrajan commented on PIG-4903:
---
Looked at the latest patch, it still seems like
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15320244#comment-15320244
]
liyunzhang_intel commented on PIG-4903:
---
[~sriksun]:
Only 1 point is left to be discussed for this
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318643#comment-15318643
]
Rohini Palaniswamy commented on PIG-4903:
-
bq. SPARK_JAR stands for the hdfs location of
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318146#comment-15318146
]
liyunzhang_intel commented on PIG-4903:
---
[~rohini] and [~sriksun]: sorry for reply late and thanks for
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315949#comment-15315949
]
Rohini Palaniswamy commented on PIG-4903:
-
Can we call it SPARK_LIB_URIS instead of SPARK_JAR and
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313486#comment-15313486
]
Srikanth Sundarrajan commented on PIG-4903:
---
Have two followup questions on the patch.
1. Will
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311028#comment-15311028
]
Rohini Palaniswamy commented on PIG-4903:
-
Please refer to my comment in
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309248#comment-15309248
]
liyunzhang_intel commented on PIG-4903:
---
[~sriksun]: Thanks for your comment!
1. for build, we still
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309216#comment-15309216
]
Srikanth Sundarrajan commented on PIG-4903:
---
Two things to consider.
1. Since Spark Assembly
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309149#comment-15309149
]
liyunzhang_intel commented on PIG-4903:
---
[~sriksun]:
After investigating the spark code, let's explain
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303400#comment-15303400
]
Srikanth Sundarrajan commented on PIG-4903:
---
If spark-assembly is present, then nothing else is
[
https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303337#comment-15303337
]
liyunzhang_intel commented on PIG-4903:
---
[~sriksun]: thanks for your reply, here is my understanding
21 matches
Mail list logo
