[
https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957194#comment-14957194
]
Cheolsoo Park commented on SPARK-6910:
--
You're right that 2nd query is faster because the
[
https://issues.apache.org/jira/browse/SPARK-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park resolved SPARK-10970.
---
Resolution: Fixed
Closing the jira because this is fixed by SPARK-10679.
SPARK-10679
Cheolsoo Park created SPARK-10970:
-
Summary: Executors overload Hive metastore by making massive
connections at execution time
Key: SPARK-10970
URL: https://issues.apache.org/jira/browse/SPARK-10970
[
https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-10001:
--
Summary: Allow Ctrl-C in spark-shell to kill running job (was: Ctrl-C in
spark-shell doesn't
Cheolsoo Park created SPARK-10001:
-
Summary: Ctrl-C in spark-shell doesn't kill running job
Key: SPARK-10001
URL: https://issues.apache.org/jira/browse/SPARK-10001
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-10001:
--
Affects Version/s: 1.4.1
Fix Version/s: (was: 1.4.1)
Ctrl-C in spark-shell
[
https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697850#comment-14697850
]
Cheolsoo Park commented on SPARK-10001:
---
[~sowen], I am creating a subtask so that
Cheolsoo Park created SPARK-9926:
Summary: Parallelize file listing for partitioned Hive table
Key: SPARK-9926
URL: https://issues.apache.org/jira/browse/SPARK-9926
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-9270:
-
Description:
Currently, the app name is hardcoded in pyspark as PySparkShell, and the
[
https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639155#comment-14639155
]
Cheolsoo Park commented on SPARK-8105:
--
OK, I guess I got the answer to my question
[
https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639083#comment-14639083
]
Cheolsoo Park commented on SPARK-8105:
--
[~yhuai], what's the plan for this?
[
https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639083#comment-14639083
]
Cheolsoo Park edited comment on SPARK-8105 at 7/23/15 4:27 PM:
[
https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-9270:
-
Description:
Currently, the app name is hardcoded in pyspark as PySparkShell, and the
[
https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638319#comment-14638319
]
Cheolsoo Park commented on SPARK-9270:
--
[~sowen], I just tested SPARK-9180 now. even
[
https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-9270:
-
Description:
Currently, the app name is hardcoded in pyspark as PySparkShell, and the app
name
[
https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-9270:
-
Description:
Currently, the app name is hardcoded in pyspark as PySparkShell, and the app
name
Cheolsoo Park created SPARK-9270:
Summary: spark.app.name is not honored by spark-shell and pyspark
Key: SPARK-9270
URL: https://issues.apache.org/jira/browse/SPARK-9270
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638187#comment-14638187
]
Cheolsoo Park commented on SPARK-9270:
--
Oh it is. I missed it. So spark-shell is
[
https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638187#comment-14638187
]
Cheolsoo Park edited comment on SPARK-9270 at 7/23/15 5:43 AM:
Cheolsoo Park created SPARK-8908:
Summary: Calling distinct() with parentheses throws error in Scala
DataFrame
Key: SPARK-8908
URL: https://issues.apache.org/jira/browse/SPARK-8908
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579218#comment-14579218
]
Cheolsoo Park commented on SPARK-7955:
--
Can we close the jira since Hari's PR is
[
https://issues.apache.org/jira/browse/SPARK-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park resolved SPARK-7851.
--
Resolution: Duplicate
Closing the jira since the issue is fixed by SPARK-8020.
SparkSQL cli
[
https://issues.apache.org/jira/browse/SPARK-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567997#comment-14567997
]
Cheolsoo Park commented on SPARK-7851:
--
[~yhuai], thanks for checking.
1) I am
[
https://issues.apache.org/jira/browse/SPARK-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568085#comment-14568085
]
Cheolsoo Park commented on SPARK-7851:
--
{quote}
have you seen any thing like INFO
[
https://issues.apache.org/jira/browse/SPARK-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568200#comment-14568200
]
Cheolsoo Park commented on SPARK-7851:
--
{quote}
For a quick workaround, can you set
[
https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568444#comment-14568444
]
Cheolsoo Park edited comment on SPARK-8020 at 6/2/15 3:17 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568444#comment-14568444
]
Cheolsoo Park commented on SPARK-8020:
--
[~yhuai], the patch seems to fix the original
Cheolsoo Park created SPARK-7851:
Summary: SparkSQL cli built against Hive 0.13 throws exception
when using with Hive 0.12 HCat
Key: SPARK-7851
URL: https://issues.apache.org/jira/browse/SPARK-7851
Cheolsoo Park created SPARK-7850:
Summary: Hive 0.12.0 profile in POM should be removed
Key: SPARK-7850
URL: https://issues.apache.org/jira/browse/SPARK-7850
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557628#comment-14557628
]
Cheolsoo Park commented on SPARK-6910:
--
I don't know what's the best way to fix this,
Cheolsoo Park created SPARK-7037:
Summary: Inconsistent behavior for non-spark config properties in
spark-shell and spark-submit
Key: SPARK-7037
URL: https://issues.apache.org/jira/browse/SPARK-7037
[
https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-6954:
-
Attachment: without_fix.png
with_fix.png
I am uploading two diagrams that shows
[
https://issues.apache.org/jira/browse/SPARK-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502612#comment-14502612
]
Cheolsoo Park commented on SPARK-7006:
--
Thanks for asking about Ctrl-D. During a job
[
https://issues.apache.org/jira/browse/SPARK-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502624#comment-14502624
]
Cheolsoo Park commented on SPARK-7006:
--
Yes, when the shell exits, jobs die in all
[
https://issues.apache.org/jira/browse/SPARK-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502597#comment-14502597
]
Cheolsoo Park commented on SPARK-7006:
--
Yes, I'd like to see the same result ideally.
Cheolsoo Park created SPARK-7006:
Summary: Inconsistent behavior for ctrl-c in Spark shells
Key: SPARK-7006
URL: https://issues.apache.org/jira/browse/SPARK-7006
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-6954:
-
Description:
I have a simple test case for dynamic allocation on YARN that fails with the
[
https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-6954:
-
Description:
I have a simple test case for dynamic allocation on YARN that fails with the
Cheolsoo Park created SPARK-6954:
Summary: Dynamic allocation: numExecutorsPending in
ExecutorAllocationManager should never become negative
Key: SPARK-6954
URL: https://issues.apache.org/jira/browse/SPARK-6954
[
https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-6954:
-
Affects Version/s: (was: 1.3.0)
1.3.1
Hi [~sandyr], Thank you for the
[
https://issues.apache.org/jira/browse/SPARK-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-6692:
-
Summary: Add an option for client to kill AM when it is killed (was: Make
it possible to kill AM
[
https://issues.apache.org/jira/browse/SPARK-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park closed SPARK-6712.
Resolution: Won't Fix
Closing the jira as won't fix. See the discussion in the PR.
Allow lower
Cheolsoo Park created SPARK-6712:
Summary: Allow lower the log level in YARN client while keeping AM
tracking URL printed
Key: SPARK-6712
URL: https://issues.apache.org/jira/browse/SPARK-6712
Cheolsoo Park created SPARK-6692:
Summary: Make it possible to kill AM in YARN cluster mode when the
client is terminated
Key: SPARK-6692
URL: https://issues.apache.org/jira/browse/SPARK-6692
[
https://issues.apache.org/jira/browse/SPARK-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392963#comment-14392963
]
Cheolsoo Park commented on SPARK-6662:
--
[~srowen], thank you for your comment.
Cheolsoo Park created SPARK-6662:
Summary: Allow variable substitution in
spark.yarn.historyServer.address
Key: SPARK-6662
URL: https://issues.apache.org/jira/browse/SPARK-6662
Project: Spark
Cheolsoo Park created SPARK-6014:
Summary: java.io.IOException: Filesystem is thrown when ctrl+c or
ctrl+d spark-sql on YARN
Key: SPARK-6014
URL: https://issues.apache.org/jira/browse/SPARK-6014
[
https://issues.apache.org/jira/browse/SPARK-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated SPARK-6018:
-
Description:
I discovered this bug while testing 1.3 RC with old 1.2 Spark job that I had.
Due
Cheolsoo Park created SPARK-6018:
Summary: NoSuchMethodError in Spark app is swallowed by YARN AM
Key: SPARK-6018
URL: https://issues.apache.org/jira/browse/SPARK-6018
Project: Spark
Issue
49 matches
Mail list logo
