[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103289#comment-15103289
]
Jason Hubbard commented on SPARK-2243:
--
I think what Richard is referring to and what we have seen as
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103348#comment-15103348
]
Jason Hubbard commented on SPARK-2243:
--
Dynamic allocation allows executors to be started and stopped
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103419#comment-15103419
]
Jason Hubbard commented on SPARK-2243:
--
There is a limit to how small you can make the heap before
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103476#comment-15103476
]
Jason Hubbard commented on SPARK-2243:
--
It seems feasible to me to implement such functionality and
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103446#comment-15103446
]
Jason Hubbard commented on SPARK-2243:
--
The difference between N contexts in N JVMs and N contexts in
[
https://issues.apache.org/jira/browse/SPARK-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14711291#comment-14711291
]
Jason Hubbard commented on SPARK-3533:
--
Spark SQL has the ability to write to
[
https://issues.apache.org/jira/browse/SPARK-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608626#comment-14608626
]
Jason Hubbard commented on SPARK-6190:
--
We often run into the 2gb limit using the
[
https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509250#comment-14509250
]
Jason Hubbard commented on SPARK-6067:
--
I was able to test this. I had problems
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392804#comment-14392804
]
Jason Hubbard commented on SPARK-2243:
--
I don't think programmatically spinning up
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391770#comment-14391770
]
Jason Hubbard edited comment on SPARK-2243 at 4/1/15 11:40 PM:
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391770#comment-14391770
]
Jason Hubbard commented on SPARK-2243:
--
Apologizing for being flippant is a bit of an
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391770#comment-14391770
]
Jason Hubbard edited comment on SPARK-2243 at 4/1/15 11:41 PM:
[
https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372061#comment-14372061
]
Jason Hubbard commented on SPARK-6067:
--
Hi Baishuo, I've been on holiday, but I'll
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357545#comment-14357545
]
Jason Hubbard commented on SPARK-2243:
--
It also mentions changing the broadcast
[
https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348826#comment-14348826
]
Jason Hubbard commented on SPARK-6067:
--
This occurred because of an OOM, but we have
[
https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Hubbard updated SPARK-6067:
-
Attachment: job.log
Spark sql hive dynamic partitions job will fail if task fails
[
https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345519#comment-14345519
]
Jason Hubbard commented on SPARK-6067:
--
Hi baishuo. To reproduce, create a Hive
Jason Hubbard created SPARK-6067:
Summary: Spark sql hive dynamic partitions job will fail if task
fails
Key: SPARK-6067
URL: https://issues.apache.org/jira/browse/SPARK-6067
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Hubbard updated SPARK-6067:
-
Description:
When inserting into a hive table from spark sql while using dynamic
partitioning,
19 matches
Mail list logo
