Rui Li created SPARK-25085:
--
Summary: Insert overwrite a non-partitioned table can delete table
folder
Key: SPARK-25085
URL: https://issues.apache.org/jira/browse/SPARK-25085
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16509214#comment-16509214
]
Rui Li commented on SPARK-24387:
Yes, blacklisting can be used to avoid the issue. But b
[
https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16492563#comment-16492563
]
Rui Li commented on SPARK-24387:
Instead of let HeartbeatReceiver tell TaskScheduler the
[
https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16490309#comment-16490309
]
Rui Li commented on SPARK-24387:
When HeartbeatReceiver finds the executor's heartbeat is
[
https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16490293#comment-16490293
]
Rui Li commented on SPARK-24387:
A snippet of the log w/ some fields masked:
{noformat}
[
Rui Li created SPARK-24387:
--
Summary: Heartbeat-timeout executor is added back and used again
Key: SPARK-24387
URL: https://issues.apache.org/jira/browse/SPARK-24387
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-24116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16462040#comment-16462040
]
Rui Li commented on SPARK-24116:
To reproduce:
{code}
create table test_text(x int);
ins
[
https://issues.apache.org/jira/browse/SPARK-24116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460472#comment-16460472
]
Rui Li commented on SPARK-24116:
[~hyukjin.kwon], sorry for the late response. For exampl
Rui Li created SPARK-24116:
--
Summary: SparkSQL inserting overwrite table has inconsistent
behavior regarding HDFS trash
Key: SPARK-24116
URL: https://issues.apache.org/jira/browse/SPARK-24116
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16446761#comment-16446761
]
Rui Li commented on SPARK-24010:
[~rxin], thanks for your reply. I noted that InMemoryCat
[
https://issues.apache.org/jira/browse/SPARK-24010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16442146#comment-16442146
]
Rui Li commented on SPARK-24010:
Hi [~rxin], I think checking databaseExists is added in
Rui Li created SPARK-24010:
--
Summary: Select from table needs read access on DB folder when
storage based auth is enabled
Key: SPARK-24010
URL: https://issues.apache.org/jira/browse/SPARK-24010
Project: Spar
[
https://issues.apache.org/jira/browse/SPARK-14958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15561094#comment-15561094
]
Rui Li commented on SPARK-14958:
I hit the issue with Spark 1.6.1
> Failed task hangs if
Rui Li created SPARK-14958:
--
Summary: Failed task hangs if error is encountered when getting
task result
Key: SPARK-14958
URL: https://issues.apache.org/jira/browse/SPARK-14958
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-4440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14791732#comment-14791732
]
Rui Li commented on SPARK-4440:
---
For Hive on Spark, we want completion time for each stage s
[
https://issues.apache.org/jira/browse/SPARK-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14562386#comment-14562386
]
Rui Li commented on SPARK-7081:
---
Hi [~joshrosen], requiring the dependency having no aggrega
[
https://issues.apache.org/jira/browse/SPARK-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270714#comment-14270714
]
Rui Li commented on SPARK-2621:
---
Hey [~sandyr], it seems after this change we require the in
Rui Li created SPARK-5080:
-
Summary: Expose more cluster resource information to user
Key: SPARK-5080
URL: https://issues.apache.org/jira/browse/SPARK-5080
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14261767#comment-14261767
]
Rui Li commented on SPARK-4921:
---
Hi [~sandyr], you're right. Returning PROCESS_LOCAL won't h
[
https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258074#comment-14258074
]
Rui Li commented on SPARK-4921:
---
Hi [~sandyr], I thought more on this and maybe the check I
[
https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14256425#comment-14256425
]
Rui Li commented on SPARK-4921:
---
I'm not sure if this is intended, but returning process_loc
[
https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217485#comment-14217485
]
Rui Li commented on SPARK-2321:
---
Hi [~joshrosen],
Shall we make {{SparkJobInfo}} and {{Spar
[
https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214223#comment-14214223
]
Rui Li commented on SPARK-2321:
---
Hey [~joshrosen],
Thanks a lot for the update! I created S
Rui Li created SPARK-4440:
-
Summary: Enhance the job progress API to expose more information
Key: SPARK-4440
URL: https://issues.apache.org/jira/browse/SPARK-4440
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14212000#comment-14212000
]
Rui Li commented on SPARK-2321:
---
Hi [~joshrosen],
The new API is quite useful. But the info
[
https://issues.apache.org/jira/browse/SPARK-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110172#comment-14110172
]
Rui Li commented on SPARK-2636:
---
Just want to make sure I understand everything correctly:
[
https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14092331#comment-14092331
]
Rui Li commented on SPARK-2931:
---
I think this may be introduced in
[#892|https://github.com
[
https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078798#comment-14078798
]
Rui Li commented on SPARK-2387:
---
Right, thanks [~joshrosen] for pointing out. This is just s
Rui Li created SPARK-2740:
-
Summary: In JavaPairRdd, allow user to specify ascending and
numPartitions for sortByKey
Key: SPARK-2740
URL: https://issues.apache.org/jira/browse/SPARK-2740
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073989#comment-14073989
]
Rui Li commented on SPARK-2387:
---
[~kayousterhout] Thanks for the review.
I tested this PoC w
[
https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054862#comment-14054862
]
Rui Li commented on SPARK-2387:
---
PR created at
https://github.com/apache/spark/pull/1328
>
Rui Li created SPARK-2387:
-
Summary: Remove the stage barrier for better resource utilization
Key: SPARK-2387
URL: https://issues.apache.org/jira/browse/SPARK-2387
Project: Spark
Issue Type: New Feat
[
https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14052103#comment-14052103
]
Rui Li commented on SPARK-2277:
---
With [PR #892|https://github.com/apache/spark/pull/892], we
[
https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14050952#comment-14050952
]
Rui Li commented on SPARK-2277:
---
PR created at:
https://github.com/apache/spark/pull/1212
>
[
https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14050951#comment-14050951
]
Rui Li commented on SPARK-2277:
---
Suppose task1 prefers node1 but node1 is not available at t
Rui Li created SPARK-2277:
-
Summary: Make TaskScheduler track whether there's host on a rack
Key: SPARK-2277
URL: https://issues.apache.org/jira/browse/SPARK-2277
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated SPARK-1937:
--
Attachment: RSBTest.scala
The program that triggers the problem.
With the patch, the whole execution time of th
[
https://issues.apache.org/jira/browse/SPARK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated SPARK-1937:
--
Attachment: Before-patch.png
> Tasks can be submitted before executors are registered
> ---
[
https://issues.apache.org/jira/browse/SPARK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14009490#comment-14009490
]
Rui Li commented on SPARK-1937:
---
Here's a quick fix:
https://github.com/apache/spark/pull/89
[
https://issues.apache.org/jira/browse/SPARK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated SPARK-1937:
--
Attachment: After-patch.PNG
> Tasks can be submitted before executors are registered
>
Rui Li created SPARK-1937:
-
Summary: Tasks can be submitted before executors are registered
Key: SPARK-1937
URL: https://issues.apache.org/jira/browse/SPARK-1937
Project: Spark
Issue Type: Bug
41 matches
Mail list logo