Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20481
@vanzin NVM. I was wrong. The issue is indeed not related to this PR.
Please take a look at https://issues.apache.org/jira/browse/SPARK-23470
---
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20481
Indices in the in-memory store are kinda dumb right now. It should be
possible to do something smarter but that would increase memory usage.
It would also be good to know what "large
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20481
IIUC we use index a lot in the UI code, @vanzin is it possible to support
index for in-memory kv store?
---
-
To unsubscribe,
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20481
I didn't know InMemoryStore doesn't have any index... Just saw the UI is
very slow on a large cluster and it causes read timeout.
---
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20481
thanks, merging to master/2.3!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87005/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20481
**[Test build #87005 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87005/testReport)**
for PR 20481 at commit
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20481
> There's already a test for the cleanup, it'd be nice if it were tweaked
to cover the changes here.
I created separated tests for job/stage/task/execution as the existing
cleanup test is
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20481
**[Test build #87005 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87005/testReport)**
for PR 20481 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/540/
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/20481
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86954/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20481
**[Test build #86954 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86954/testReport)**
for PR 20481 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86953/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20481
**[Test build #86953 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86953/testReport)**
for PR 20481 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86952/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20481
**[Test build #86952 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86952/testReport)**
for PR 20481 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86947/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20481
**[Test build #86947 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86947/testReport)**
for PR 20481 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20481
The logic looks ok. Did you look at adding a test in
`AppStatusListenerSuite` for this? There's already a test for the cleanup, it'd
be nice if it were tweaked to cover the changes here.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20481
**[Test build #86954 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86954/testReport)**
for PR 20481 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/496/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20481
**[Test build #86953 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86953/testReport)**
for PR 20481 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/495/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20481
> This is fine, but if you want you can probably replace the filters in the
listener by setting this to -1 for running jobs / stages / others, and starting
iteration at "0".
Not sure if I
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20481
> I cannot iterate tasks using two indices.
You can actually; indices can have a parent index, and there's actually a
bunch of examples in `TaskDataWrapper`.
Use them like this.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/494/
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20481
@vanzin just updated it. I don't fix the task order as I think it's already
using `stage` index and I cannot iterate tasks using two indices.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20481
**[Test build #86952 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86952/testReport)**
for PR 20481 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/493/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20481
**[Test build #86947 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86947/testReport)**
for PR 20481 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20481
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/489/
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20481
cc @vanzin @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
44 matches
Mail list logo
