Github user jzhuge commented on the issue:
https://github.com/apache/spark/pull/21709
Not quite there with SparkConf. We already uses option `--properties-file`
for a different purpose and spark-submit does not allow multiple occurrences of
`--properties-file`.
How about the
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21709
From my point, I don't see a special reason that it cannot be achieved by
SparkConf. Also you can specify different local metrics conf file for different
users/purpose, I don't think it is
Github user jzhuge commented on the issue:
https://github.com/apache/spark/pull/21709
Thx @jerryshao for looking at the PR.
Compared to spark.metrics.conf.* in SparkConf, a metrics config file can
group the properties together, separate from the rest of the properties. In my
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21709
If you want metrics conf to be centralized without needing to put it on to
different nodes, you can set it through `SparkConf` with prefix
"spark.metrics.conf.", MetricsSystem also supports
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21709
Hi @jzhuge what is the purpose of supporting reading metrics conf from
HDFS/S3?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21709
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21709
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21709
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
