[ https://issues.apache.org/jira/browse/SPARK-48298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated SPARK-48298: ------------------------------ Description: Currently, the StatsdSink in Spark supports UDP mode only, which is the default mode of StatsD. However, in real production environments, we often find that a more reliable transmission of metrics is needed to avoid metrics lose in high-traffic systems. TCP mode is already supported by Statsd: [https://github.com/statsd/statsd/blob/master/docs/server.md] Prometheus' statsd_exporter: [https://github.com/prometheus/statsd_exporter] and also many other Statsd-based metrics proxies/receivers. was: Currently, the StatsdSink in Spark supports UDP mode only, which is the default mode of StatsD. However, in real production environments, we often find that a more reliable transmission of metrics is needed to avoid metrics lose in high-traffic systems. TCP mode is already supported by Statsd: [https://github.com/statsd/statsd/blob/master/docs/server.md] Prometheus' statsd_exporter: [https://github.com/prometheus/statsd_exporter] and also many other Statsd-based metrics proxy/receiver. > StatsdSink supports TCP mode > ---------------------------- > > Key: SPARK-48298 > URL: https://issues.apache.org/jira/browse/SPARK-48298 > Project: Spark > Issue Type: New Feature > Components: Spark Core > Affects Versions: 4.0.0 > Reporter: Eric Yang > Priority: Major > > Currently, the StatsdSink in Spark supports UDP mode only, which is the > default mode of StatsD. However, in real production environments, we often > find that a more reliable transmission of metrics is needed to avoid metrics > lose in high-traffic systems. > > TCP mode is already supported by Statsd: > [https://github.com/statsd/statsd/blob/master/docs/server.md] > Prometheus' statsd_exporter: [https://github.com/prometheus/statsd_exporter] > and also many other Statsd-based metrics proxies/receivers. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org