[
https://issues.apache.org/jira/browse/SPARK-42502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Niranjan Jayakar updated SPARK-42502:
-
Description:
Currently, the Spark Connect service's {{client_type}} attribute (which is
really user agent) is set to {{_SPARK_CONNECT_PYTHON}} to signify PySpark.
Accept an optional {{user_agent}} parameter in the connection string and plumb
this down to the Spark Connect service.
This enables partners using Spark Connect to set their application as the user
agent,
which then allows visibility and measurement of integrations and usages of spark
connect.
This is already done for the Python client:
https://github.com/apache/spark/commit/b887d3de954ae5b2482087fe08affcc4ac60c669
was:
Currently, the Spark Connect service's {{client_type}} attribute (which is
really user agent) is set to {{_SPARK_CONNECT_PYTHON}} to signify PySpark.
Accept an optional {{user_agent}} parameter in the connection string and plumb
this down to the Spark Connect service.
This enables partners using Spark Connect to set their application as the user
agent,
which then allows visibility and measurement of integrations and usages of spark
connect.
> scala: accept user_agent in spark connect's connection string
> -
>
> Key: SPARK-42502
> URL: https://issues.apache.org/jira/browse/SPARK-42502
> Project: Spark
> Issue Type: New Feature
> Components: Connect
>Affects Versions: 3.3.2
>Reporter: Niranjan Jayakar
>Assignee: Niranjan Jayakar
>Priority: Major
> Fix For: 3.4.0
>
>
> Currently, the Spark Connect service's {{client_type}} attribute (which is
> really user agent) is set to {{_SPARK_CONNECT_PYTHON}} to signify PySpark.
> Accept an optional {{user_agent}} parameter in the connection string and
> plumb this down to the Spark Connect service.
> This enables partners using Spark Connect to set their application as the
> user agent,
> which then allows visibility and measurement of integrations and usages of
> spark
> connect.
> This is already done for the Python client:
> https://github.com/apache/spark/commit/b887d3de954ae5b2482087fe08affcc4ac60c669
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
