Jan Gorecki created SPARK-26589:
-----------------------------------
Summary: proper `median` method for spark dataframe
Key: SPARK-26589
URL: https://issues.apache.org/jira/browse/SPARK-26589
Project: Spark
Issue Type: New Feature
Components: Spark Core
Affects Versions: 2.4.0
Reporter: Jan Gorecki
I found multiple tickets asking for median function to be implemented in Spark.
Most of those tickets links to "SPARK-6761 Approximate quantile" as duplicate
of it. The thing is that approximate quantile is a workaround for lack of
median function. Thus I am filling this Feature Request for proper, exact, not
approximation of, median function. I am aware about difficulties that are
caused by distributed environment when trying to compute median, nevertheless I
don't think those difficulties is reason good enough to drop out `median`
function from scope of Spark. I am not asking about efficient median but exact
median.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
