[ https://issues.apache.org/jira/browse/SPARK-30131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexander Hagerf updated SPARK-30131: ------------------------------------- Description: It is known that there isn't any exact median function in Spark SQL, and this might be a difficult problem to solve efficiently. However, to find the median for an array should be a simple task, and something that users can utilize when collecting numeric values to a list or set. This can already be achieved by using sorting and choosing element, but can get cumbersome and if a fully tested function is provided in the API, I think it can solve some headache for many. was: It is known that there isn't any exact median function in Spark SQL, and this might be a difficult problem to solve efficiently. However, to find the median for an array should be a simple task, and something that users can utilize when collecting numeric values to a list or set. This can already be achieved by using sorting and choosing element, but can get cumbersome and if a fully tested function is provided in the API, I think it can solve some headache for many. > Add array_median function > ------------------------- > > Key: SPARK-30131 > URL: https://issues.apache.org/jira/browse/SPARK-30131 > Project: Spark > Issue Type: New Feature > Components: SQL > Affects Versions: 2.4.4 > Reporter: Alexander Hagerf > Priority: Minor > Fix For: 3.0.0 > > > It is known that there isn't any exact median function in Spark SQL, and this > might be a difficult problem to solve efficiently. However, to find the > median for an array should be a simple task, and something that users can > utilize when collecting numeric values to a list or set. > This can already be achieved by using sorting and choosing element, but can > get cumbersome and if a fully tested function is provided in the API, I think > it can solve some headache for many. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org