Repository: spark Updated Branches: refs/heads/branch-1.5 6a7582ea2 -> b28295fe0
[SPARK-9907] [SQL] Python crc32 is mistakenly calling md5 Author: Reynold Xin <r...@databricks.com> Closes #8138 from rxin/SPARK-9907. (cherry picked from commit a17384fa343628cec44437da5b80b9403ecd5838) Signed-off-by: Reynold Xin <r...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b28295fe Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b28295fe Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b28295fe Branch: refs/heads/branch-1.5 Commit: b28295fe0c91405ade86e215083de25ec5bb52d9 Parents: 6a7582e Author: Reynold Xin <r...@databricks.com> Authored: Wed Aug 12 15:27:52 2015 -0700 Committer: Reynold Xin <r...@databricks.com> Committed: Wed Aug 12 15:27:58 2015 -0700 ---------------------------------------------------------------------- python/pyspark/sql/functions.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/b28295fe/python/pyspark/sql/functions.py ---------------------------------------------------------------------- diff --git a/python/pyspark/sql/functions.py b/python/pyspark/sql/functions.py index 95f4604..e989795 100644 --- a/python/pyspark/sql/functions.py +++ b/python/pyspark/sql/functions.py @@ -885,10 +885,10 @@ def crc32(col): returns the value as a bigint. >>> sqlContext.createDataFrame([('ABC',)], ['a']).select(crc32('a').alias('crc32')).collect() - [Row(crc32=u'902fbdd2b1df0c4f70b4a5d23525e932')] + [Row(crc32=2743272264)] """ sc = SparkContext._active_spark_context - return Column(sc._jvm.functions.md5(_to_java_column(col))) + return Column(sc._jvm.functions.crc32(_to_java_column(col))) @ignore_unicode_prefix --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
