RE: pyspark.sql.functions.last not working as expected

2016-08-18 Thread Alexander Peletz
ct: RE: pyspark.sql.functions.last not working as expected So here is the test case from the commit adding the first/last methods here: https://github.com/apache/spark/pull/10957/commits/defcc02a8885e884d5140b11705b764a51753162<https://urldefense.proofpoint.com/v2/ur

RE: pyspark.sql.functions.last not working as expected

2016-08-17 Thread Alexander Peletz
So here is the test case from the commit adding the first/last methods here: https://github.com/apache/spark/pull/10957/commits/defcc02a8885e884d5140b11705b764a51753162 + test("last/first with ignoreNulls") { +val nullStr: String = null +val df = Seq( + ("a", 0, nullStr),