[ https://issues.apache.org/jira/browse/SPARK-31439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan resolved SPARK-31439. --------------------------------- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28205 [https://github.com/apache/spark/pull/28205] > Perf regression of fromJavaDate > ------------------------------- > > Key: SPARK-31439 > URL: https://issues.apache.org/jira/browse/SPARK-31439 > Project: Spark > Issue Type: Sub-task > Components: SQL > Affects Versions: 3.0.0 > Reporter: Maxim Gekk > Assignee: Maxim Gekk > Priority: Major > Fix For: 3.0.0 > > > DateTimeBenchmark shows the regression > Spark 2.4.6-SNAPSHOT at the PR https://github.com/MaxGekk/spark/pull/27 > {code} > ================================================================================================ > Conversion from/to external types > ================================================================================================ > OpenJDK 64-Bit Server VM 1.8.0_242-8u242-b08-0ubuntu3~18.04-b08 on Linux > 4.15.0-1063-aws > Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz > To/from java.sql.Timestamp: Best Time(ms) Avg Time(ms) > Stdev(ms) Rate(M/s) Per Row(ns) Relative > ------------------------------------------------------------------------------------------------------------------------ > From java.sql.Date 614 655 > 43 8.1 122.8 1.0X > {code} > Current master: > {code} > ================================================================================================ > Conversion from/to external types > ================================================================================================ > OpenJDK 64-Bit Server VM 1.8.0_242-8u242-b08-0ubuntu3~18.04-b08 on Linux > 4.15.0-1063-aws > Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz > To/from java.sql.Timestamp: Best Time(ms) Avg Time(ms) > Stdev(ms) Rate(M/s) Per Row(ns) Relative > ------------------------------------------------------------------------------------------------------------------------ > From java.sql.Date 1154 1206 > 46 4.3 230.9 1.0X > {code} > The regression is ~x2. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org