[spark] branch master updated (3267b177 -> d189cf7)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3267b177 [SPARK-35530][ML][TESTS] Fix rounding error in DifferentiableLossAggregatorSuite with Java 11 add d189cf7 Revert "[SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA" No new revisions were added by this update. Summary of changes: .github/workflows/build_and_test.yml | 80 -- dev/run-tests.py | 16 ++--- dev/sparktestsupport/modules.py| 15 .../spark/sql/jdbc/DB2IntegrationSuite.scala | 2 +- .../spark/sql/jdbc/DB2KrbIntegrationSuite.scala| 2 +- .../spark/sql/jdbc/DockerIntegrationFunSuite.scala | 54 --- .../sql/jdbc/DockerJDBCIntegrationSuite.scala | 5 +- .../sql/jdbc/DockerKrbJDBCIntegrationSuite.scala | 2 +- .../sql/jdbc/MariaDBKrbIntegrationSuite.scala | 2 +- .../sql/jdbc/MsSqlServerIntegrationSuite.scala | 2 +- .../spark/sql/jdbc/MySQLIntegrationSuite.scala | 2 +- .../spark/sql/jdbc/OracleIntegrationSuite.scala| 3 +- .../spark/sql/jdbc/PostgresIntegrationSuite.scala | 2 +- .../sql/jdbc/PostgresKrbIntegrationSuite.scala | 2 +- .../spark/sql/jdbc/v2/DB2IntegrationSuite.scala| 2 +- .../sql/jdbc/v2/MsSqlServerIntegrationSuite.scala | 2 +- .../spark/sql/jdbc/v2/MySQLIntegrationSuite.scala | 4 +- .../spark/sql/jdbc/v2/OracleIntegrationSuite.scala | 3 +- .../sql/jdbc/v2/PostgresIntegrationSuite.scala | 2 +- .../spark/sql/jdbc/v2/PostgresNamespaceSuite.scala | 2 +- .../spark/sql/jdbc/v2/V2JDBCNamespaceTest.scala| 3 +- .../org/apache/spark/sql/jdbc/v2/V2JDBCTest.scala | 3 +- 22 files changed, 27 insertions(+), 183 deletions(-) delete mode 100644 external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/DockerIntegrationFunSuite.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (0a74ad6 -> 3267b177)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 0a74ad6 [SPARK-35483][INFRA] Add docker-integration-tests to run-tests.py and GA add 3267b177 [SPARK-35530][ML][TESTS] Fix rounding error in DifferentiableLossAggregatorSuite with Java 11 No new revisions were added by this update. Summary of changes: .../spark/ml/optim/aggregator/DifferentiableLossAggregatorSuite.scala | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] maropu commented on pull request #345: Add Apache Spark 3.1.2 doc
maropu commented on pull request #345: URL: https://github.com/apache/spark-website/pull/345#issuecomment-849996964 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (29ed1a2 -> 0a74ad6)
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 29ed1a2 [SPARK-35541][SQL] Simplify OptimizeSkewedJoin
add 0a74ad6 [SPARK-35483][INFRA] Add docker-integration-tests to
run-tests.py and GA
No new revisions were added by this update.
Summary of changes:
.github/workflows/build_and_test.yml | 80 ++
dev/run-tests.py | 16 +++--
dev/sparktestsupport/modules.py| 15
.../spark/sql/jdbc/DB2IntegrationSuite.scala | 2 +-
.../spark/sql/jdbc/DB2KrbIntegrationSuite.scala| 2 +-
.../sql/jdbc/DockerIntegrationFunSuite.scala} | 22 --
.../sql/jdbc/DockerJDBCIntegrationSuite.scala | 5 +-
.../sql/jdbc/DockerKrbJDBCIntegrationSuite.scala | 2 +-
.../sql/jdbc/MariaDBKrbIntegrationSuite.scala | 2 +-
.../sql/jdbc/MsSqlServerIntegrationSuite.scala | 2 +-
.../spark/sql/jdbc/MySQLIntegrationSuite.scala | 2 +-
.../spark/sql/jdbc/OracleIntegrationSuite.scala| 3 +-
.../spark/sql/jdbc/PostgresIntegrationSuite.scala | 2 +-
.../sql/jdbc/PostgresKrbIntegrationSuite.scala | 2 +-
.../spark/sql/jdbc/v2/DB2IntegrationSuite.scala| 2 +-
.../sql/jdbc/v2/MsSqlServerIntegrationSuite.scala | 2 +-
.../spark/sql/jdbc/v2/MySQLIntegrationSuite.scala | 4 +-
.../spark/sql/jdbc/v2/OracleIntegrationSuite.scala | 3 +-
.../sql/jdbc/v2/PostgresIntegrationSuite.scala | 2 +-
.../spark/sql/jdbc/v2/PostgresNamespaceSuite.scala | 2 +-
.../spark/sql/jdbc/v2/V2JDBCNamespaceTest.scala| 3 +-
.../org/apache/spark/sql/jdbc/v2/V2JDBCTest.scala | 3 +-
22 files changed, 144 insertions(+), 34 deletions(-)
copy
external/{kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisFunSuite.scala
=>
docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/DockerIntegrationFunSuite.scala}
(68%)
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] HyukjinKwon commented on pull request #345: Add Apache Spark 3.1.2 doc
HyukjinKwon commented on pull request #345: URL: https://github.com/apache/spark-website/pull/345#issuecomment-849993433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun merged pull request #345: Add Apache Spark 3.1.2 doc
dongjoon-hyun merged pull request #345: URL: https://github.com/apache/spark-website/pull/345 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun commented on pull request #345: Add Apache Spark 3.1.2 doc
dongjoon-hyun commented on pull request #345: URL: https://github.com/apache/spark-website/pull/345#issuecomment-849968555 I'll merge this and proceed to the next steps. Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun commented on pull request #345: Add Apache Spark 3.1.2 doc
dongjoon-hyun commented on pull request #345: URL: https://github.com/apache/spark-website/pull/345#issuecomment-849965155 Thank you, @maropu ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun commented on pull request #345: Add Apache Spark 3.1.2 doc
dongjoon-hyun commented on pull request #345: URL: https://github.com/apache/spark-website/pull/345#issuecomment-849958704 Thank you, @viirya ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun commented on pull request #345: Add Apache Spark 3.1.2 doc
dongjoon-hyun commented on pull request #345: URL: https://github.com/apache/spark-website/pull/345#issuecomment-849881162 @gengliangwang . This has the update for facetFilters. Could you check the second commit? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun opened a new pull request #345: Add Apache Spark 3.1.2 doc
dongjoon-hyun opened a new pull request #345: URL: https://github.com/apache/spark-website/pull/345 - The first commit is adding the voted 3.1.2 doc and update `latest` link. - The second commit is updating `facetFilter`. ``` - 'facetFilters': ["version:3.1.1"] + 'facetFilters': ["version:3.1.2"] ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] tag v3.1.2 created (now de351e3)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to tag v3.1.2 in repository https://gitbox.apache.org/repos/asf/spark.git. at de351e3 (commit) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r47938 - /dev/spark/v3.1.2-rc1-bin/ /release/spark/spark-3.1.2/
Author: dongjoon Date: Thu May 27 16:45:18 2021 New Revision: 47938 Log: Release Apache Spark 3.1.2 Added: release/spark/spark-3.1.2/ - copied from r47937, dev/spark/v3.1.2-rc1-bin/ Removed: dev/spark/v3.1.2-rc1-bin/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (f98a063 -> 29ed1a2)
This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from f98a063 [SPARK-35172][SS] The implementation of RocksDBCheckpointMetadata add 29ed1a2 [SPARK-35541][SQL] Simplify OptimizeSkewedJoin No new revisions were added by this update. Summary of changes: .../execution/adaptive/OptimizeSkewedJoin.scala| 37 +++--- 1 file changed, 18 insertions(+), 19 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (52a1f8c -> f98a063)
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 52a1f8c [SPARK-33428][SQL] Match the behavior of conv function to MySQL's add f98a063 [SPARK-35172][SS] The implementation of RocksDBCheckpointMetadata No new revisions were added by this update. Summary of changes: .../streaming/state/RocksDBFileManager.scala | 165 + .../execution/streaming/state/RocksDBSuite.scala | 57 +++ 2 files changed, 222 insertions(+) create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/RocksDBFileManager.scala create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/RocksDBSuite.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (5bcd1c2 -> 52a1f8c)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 5bcd1c2 [SPARK-35535][SQL] New data source V2 API: LocalScan add 52a1f8c [SPARK-33428][SQL] Match the behavior of conv function to MySQL's No new revisions were added by this update. Summary of changes: .../sql/catalyst/expressions/mathExpressions.scala| 4 ++-- .../spark/sql/catalyst/util/NumberConverter.scala | 19 +++ .../org/apache/spark/sql/MathFunctionsSuite.scala | 15 +++ 3 files changed, 28 insertions(+), 10 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3e19080 -> 5bcd1c2)
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 3e19080 [SPARK-35057][SQL] Group exception messages in
hive/thriftserver
add 5bcd1c2 [SPARK-35535][SQL] New data source V2 API: LocalScan
No new revisions were added by this update.
Summary of changes:
.../spark/sql/connector/read/LocalScan.java} | 9 +-
.../datasources/v2/DataSourceV2Strategy.scala | 6 ++
.../spark/sql/connector/LocalScanSuite.scala | 95 ++
3 files changed, 107 insertions(+), 3 deletions(-)
copy
sql/{catalyst/src/main/java/org/apache/spark/sql/connector/distributions/UnspecifiedDistribution.java
=> core/src/main/java/org/apache/spark/sql/connector/read/LocalScan.java} (78%)
create mode 100644
sql/core/src/test/scala/org/apache/spark/sql/connector/LocalScanSuite.scala
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (5cc17ba -> 3e19080)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 5cc17ba [SPARK-35351][SQL][FOLLOWUP] Avoid using `loaded` variable for LEFT ANTI SMJ code-gen add 3e19080 [SPARK-35057][SQL] Group exception messages in hive/thriftserver No new revisions were added by this update. Summary of changes: .../spark/sql/errors/QueryExecutionErrors.scala| 13 + .../hive/thriftserver/HiveThriftServerErrors.scala | 62 ++ .../SparkExecuteStatementOperation.scala | 5 +- .../sql/hive/thriftserver/SparkOperation.scala | 2 +- .../sql/hive/thriftserver/SparkSQLCLIDriver.scala | 5 +- .../sql/hive/thriftserver/SparkSQLCLIService.scala | 13 +++-- .../hive/thriftserver/SparkSQLSessionManager.scala | 4 +- .../sql/hive/thriftserver/ui/ThriftServerTab.scala | 5 +- 8 files changed, 92 insertions(+), 17 deletions(-) create mode 100644 sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServerErrors.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
