[GitHub] [spark-website] xuanyuanking commented on pull request #334: update the spark-packages post
xuanyuanking commented on pull request #334: URL: https://github.com/apache/spark-website/pull/334#issuecomment-830792431 Late LGTM. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (caa46ce -> cd689c9)
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from caa46ce [SPARK-35112][SQL] Support Cast string to day-second interval add cd689c9 [SPARK-35192][SQL][TESTS] Port minimal TPC-DS datagen code from databricks/spark-sql-perf No new revisions were added by this update. Summary of changes: .github/workflows/build_and_test.yml | 31 +- .../scala/org/apache/spark/sql/GenTPCDSData.scala | 445 + .../scala/org/apache/spark/sql/TPCDSBase.scala | 537 + .../sql/{TPCDSBase.scala => TPCDSSchema.scala} | 92 +--- 4 files changed, 466 insertions(+), 639 deletions(-) create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/GenTPCDSData.scala copy sql/core/src/test/scala/org/apache/spark/sql/{TPCDSBase.scala => TPCDSSchema.scala} (83%) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (cd689c9 -> 335f00b)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from cd689c9 [SPARK-35192][SQL][TESTS] Port minimal TPC-DS datagen code from databricks/spark-sql-perf add 335f00b [SPARK-35285][SQL] Parse ANSI interval types in SQL schema No new revisions were added by this update. Summary of changes: docs/sql-ref-ansi-compliance.md| 4 ++ .../apache/spark/sql/catalyst/parser/SqlBase.g4| 14 + .../spark/sql/catalyst/parser/AstBuilder.scala | 8 +++ .../spark/sql/types/DayTimeIntervalType.scala | 2 +- .../spark/sql/types/YearMonthIntervalType.scala| 2 +- .../analysis/ExpressionTypeCheckingSuite.scala | 4 +- .../expressions/CollectionExpressionsSuite.scala | 2 +- .../sql/catalyst/parser/DataTypeParserSuite.scala | 2 + .../org/apache/spark/sql/types/DataTypeSuite.scala | 3 ++ .../apache/spark/sql/types/StructTypeSuite.scala | 8 +++ .../sql-tests/results/ansi/datetime.sql.out| 12 ++--- .../sql-tests/results/ansi/interval.sql.out| 60 +++--- .../sql-tests/results/ansi/literals.sql.out| 18 +++ .../sql-tests/results/datetime-legacy.sql.out | 12 ++--- .../resources/sql-tests/results/datetime.sql.out | 12 ++--- .../resources/sql-tests/results/extract.sql.out| 10 ++-- .../resources/sql-tests/results/interval.sql.out | 60 +++--- .../resources/sql-tests/results/literals.sql.out | 18 +++ .../typeCoercion/native/promoteStrings.sql.out | 2 +- .../native/windowFrameCoercion.sql.out | 6 +-- .../resources/sql-tests/results/window.sql.out | 2 +- 21 files changed, 150 insertions(+), 111 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (335f00b -> 2a8d7ed)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 335f00b [SPARK-35285][SQL] Parse ANSI interval types in SQL schema add 2a8d7ed [SPARK-35281][SQL] StaticInvoke should not apply boxing if return type is primitive No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/expressions/objects/objects.scala | 2 +- .../sql/catalyst/expressions/ObjectExpressionsSuite.scala | 14 +- 2 files changed, 14 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (2a8d7ed -> 44b7931)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2a8d7ed [SPARK-35281][SQL] StaticInvoke should not apply boxing if return type is primitive add 44b7931 [SPARK-35176][PYTHON] Standardize input validation error type No new revisions were added by this update. Summary of changes: python/docs/source/migration_guide/index.rst | 1 + .../pyspark_3.1_to_3.2.rst}| 19 ++- python/pyspark/ml/base.py | 6 +-- python/pyspark/ml/classification.py| 10 ++-- python/pyspark/ml/evaluation.py| 2 +- python/pyspark/ml/param/__init__.py| 2 +- python/pyspark/ml/regression.py| 4 +- python/pyspark/ml/tests/test_base.py | 23 +++-- python/pyspark/ml/tests/test_evaluation.py | 6 +++ python/pyspark/ml/tests/test_param.py | 15 ++ python/pyspark/mllib/linalg/distributed.py | 6 +-- python/pyspark/mllib/tests/test_linalg.py | 13 - python/pyspark/pandas/base.py | 4 +- python/pyspark/pandas/config.py| 4 +- python/pyspark/pandas/frame.py | 38 +++--- python/pyspark/pandas/generic.py | 2 +- python/pyspark/pandas/groupby.py | 2 +- python/pyspark/pandas/indexes/base.py | 2 +- python/pyspark/pandas/indexes/multi.py | 2 +- python/pyspark/pandas/namespace.py | 4 +- python/pyspark/pandas/plot/core.py | 4 +- python/pyspark/pandas/series.py| 22 python/pyspark/pandas/strings.py | 2 +- python/pyspark/pandas/tests/indexes/test_base.py | 22 python/pyspark/pandas/tests/test_config.py | 8 +-- python/pyspark/pandas/tests/test_dataframe.py | 52 +-- python/pyspark/pandas/tests/test_groupby.py| 2 +- python/pyspark/pandas/tests/test_namespace.py | 4 +- .../pandas/tests/test_ops_on_diff_frames.py| 2 +- python/pyspark/pandas/tests/test_series.py | 32 ++-- python/pyspark/pandas/tests/test_series_string.py | 2 +- python/pyspark/pandas/tests/test_utils.py | 2 +- python/pyspark/pandas/utils.py | 2 +- python/pyspark/sql/dataframe.py| 59 -- python/pyspark/sql/tests/test_dataframe.py | 6 +-- python/pyspark/sql/tests/test_functions.py | 6 +-- python/pyspark/taskcontext.py | 2 +- 37 files changed, 215 insertions(+), 179 deletions(-) copy python/docs/source/{reference/index.rst => migration_guide/pyspark_3.1_to_3.2.rst} (74%) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org