[spark] branch master updated (2437878 -> ab92e17)
This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2437878 [SPARK-29502][SQL] typed interval expression should fail for invalid format add ab92e17 [SPARK-29512][SQL] REPAIR TABLE should look up catalog/table like v2 commands No new revisions were added by this update. Summary of changes: .../apache/spark/sql/catalyst/parser/SqlBase.g4| 2 +- .../spark/sql/catalyst/parser/AstBuilder.scala | 12 .../sql/catalyst/plans/logical/statements.scala| 5 .../spark/sql/catalyst/parser/DDLParserSuite.scala | 6 .../catalyst/analysis/ResolveSessionCatalog.scala | 32 ++ .../spark/sql/execution/SparkSqlParser.scala | 14 -- .../spark/sql/connector/DataSourceV2SQLSuite.scala | 12 .../sql/execution/command/DDLParserSuite.scala | 9 -- 8 files changed, 56 insertions(+), 36 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (e4b4a35 -> 2437878)
This is an automated email from the ASF dual-hosted git repository. yumwang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from e4b4a35 [SPARK-29466][WEBUI] Show `Duration` for running drivers in Standalone master web UI add 2437878 [SPARK-29502][SQL] typed interval expression should fail for invalid format No new revisions were added by this update. Summary of changes: .../org/apache/spark/sql/catalyst/parser/AstBuilder.scala | 10 +- .../spark/sql/catalyst/parser/ExpressionParserSuite.scala | 7 +++ 2 files changed, 12 insertions(+), 5 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (4cfce3e -> e4b4a35)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4cfce3e [SPARK-29494][SQL] Fix for ArrayOutofBoundsException while converting string to timestamp add e4b4a35 [SPARK-29466][WEBUI] Show `Duration` for running drivers in Standalone master web UI No new revisions were added by this update. Summary of changes: .../apache/spark/deploy/master/ui/MasterPage.scala | 22 +- 1 file changed, 17 insertions(+), 5 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated: Revert "[SPARK-29494][SQL] Fix for ArrayOutofBoundsException while converting string to timestamp"
This is an automated email from the ASF dual-hosted git repository.
zsxwing pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new b094774 Revert "[SPARK-29494][SQL] Fix for ArrayOutofBoundsException
while converting string to timestamp"
b094774 is described below
commit b09477415f8cbff5292066c438f65af15622
Author: Shixiong Zhu
AuthorDate: Fri Oct 18 15:21:35 2019 -0700
Revert "[SPARK-29494][SQL] Fix for ArrayOutofBoundsException while
converting string to timestamp"
This reverts commit 4d476ed44a36eadb0b21b88d0f6420d52a80cc9d.
---
.../scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala| 2 +-
.../org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala | 6 --
2 files changed, 1 insertion(+), 7 deletions(-)
diff --git
a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
index 5deb83e..cc3fcb2 100644
---
a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
+++
b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
@@ -378,7 +378,7 @@ object DateTimeUtils {
i += 1
}
} else {
- if (i < segments.length && (b == ':' || b == ' ')) {
+ if (b == ':' || b == ' ') {
segments(i) = currentSegmentValue
currentSegmentValue = 0
i += 1
diff --git
a/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
b/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
index 4496ec8..abdb916 100644
---
a/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
+++
b/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
@@ -581,12 +581,6 @@ class DateTimeUtilsSuite extends SparkFunSuite {
}
}
- test("trailing characters while converting string to timestamp") {
-val s = UTF8String.fromString("2019-10-31T10:59:23Z:::")
-val time = DateTimeUtils.stringToTimestamp(s, defaultZoneId)
-assert(time == None)
- }
-
test("truncTimestamp") {
def testTrunc(
level: Int,
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated: [SPARK-29494][SQL] Fix for ArrayOutofBoundsException while converting string to timestamp
This is an automated email from the ASF dual-hosted git repository.
srowen pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 4d476ed [SPARK-29494][SQL] Fix for ArrayOutofBoundsException while
converting string to timestamp
4d476ed is described below
commit 4d476ed44a36eadb0b21b88d0f6420d52a80cc9d
Author: Rahul Mahadev
AuthorDate: Fri Oct 18 16:45:25 2019 -0500
[SPARK-29494][SQL] Fix for ArrayOutofBoundsException while converting
string to timestamp
### What changes were proposed in this pull request?
* Adding an additional check in `stringToTimestamp` to handle cases where
the input has trailing ':'
* Added a test to make sure this works.
### Why are the changes needed?
In a couple of scenarios while converting from String to Timestamp
`DateTimeUtils.stringToTimestamp` throws an array out of bounds exception if
there is trailing ':'. The behavior of this method requires it to return
`None` in case the format of the string is incorrect.
### Does this PR introduce any user-facing change?
No
### How was this patch tested?
Added a test in the `DateTimeTestUtils` suite to test if my fix works.
Closes #26143 from rahulsmahadev/SPARK-29494.
Lead-authored-by: Rahul Mahadev
Co-authored-by: Rahul Shivu Mahadev
<51690557+rahulsmaha...@users.noreply.github.com>
Signed-off-by: Sean Owen
(cherry picked from commit 4cfce3e5d03b0badb4e9685499be2ab0fca5747a)
Signed-off-by: Sean Owen
---
.../scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala| 2 +-
.../org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala | 6 ++
2 files changed, 7 insertions(+), 1 deletion(-)
diff --git
a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
index cc3fcb2..5deb83e 100644
---
a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
+++
b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
@@ -378,7 +378,7 @@ object DateTimeUtils {
i += 1
}
} else {
- if (b == ':' || b == ' ') {
+ if (i < segments.length && (b == ':' || b == ' ')) {
segments(i) = currentSegmentValue
currentSegmentValue = 0
i += 1
diff --git
a/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
b/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
index abdb916..4496ec8 100644
---
a/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
+++
b/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala
@@ -581,6 +581,12 @@ class DateTimeUtilsSuite extends SparkFunSuite {
}
}
+ test("trailing characters while converting string to timestamp") {
+val s = UTF8String.fromString("2019-10-31T10:59:23Z:::")
+val time = DateTimeUtils.stringToTimestamp(s, defaultZoneId)
+assert(time == None)
+ }
+
test("truncTimestamp") {
def testTrunc(
level: Int,
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (23f45f1 -> 4cfce3e)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 23f45f1 [SPARK-29515][CORE] MapStatuses SerDeser Benchmark add 4cfce3e [SPARK-29494][SQL] Fix for ArrayOutofBoundsException while converting string to timestamp No new revisions were added by this update. Summary of changes: .../scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala| 2 +- .../org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala | 6 ++ 2 files changed, 7 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (9a3dcca -> 23f45f1)
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 9a3dcca [SPARK-29379][SQL] SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' add 23f45f1 [SPARK-29515][CORE] MapStatuses SerDeser Benchmark No new revisions were added by this update. Summary of changes: .../MapStatusesSerDeserBenchmark-jdk11-results.txt | 66 +++ .../MapStatusesSerDeserBenchmark-results.txt | 66 +++ .../scala/org/apache/spark/MapOutputTracker.scala | 4 +- .../spark/MapStatusesSerDeserBenchmark.scala | 130 + 4 files changed, 264 insertions(+), 2 deletions(-) create mode 100644 core/benchmarks/MapStatusesSerDeserBenchmark-jdk11-results.txt create mode 100644 core/benchmarks/MapStatusesSerDeserBenchmark-results.txt create mode 100644 core/src/test/scala/org/apache/spark/MapStatusesSerDeserBenchmark.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (9a3dcca -> 23f45f1)
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 9a3dcca [SPARK-29379][SQL] SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' add 23f45f1 [SPARK-29515][CORE] MapStatuses SerDeser Benchmark No new revisions were added by this update. Summary of changes: .../MapStatusesSerDeserBenchmark-jdk11-results.txt | 66 +++ .../MapStatusesSerDeserBenchmark-results.txt | 66 +++ .../scala/org/apache/spark/MapOutputTracker.scala | 4 +- .../spark/MapStatusesSerDeserBenchmark.scala | 130 + 4 files changed, 264 insertions(+), 2 deletions(-) create mode 100644 core/benchmarks/MapStatusesSerDeserBenchmark-jdk11-results.txt create mode 100644 core/benchmarks/MapStatusesSerDeserBenchmark-results.txt create mode 100644 core/src/test/scala/org/apache/spark/MapStatusesSerDeserBenchmark.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (9e42c52 -> 9a3dcca)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 9e42c52 [MINOR][DOCS] Fix incorrect EqualNullSafe symbol in sql-migration-guide.md add 9a3dcca [SPARK-29379][SQL] SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' No new revisions were added by this update. Summary of changes: .../apache/spark/sql/execution/command/functions.scala | 18 +- .../scala/org/apache/spark/sql/SQLQuerySuite.scala | 4 +++- .../apache/spark/sql/execution/command/DDLSuite.scala | 3 ++- .../apache/spark/sql/hive/execution/HiveUDFSuite.scala | 4 +++- .../spark/sql/hive/execution/SQLQuerySuite.scala | 7 ++- 5 files changed, 31 insertions(+), 5 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated (90139f6 -> 65c0a78)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 90139f6 [SPARK-27259][CORE] Allow setting -1 as length for FileBlock add 65c0a78 [SPARK-27812][K8S][2.4] Bump K8S client version to 4.6.1 No new revisions were added by this update. Summary of changes: dev/deps/spark-deps-hadoop-2.6 | 11 +-- dev/deps/spark-deps-hadoop-2.7 | 11 +-- dev/deps/spark-deps-hadoop-3.1 | 11 +-- resource-managers/kubernetes/core/pom.xml | 8 +--- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- 5 files changed, 17 insertions(+), 26 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (77fe8a8 -> 9e42c52)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 77fe8a8 [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` add 9e42c52 [MINOR][DOCS] Fix incorrect EqualNullSafe symbol in sql-migration-guide.md No new revisions were added by this update. Summary of changes: docs/sql-migration-guide.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (c3a0d02 -> 77fe8a8)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c3a0d02 [SPARK-28560][SQL][FOLLOWUP] resolve the remaining comments for PR#25295 add 77fe8a8 [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` No new revisions were added by this update. Summary of changes: .../catalyst/expressions/datetimeExpressions.scala | 40 +- .../catalyst/expressions/intervalExpressions.scala | 111 + .../spark/sql/catalyst/util/IntervalUtils.scala| 91 .../expressions/IntervalExpressionsSuite.scala | 192 + .../test/resources/sql-tests/inputs/date_part.sql | 75 .../resources/sql-tests/results/date_part.sql.out | 470 - 6 files changed, 970 insertions(+), 9 deletions(-) create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/intervalExpressions.scala create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/IntervalExpressionsSuite.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (39af51d -> c3a0d02)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 39af51d [SPARK-29014][SQL] DataSourceV2: Fix current/default catalog usage add c3a0d02 [SPARK-28560][SQL][FOLLOWUP] resolve the remaining comments for PR#25295 No new revisions were added by this update. Summary of changes: .../adaptive/OptimizeLocalShuffleReader.scala | 2 +- .../adaptive/AdaptiveQueryExecSuite.scala | 22 -- 2 files changed, 17 insertions(+), 7 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (7435146 -> 39af51d)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 7435146 [SPARK-29482][SQL] ANALYZE TABLE should look up catalog/table like v2 commands add 39af51d [SPARK-29014][SQL] DataSourceV2: Fix current/default catalog usage No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/analysis/Analyzer.scala | 42 ++-- .../sql/catalyst/analysis/ResolveCatalogs.scala| 5 +-- .../sql/connector/catalog/CatalogManager.scala | 15 +-- .../sql/connector/catalog/LookupCatalog.scala | 31 +++ .../sql/connector/catalog/LookupCatalogSuite.scala | 46 +++--- .../org/apache/spark/sql/DataFrameWriter.scala | 18 + .../org/apache/spark/sql/DataFrameWriterV2.scala | 5 +-- .../catalyst/analysis/ResolveSessionCatalog.scala | 3 +- .../DataSourceV2DataFrameSessionCatalogSuite.scala | 2 +- .../DataSourceV2SQLSessionCatalogSuite.scala | 2 +- .../spark/sql/connector/DataSourceV2SQLSuite.scala | 17 .../execution/command/PlanResolutionSuite.scala| 6 +-- 12 files changed, 98 insertions(+), 94 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (dba673f -> 7435146)
This is an automated email from the ASF dual-hosted git repository. gengliang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from dba673f [SPARK-29489][ML][PYSPARK] ml.evaluation support log-loss add 7435146 [SPARK-29482][SQL] ANALYZE TABLE should look up catalog/table like v2 commands No new revisions were added by this update. Summary of changes: .../apache/spark/sql/catalyst/parser/SqlBase.g4| 2 +- .../spark/sql/catalyst/parser/AstBuilder.scala | 48 ++ .../sql/catalyst/plans/logical/statements.scala| 19 ++ .../spark/sql/catalyst/parser/DDLParserSuite.scala | 76 ++ .../catalyst/analysis/ResolveSessionCatalog.scala | 20 +- .../spark/sql/execution/SparkSqlParser.scala | 49 -- .../spark/sql/connector/DataSourceV2SQLSuite.scala | 17 + .../spark/sql/execution/SparkSqlParserSuite.scala | 62 -- 8 files changed, 180 insertions(+), 113 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (6f8c001 -> dba673f)
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 6f8c001 [SPARK-29381][FOLLOWUP][PYTHON][ML] Add 'private' _XXXParams classes for classification & regression add dba673f [SPARK-29489][ML][PYSPARK] ml.evaluation support log-loss No new revisions were added by this update. Summary of changes: .../MulticlassClassificationEvaluator.scala| 77 +++-- .../spark/mllib/evaluation/MulticlassMetrics.scala | 62 + .../MulticlassClassificationEvaluatorSuite.scala | 20 ++ .../mllib/evaluation/MulticlassMetricsSuite.scala | 78 ++ python/pyspark/ml/evaluation.py| 59 python/pyspark/mllib/evaluation.py | 22 +- 6 files changed, 270 insertions(+), 48 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (6f8c001 -> dba673f)
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 6f8c001 [SPARK-29381][FOLLOWUP][PYTHON][ML] Add 'private' _XXXParams classes for classification & regression add dba673f [SPARK-29489][ML][PYSPARK] ml.evaluation support log-loss No new revisions were added by this update. Summary of changes: .../MulticlassClassificationEvaluator.scala| 77 +++-- .../spark/mllib/evaluation/MulticlassMetrics.scala | 62 + .../MulticlassClassificationEvaluatorSuite.scala | 20 ++ .../mllib/evaluation/MulticlassMetricsSuite.scala | 78 ++ python/pyspark/ml/evaluation.py| 59 python/pyspark/mllib/evaluation.py | 22 +- 6 files changed, 270 insertions(+), 48 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (5692680 -> 6f8c001)
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 5692680 [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data add 6f8c001 [SPARK-29381][FOLLOWUP][PYTHON][ML] Add 'private' _XXXParams classes for classification & regression No new revisions were added by this update. Summary of changes: python/pyspark/ml/classification.py | 501 python/pyspark/ml/regression.py | 216 +--- 2 files changed, 392 insertions(+), 325 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (ef4c298 -> 5692680)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ef4c298 [SPARK-29405][SQL] Alter table / Insert statements should not change a table's ownership add 5692680 [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data No new revisions were added by this update. Summary of changes: .../sql/hive/execution/InsertIntoHiveTable.scala | 68 +++--- .../spark/sql/hive/execution/SQLQuerySuite.scala | 80 ++ 2 files changed, 139 insertions(+), 9 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (78b0cbe -> ef4c298)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 78b0cbe [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values add ef4c298 [SPARK-29405][SQL] Alter table / Insert statements should not change a table's ownership No new revisions were added by this update. Summary of changes: .../org/apache/spark/sql/hive/client/HiveClientImpl.scala | 3 ++- .../org/apache/spark/sql/hive/client/VersionsSuite.scala| 13 + 2 files changed, 15 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (ec5d698 -> 78b0cbe)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ec5d698 [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED add 78b0cbe [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/json/JSONOptions.scala | 5 .../spark/sql/catalyst/json/JacksonGenerator.scala | 3 +++ .../org/apache/spark/sql/internal/SQLConf.scala| 8 +++ .../sql/catalyst/json/JacksonGeneratorSuite.scala | 27 ++ 4 files changed, 43 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (8616109 -> ec5d698)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 8616109 [SPARK-9853][CORE][FOLLOW-UP] Regularize all the shuffle configurations related to adaptive execution add ec5d698 [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED No new revisions were added by this update. Summary of changes: .../spark/sql/execution/DataSourceScanExec.scala | 43 - .../org/apache/spark/sql/execution/subquery.scala | 2 +- .../results/describe-part-after-analyze.sql.out| 28 - .../describe-table-after-alter-table.sql.out | 10 +-- .../resources/sql-tests/results/describe.sql.out | 16 ++--- .../resources/sql-tests/results/explain.sql.out| 72 ++ .../sql-tests/results/show-tables.sql.out | 6 +- .../scala/org/apache/spark/sql/ExplainSuite.scala | 17 - .../org/apache/spark/sql/SQLQueryTestSuite.scala | 4 +- 9 files changed, 162 insertions(+), 36 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (901ff92 -> 8616109)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 901ff92 [SPARK-29464][PYTHON][ML] PySpark ML should expose Params.clear() to unset a user supplied Param add 8616109 [SPARK-9853][CORE][FOLLOW-UP] Regularize all the shuffle configurations related to adaptive execution No new revisions were added by this update. Summary of changes: .../spark/shuffle/BlockStoreShuffleReader.scala| 2 +- .../shuffle/BlockStoreShuffleReaderSuite.scala | 3 +- .../org/apache/spark/sql/internal/SQLConf.scala| 50 ++ 3 files changed, 25 insertions(+), 30 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
