dongjoon-hyun commented on PR #45326:
URL: https://github.com/apache/spark/pull/45326#issuecomment-1989108153
It seems that one of `ClientStreamingQuerySuite` test hangs due to the
independent flakiness. Could you re-trigger it when it fails?
```
[info] *** Test still running after 3
chaoqin-li1123 commented on code in PR #45023:
URL: https://github.com/apache/spark/pull/45023#discussion_r1520229021
##
python/pyspark/sql/datasource.py:
##
@@ -298,6 +320,133 @@ def read(self, partition: InputPartition) ->
Iterator[Union[Tuple, Row]]:
...
+class
sunchao commented on code in PR #45267:
URL: https://github.com/apache/spark/pull/45267#discussion_r1520187304
##
sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/functions/ReducibleFunction.java:
##
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software
rayhondo opened a new pull request, #45465:
URL: https://github.com/apache/spark/pull/45465
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How
GideonPotok commented on PR #45453:
URL: https://github.com/apache/spark/pull/45453#issuecomment-1989191094
> @GideonPotok - I think that better approach for benchmarking collation
track is to start with the basics. e.g. unit benchmarks against
`CollationFactory` +`UTF8String`. E.g. what
sunchao commented on code in PR #45267:
URL: https://github.com/apache/spark/pull/45267#discussion_r1520267117
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/physical/partitioning.scala:
##
@@ -635,6 +636,22 @@ trait ShuffleSpec {
*/
def
ahshahid commented on code in PR #45343:
URL: https://github.com/apache/spark/pull/45343#discussion_r1520323348
##
sql/core/src/test/scala/org/apache/spark/sql/DataFrameSelfJoinSuite.scala:
##
@@ -498,4 +559,70 @@ class DataFrameSelfJoinSuite extends QueryTest with
chaoqin-li1123 commented on code in PR #45023:
URL: https://github.com/apache/spark/pull/45023#discussion_r1520368942
##
sql/core/src/test/scala/org/apache/spark/sql/execution/python/PythonStreamingDataSourceSuite.scala:
##
@@ -0,0 +1,233 @@
+/*
+ * Licensed to the Apache
allisonwang-db commented on code in PR #45023:
URL: https://github.com/apache/spark/pull/45023#discussion_r1520455477
##
sql/core/src/main/scala/org/apache/spark/sql/execution/python/PythonStreamingSourceRunner.scala:
##
@@ -0,0 +1,208 @@
+/*
+ * Licensed to the Apache Software
allisonwang-db opened a new pull request, #45468:
URL: https://github.com/apache/spark/pull/45468
### What changes were proposed in this pull request?
This PR adds an extra config to env.createPythonWorker to make daemon mode
configurable to give more flexibility when
rayhondo closed pull request #45465: Raykim/iceberg 150
URL: https://github.com/apache/spark/pull/45465
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
dongjoon-hyun closed pull request #45459:
[SPARK-45245][CONNECT][TESTS][FOLLOW-UP] Remove unneeded Matchers trait in the
test
URL: https://github.com/apache/spark/pull/45459
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
dongjoon-hyun commented on PR #45459:
URL: https://github.com/apache/spark/pull/45459#issuecomment-1989103412
Merged to master. Thank you all.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
allisonwang-db commented on code in PR #45023:
URL: https://github.com/apache/spark/pull/45023#discussion_r1520450074
##
python/pyspark/sql/datasource.py:
##
@@ -298,6 +320,133 @@ def read(self, partition: InputPartition) ->
Iterator[Union[Tuple, Row]]:
...
+class
erenavsarogullari commented on code in PR #45234:
URL: https://github.com/apache/spark/pull/45234#discussion_r1520503365
##
sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala:
##
@@ -897,6 +897,138 @@ class AdaptiveQueryExecSuite
}
dongjoon-hyun commented on PR #45463:
URL: https://github.com/apache/spark/pull/45463#issuecomment-1989098700
Thank you, @cashmand and all. Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
dongjoon-hyun closed pull request #45463: [SPARK-45827][SQL][FOLLOWUP] Fix for
collation
URL: https://github.com/apache/spark/pull/45463
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
shujingyang-db commented on code in PR #45411:
URL: https://github.com/apache/spark/pull/45411#discussion_r1520393576
##
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/xml/XmlInferSchemaSuite.scala:
##
@@ -0,0 +1,296 @@
+/*
+ * Licensed to the Apache
ahshahid commented on code in PR #45343:
URL: https://github.com/apache/spark/pull/45343#discussion_r1520395436
##
sql/core/src/test/scala/org/apache/spark/sql/DataFrameSelfJoinSuite.scala:
##
@@ -498,4 +559,70 @@ class DataFrameSelfJoinSuite extends QueryTest with
jingz-db opened a new pull request, #45467:
URL: https://github.com/apache/spark/pull/45467
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How
anishshri-db commented on code in PR #45051:
URL: https://github.com/apache/spark/pull/45051#discussion_r1520472228
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StatefulProcessorHandleImpl.scala:
##
@@ -121,6 +123,46 @@ class StatefulProcessorHandleImpl(
dongjoon-hyun commented on PR #45451:
URL: https://github.com/apache/spark/pull/45451#issuecomment-1989111676
Thank you, @panbingkun .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
ahshahid commented on code in PR #45343:
URL: https://github.com/apache/spark/pull/45343#discussion_r1520314613
##
sql/core/src/test/scala/org/apache/spark/sql/DataFrameSelfJoinSuite.scala:
##
@@ -498,4 +559,70 @@ class DataFrameSelfJoinSuite extends QueryTest with
yhosny opened a new pull request, #45466:
URL: https://github.com/apache/spark/pull/45466
### What changes were proposed in this pull request?
Convert JsonFunctiosnSuite.scala to XML equivalent. Note that XML doesn’t
implement all json functions like json_tuple,
shujingyang-db commented on code in PR #45411:
URL: https://github.com/apache/spark/pull/45411#discussion_r1520394446
##
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/xml/TestXmlData.scala:
##
@@ -68,4 +68,444 @@ private[xml] trait TestXmlData {
f(dir)
allisonwang-db commented on code in PR #45023:
URL: https://github.com/apache/spark/pull/45023#discussion_r1520455477
##
sql/core/src/main/scala/org/apache/spark/sql/execution/python/PythonStreamingSourceRunner.scala:
##
@@ -0,0 +1,208 @@
+/*
+ * Licensed to the Apache Software
allisonwang-db commented on PR #45468:
URL: https://github.com/apache/spark/pull/45468#issuecomment-1989589046
cc @ueshin @HyukjinKwon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
anishshri-db commented on code in PR #45051:
URL: https://github.com/apache/spark/pull/45051#discussion_r1520519676
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StatefulProcessorHandleImpl.scala:
##
@@ -121,6 +123,46 @@ class StatefulProcessorHandleImpl(
ueshin commented on code in PR #45468:
URL: https://github.com/apache/spark/pull/45468#discussion_r1520516470
##
core/src/main/scala/org/apache/spark/SparkEnv.scala:
##
@@ -141,20 +141,22 @@ class SparkEnv (
pythonExec: String,
workerModule: String,
wbo4958 commented on PR #45232:
URL: https://github.com/apache/spark/pull/45232#issuecomment-1989639850
Hi @grundprinzip, Could you help review it again?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
dongjoon-hyun closed pull request #45451: [SPARK-47339][BUILD] Upgrade
checkStyle to `10.14.0`
URL: https://github.com/apache/spark/pull/45451
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
jingz-db commented on code in PR #45341:
URL: https://github.com/apache/spark/pull/45341#discussion_r1520256936
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MapStateImpl.scala:
##
@@ -0,0 +1,109 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF)
anishshri-db commented on code in PR #45360:
URL: https://github.com/apache/spark/pull/45360#discussion_r1520296736
##
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/RocksDBSuite.scala:
##
@@ -536,6 +536,67 @@ class RocksDBSuite extends
anishshri-db commented on code in PR #45360:
URL: https://github.com/apache/spark/pull/45360#discussion_r1520296947
##
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/RocksDBSuite.scala:
##
@@ -582,7 +636,7 @@ class RocksDBSuite extends
dongjoon-hyun commented on PR #45408:
URL: https://github.com/apache/spark/pull/45408#issuecomment-1989116494
Could you do the following to re-generate the golden files, @ted-jenks ?
```
SPARK_GENERATE_GOLDEN_FILES=1 build/sbt "sql/testOnly
org.apache.spark.sql.SQLQueryTestSuite"
shujingyang-db commented on code in PR #45411:
URL: https://github.com/apache/spark/pull/45411#discussion_r1520393576
##
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/xml/XmlInferSchemaSuite.scala:
##
@@ -0,0 +1,296 @@
+/*
+ * Licensed to the Apache
anishshri-db commented on code in PR #45051:
URL: https://github.com/apache/spark/pull/45051#discussion_r1520520070
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/TransformWithStateExec.scala:
##
@@ -103,8 +116,12 @@ case class TransformWithStateExec(
HyukjinKwon commented on PR #45448:
URL: https://github.com/apache/spark/pull/45448#issuecomment-1989657160
seems the test failure is related
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
HyukjinKwon closed pull request #45460: [SPARK-47341][Connect] Replace commands
with relations in a few tests in SparkConnectClientSuite
URL: https://github.com/apache/spark/pull/45460
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
allisonwang-db commented on code in PR #45468:
URL: https://github.com/apache/spark/pull/45468#discussion_r1520588014
##
core/src/main/scala/org/apache/spark/api/python/StreamingPythonRunner.scala:
##
@@ -68,17 +68,11 @@ private[spark] class StreamingPythonRunner(
HyukjinKwon commented on PR #45436:
URL: https://github.com/apache/spark/pull/45436#issuecomment-1989650161
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
HyukjinKwon closed pull request #45436: [SPARK-47327][SQL] Fix thread safety
issue in ICU Collator
URL: https://github.com/apache/spark/pull/45436
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
nchammas commented on PR #45461:
URL: https://github.com/apache/spark/pull/45461#issuecomment-1989744426
Ah, the test failure is due to the generated error documentation that is
checked in to git.
#44971 will eliminate this kind of maintenance headache. (Also, look at that
diff
panbingkun commented on PR #45469:
URL: https://github.com/apache/spark/pull/45469#issuecomment-1989791290
This issue has existed since version `3.4.0`. After this PR, I will submit
`a patch` to fix the doc in `spark-website`.
panbingkun commented on PR #45326:
URL: https://github.com/apache/spark/pull/45326#issuecomment-1990682229
@dongjoon-hyun
To be more `reliable`, I will convert this pr from `draft` to `review` until
GA can run successfully.
I have tried the test `ClientStreamingQuerySuite ` several
HyukjinKwon closed pull request #45411: [SPARK-47309][SQL][XML] Add schema
inference unit tests
URL: https://github.com/apache/spark/pull/45411
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
HeartSaVioR commented on code in PR #45341:
URL: https://github.com/apache/spark/pull/45341#discussion_r1520688468
##
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/MapStateSuite.scala:
##
@@ -67,6 +67,7 @@ class MapStateSuite extends
HeartSaVioR commented on code in PR #45341:
URL: https://github.com/apache/spark/pull/45341#discussion_r1520711461
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MapStateImpl.scala:
##
@@ -73,24 +74,31 @@ class MapStateImpl[K, V](
}
/** Get the map
yaooqinn commented on PR #45469:
URL: https://github.com/apache/spark/pull/45469#issuecomment-1989889832
Merged to master.
Thank you all.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
yaooqinn closed pull request #45469: [MINOR][DOCS] Remove the extra text on
page sql-error-conditions-sqlstates
URL: https://github.com/apache/spark/pull/45469
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
yaooqinn closed pull request #45440: [SPARK-46043][SQL][FOLLOWUP] do not
resolve v2 table provider with custom session catalog
URL: https://github.com/apache/spark/pull/45440
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
yaooqinn commented on PR #45440:
URL: https://github.com/apache/spark/pull/45440#issuecomment-1989935613
Merged to master
Thank you @cloud-fan @allisonwang-db
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
HeartSaVioR commented on PR #45360:
URL: https://github.com/apache/spark/pull/45360#issuecomment-1990520156
Thanks! Merging to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
HeartSaVioR closed pull request #45360: [SPARK-47250][SS] Add additional
validations and NERF changes for RocksDB state provider and use of column
families
URL: https://github.com/apache/spark/pull/45360
--
This is an automated message from the Apache Git Service.
To respond to the message,
panbingkun opened a new pull request, #45469:
URL: https://github.com/apache/spark/pull/45469
### What changes were proposed in this pull request?
The pr aims to remove the extra text `.. include:: /shared/replacements.md`
on page `sql-error-conditions-sqlstates.md`.
### Why are
panbingkun commented on PR #45469:
URL: https://github.com/apache/spark/pull/45469#issuecomment-1989938050
The pr related to spark-website is here:
https://github.com/apache/spark-website/pull/508
--
This is an automated message from the Apache Git Service.
To respond to the message,
WweiL commented on PR #45448:
URL: https://github.com/apache/spark/pull/45448#issuecomment-1990155844
Closing this since https://github.com/apache/spark/pull/45468 has the same
change
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
anishshri-db commented on code in PR #45341:
URL: https://github.com/apache/spark/pull/45341#discussion_r1520618069
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MapStateImpl.scala:
##
@@ -0,0 +1,109 @@
+/*
+ * Licensed to the Apache Software Foundation
anishshri-db commented on code in PR #45051:
URL: https://github.com/apache/spark/pull/45051#discussion_r1520644679
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/TransformWithStateExec.scala:
##
@@ -163,6 +249,16 @@ case class TransformWithStateExec(
anishshri-db commented on code in PR #45051:
URL: https://github.com/apache/spark/pull/45051#discussion_r1520644342
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StatefulProcessorHandleImpl.scala:
##
@@ -121,6 +123,46 @@ class StatefulProcessorHandleImpl(
yaooqinn opened a new pull request, #45471:
URL: https://github.com/apache/spark/pull/45471
### What changes were proposed in this pull request?
This PR Supports TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE when
`preferTimestampNTZ` option is set to true by users
zhengruifeng opened a new pull request, #45472:
URL: https://github.com/apache/spark/pull/45472
### What changes were proposed in this pull request?
Factor session-related tests out of `test_connect_basic`
### Why are the changes needed?
for testing parallelism
###
HyukjinKwon commented on PR #45468:
URL: https://github.com/apache/spark/pull/45468#issuecomment-1989660024
im fine w/ this change but would defer to @ueshin
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
panbingkun commented on PR #45452:
URL: https://github.com/apache/spark/pull/45452#issuecomment-1989710105
> Please let me know if this is ready, @panbingkun .
Yeah, it's ready
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
jingz-db commented on code in PR #45341:
URL: https://github.com/apache/spark/pull/45341#discussion_r1520699470
##
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/MapStateSuite.scala:
##
@@ -67,6 +67,7 @@ class MapStateSuite extends StateVariableSuiteBase
HeartSaVioR commented on PR #45023:
URL: https://github.com/apache/spark/pull/45023#issuecomment-1990058421
Thanks! Merging to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
HeartSaVioR closed pull request #45023: [SPARK-46962][SS][PYTHON] Add interface
for python streaming data source API and implement python worker to run python
streaming data source
URL: https://github.com/apache/spark/pull/45023
--
This is an automated message from the Apache Git Service.
HyukjinKwon commented on PR #45411:
URL: https://github.com/apache/spark/pull/45411#issuecomment-1989688316
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
xinrong-meng commented on PR #45461:
URL: https://github.com/apache/spark/pull/45461#issuecomment-1989702036
LGTM after fixing the test, thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
MaxGekk commented on code in PR #45462:
URL: https://github.com/apache/spark/pull/45462#discussion_r1520631768
##
common/utils/src/main/resources/error/error-classes.json:
##
@@ -3004,6 +3004,12 @@
],
"sqlState" : "2200E"
},
+ "NULL_QUERY_STRING_EXECUTE_IMMEDIATE"
panbingkun commented on PR #45326:
URL: https://github.com/apache/spark/pull/45326#issuecomment-1989711132
> It seems that one of `ClientStreamingQuerySuite` test hangs due to the
independent flakiness. Could you re-trigger it when it fails?
Sure, let me continue to observe and
MaxGekk commented on code in PR #44665:
URL: https://github.com/apache/spark/pull/44665#discussion_r1520694548
##
python/pyspark/sql/functions/builtin.py:
##
@@ -15534,19 +15532,7 @@ def to_csv(col: "ColumnOrName", options:
Optional[Dict[str, str]] = None) -> Col
|
HeartSaVioR commented on code in PR #45341:
URL: https://github.com/apache/spark/pull/45341#discussion_r1520711461
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MapStateImpl.scala:
##
@@ -73,24 +74,31 @@ class MapStateImpl[K, V](
}
/** Get the map
HeartSaVioR commented on code in PR #45341:
URL: https://github.com/apache/spark/pull/45341#discussion_r1520713399
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MapStateImpl.scala:
##
@@ -73,24 +74,31 @@ class MapStateImpl[K, V](
}
/** Get the map
panbingkun commented on PR #45469:
URL: https://github.com/apache/spark/pull/45469#issuecomment-1989795305
cc @itholic @zhengruifeng @HyukjinKwon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
srielau opened a new pull request, #45470:
URL: https://github.com/apache/spark/pull/45470
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How
panbingkun commented on code in PR #44665:
URL: https://github.com/apache/spark/pull/44665#discussion_r1520791983
##
python/pyspark/sql/functions/builtin.py:
##
@@ -15534,19 +15532,7 @@ def to_csv(col: "ColumnOrName", options:
Optional[Dict[str, str]] = None) -> Col
|
HyukjinKwon commented on PR #45461:
URL: https://github.com/apache/spark/pull/45461#issuecomment-1989652642
I think the test failure is related:
```
[info] - Error classes match with document *** FAILED *** (145 milliseconds)
[info] "...one of the DataFrame[s] but Spark is
HyukjinKwon commented on PR #45460:
URL: https://github.com/apache/spark/pull/45460#issuecomment-1989654626
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
jingz-db commented on code in PR #45341:
URL: https://github.com/apache/spark/pull/45341#discussion_r1520613982
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MapStateImpl.scala:
##
@@ -0,0 +1,109 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF)
HeartSaVioR commented on code in PR #45341:
URL: https://github.com/apache/spark/pull/45341#discussion_r1520688468
##
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/MapStateSuite.scala:
##
@@ -67,6 +67,7 @@ class MapStateSuite extends
HeartSaVioR commented on code in PR #45023:
URL: https://github.com/apache/spark/pull/45023#discussion_r1520802905
##
python/pyspark/sql/datasource.py:
##
@@ -426,6 +426,10 @@ def read(self, partition: InputPartition) ->
Iterator[Union[Tuple, Row]]:
in the final
WweiL closed pull request #45448: [SPARK-47332][SS][Connect] Remove not needed
logic in PythonStreamingRunner
URL: https://github.com/apache/spark/pull/45448
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
WweiL commented on code in PR #45468:
URL: https://github.com/apache/spark/pull/45468#discussion_r1520814035
##
core/src/main/scala/org/apache/spark/api/python/StreamingPythonRunner.scala:
##
@@ -68,17 +68,11 @@ private[spark] class StreamingPythonRunner(
yaooqinn commented on PR #45385:
URL: https://github.com/apache/spark/pull/45385#issuecomment-1990595991
Instead of handling such a special case here, JVM has provided helpful
arguments to deal with OutOfMemoryError.
--
This is an automated message from the Apache Git Service.
To
stefanbuk-db commented on code in PR #45407:
URL: https://github.com/apache/spark/pull/45407#discussion_r1519220632
##
sql/api/src/main/scala/org/apache/spark/sql/catalyst/util/SparkIntervalUtils.scala:
##
@@ -229,13 +237,21 @@ trait SparkIntervalUtils {
try {
wbo4958 commented on code in PR #45232:
URL: https://github.com/apache/spark/pull/45232#discussion_r1519232917
##
connector/connect/common/src/main/protobuf/spark/connect/base.proto:
##
@@ -1011,5 +1039,7 @@ service SparkConnectService {
// FetchErrorDetails retrieves the
wbo4958 commented on code in PR #45232:
URL: https://github.com/apache/spark/pull/45232#discussion_r1519232536
##
connector/connect/common/src/main/protobuf/spark/connect/relations.proto:
##
@@ -892,6 +893,9 @@ message MapPartitions {
// (Optional) Whether to use barrier
panbingkun commented on code in PR #44665:
URL: https://github.com/apache/spark/pull/44665#discussion_r1519260055
##
sql/core/src/test/scala/org/apache/spark/sql/CsvFunctionsSuite.scala:
##
@@ -294,10 +294,19 @@ class CsvFunctionsSuite extends QueryTest with
SharedSparkSession
panbingkun commented on code in PR #44665:
URL: https://github.com/apache/spark/pull/44665#discussion_r1519273344
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/csvExpressions.scala:
##
@@ -260,16 +263,33 @@ case class StructsToCsv(
child =
eejbyfeldt commented on PR #45437:
URL: https://github.com/apache/spark/pull/45437#issuecomment-1987872112
Realised that this doc comment is actually in 2 places:
https://github.com/apache/spark/pull/45458
--
This is an automated message from the Apache Git Service.
To respond to the
eejbyfeldt opened a new pull request, #45458:
URL: https://github.com/apache/spark/pull/45458
We missed that this doc is duplicated while fixing it in
https://github.com/apache/spark/pull/45437
### What changes were proposed in this pull request?
Documentation fix.
stefankandic commented on code in PR #45383:
URL: https://github.com/apache/spark/pull/45383#discussion_r1519323364
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala:
##
@@ -764,6 +773,94 @@ abstract class TypeCoercionBase {
}
}
HeartSaVioR commented on code in PR #45051:
URL: https://github.com/apache/spark/pull/45051#discussion_r1519192303
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/TimerStateImpl.scala:
##
@@ -0,0 +1,224 @@
+/*
+ * Licensed to the Apache Software Foundation
HeartSaVioR commented on code in PR #45051:
URL: https://github.com/apache/spark/pull/45051#discussion_r1519192303
##
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/TimerStateImpl.scala:
##
@@ -0,0 +1,224 @@
+/*
+ * Licensed to the Apache Software Foundation
yaooqinn opened a new pull request, #45456:
URL: https://github.com/apache/spark/pull/45456
### What changes were proposed in this pull request?
This PR upgrades the DB2 Docker image version to 11.5.8.0 used by
docker-integration tests
panbingkun commented on PR #45326:
URL: https://github.com/apache/spark/pull/45326#issuecomment-1987848933
@LuciferYang @dongjoon-hyun
The version `2.23.1` of log4j2 has been released, which has resolved the
issue with the `StatusLogger` in the version `1.13.0`, as follows:
cloud-fan commented on code in PR #43023:
URL: https://github.com/apache/spark/pull/43023#discussion_r1519318552
##
core/src/test/scala/org/apache/spark/api/python/PythonWorkerFactorySuite.scala:
##
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under
stefankandic commented on code in PR #45383:
URL: https://github.com/apache/spark/pull/45383#discussion_r1519324890
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala:
##
@@ -764,6 +773,94 @@ abstract class TypeCoercionBase {
}
}
stefanbuk-db commented on code in PR #45407:
URL: https://github.com/apache/spark/pull/45407#discussion_r1519208459
##
sql/api/src/main/scala/org/apache/spark/sql/types/StructType.scala:
##
@@ -283,10 +283,10 @@ case class StructType(fields: Array[StructField]) extends
1 - 100 of 192 matches
Mail list logo