zhengruifeng commented on PR #42809:
URL: https://github.com/apache/spark/pull/42809#issuecomment-1706063313
@dongjoon-hyun @HyukjinKwon thanks for review
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
wangyum commented on PR #42804:
URL: https://github.com/apache/spark/pull/42804#issuecomment-1706074040
cc @cloud-fan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
cloud-fan commented on code in PR #42797:
URL: https://github.com/apache/spark/pull/42797#discussion_r1315476814
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala:
##
@@ -67,7 +67,8 @@ abstract class UnaryMathExpression(val f: Double
cloud-fan commented on code in PR #42759:
URL: https://github.com/apache/spark/pull/42759#discussion_r1315479553
##
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala:
##
@@ -117,12 +117,20 @@ class CacheManager extends Logging with
AdaptiveSparkPlanHelpe
panbingkun commented on code in PR #42797:
URL: https://github.com/apache/spark/pull/42797#discussion_r1315497780
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala:
##
@@ -67,7 +67,8 @@ abstract class UnaryMathExpression(val f: Double
cloud-fan commented on code in PR #42804:
URL: https://github.com/apache/spark/pull/42804#discussion_r1315502363
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala:
##
@@ -234,11 +240,7 @@ abstract class BinaryArithmetic extends BinaryOpera
yaooqinn opened a new pull request, #42815:
URL: https://github.com/apache/spark/pull/42815
### What changes were proposed in this pull request?
This PR upgrades dagre-d3.js from 0.4.3 to 0.6.4, a.k.a. changes the dist
build by https://github.com/andrewor14/dagre-d3 to
ht
MaxGekk opened a new pull request, #42816:
URL: https://github.com/apache/spark/pull/42816
### What changes were proposed in this pull request?
This PR captures the dataset APIs used by the user code and the call site in
the user code and provides better error messages.
E.g. consid
Hisoka-X commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1315586396
##
sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala:
##
@@ -213,7 +213,9 @@ private[sql] object CatalogV2Util {
// e
Hisoka-X commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1315586396
##
sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala:
##
@@ -213,7 +213,9 @@ private[sql] object CatalogV2Util {
// e
zhengruifeng commented on PR #42811:
URL: https://github.com/apache/spark/pull/42811#issuecomment-1706252804
merged to master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
zhengruifeng closed pull request #42811: [SPARK-43241][PS][FOLLOWUP] Add
migration guide for behavior change
URL: https://github.com/apache/spark/pull/42811
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
whcdjj commented on PR #28280:
URL: https://github.com/apache/spark/pull/28280#issuecomment-1706282059
Is there any progress on this issue? When I was insert into hive table with
speculative enabled, I encountered the same problem.
--
This is an automated message from the Apache Git Servi
MaxGekk commented on code in PR #42801:
URL: https://github.com/apache/spark/pull/42801#discussion_r1315744531
##
connector/connect/client/jvm/src/main/scala/org/apache/spark/sql/functions.scala:
##
@@ -4284,12 +4285,22 @@ object functions {
* prints '+' for positive value
panbingkun commented on code in PR #42109:
URL: https://github.com/apache/spark/pull/42109#discussion_r1315778389
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/v2ResolutionPlans.scala:
##
@@ -44,7 +44,7 @@ case class UnresolvedNamespace(multipartIdentifie
panbingkun commented on code in PR #42109:
URL: https://github.com/apache/spark/pull/42109#discussion_r1315780224
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:
##
@@ -1134,20 +1134,21 @@ class Analyzer(override val catalogManager:
Catalog
MaxGekk opened a new pull request, #42817:
URL: https://github.com/apache/spark/pull/42817
### What changes were proposed in this pull request?
In the PR, I propose to check the `accuracy` argument is not a NULL in
`ApproximatePercentile`. And if it is, throw an `AnalysisException` with n
ming95 commented on PR #42804:
URL: https://github.com/apache/spark/pull/42804#issuecomment-1706594949
@cloud-fan @wangyum
Please merge it to master , thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
wangyum commented on code in PR #42804:
URL: https://github.com/apache/spark/pull/42804#discussion_r1315905477
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala:
##
@@ -234,11 +240,7 @@ abstract class BinaryArithmetic extends BinaryOperato
ming95 commented on code in PR #42574:
URL: https://github.com/apache/spark/pull/42574#discussion_r1315907482
##
sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala:
##
@@ -191,16 +193,26 @@ case class CreateDataSourceTableAsSelectComm
hvanhovell closed pull request #42807: [SPARK-45072][CONNECT] Fix outer scopes
for ammonite classes
URL: https://github.com/apache/spark/pull/42807
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
juliuszsompolski commented on PR #42806:
URL: https://github.com/apache/spark/pull/42806#issuecomment-1706640901
https://github.com/juliuszsompolski/apache-spark/actions/runs/6076122424/job/16483638602
This module timed out. All connect related tests finished successfuly.
--
This is an
cloud-fan commented on PR #41683:
URL: https://github.com/apache/spark/pull/41683#issuecomment-1706680230
Let's spend more time on the API design first, as different people may have
different opinions and we should collect as much feedback as possible.
Taking a step back, I think what
cloud-fan commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1315957135
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -230,6 +230,15 @@ case class AlterColumn(
val defaul
cloud-fan commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1315957135
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -230,6 +230,15 @@ case class AlterColumn(
val defaul
Hisoka-X commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1315970129
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -230,6 +230,15 @@ case class AlterColumn(
val default
cloud-fan commented on code in PR #42481:
URL: https://github.com/apache/spark/pull/42481#discussion_r1315972356
##
sql/core/src/main/scala/org/apache/spark/sql/execution/SQLExecution.scala:
##
@@ -124,7 +136,7 @@ object SQLExecution {
physicalPlanDescription =
que
MaxGekk closed pull request #42816: [WIP][SPARK-45022][SQL] Provide context for
dataset API errors
URL: https://github.com/apache/spark/pull/42816
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
cloud-fan commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1315981102
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableCha
Hisoka-X commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1316039979
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableChan
dongjoon-hyun commented on PR #42807:
URL: https://github.com/apache/spark/pull/42807#issuecomment-1706851416
Let me fix that for you, @hvanhovell . If you don't think this is not a bug,
please let me know, @hvanhovell .
--
This is an automated message from the Apache Git Service.
To resp
ming95 commented on code in PR #42804:
URL: https://github.com/apache/spark/pull/42804#discussion_r1316079522
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala:
##
@@ -234,11 +240,7 @@ abstract class BinaryArithmetic extends BinaryOper
hvanhovell commented on PR #42807:
URL: https://github.com/apache/spark/pull/42807#issuecomment-1706856355
I think it is a bug.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific commen
dtenedor commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1316137847
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableChan
sunchao commented on PR #42757:
URL: https://github.com/apache/spark/pull/42757#issuecomment-1706951663
Thanks all!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsub
juliuszsompolski opened a new pull request, #42818:
URL: https://github.com/apache/spark/pull/42818
### What changes were proposed in this pull request?
Make INVALID_CURSOR.DISCONNECTED a retriable error.
### Why are the changes needed?
This error can happen if two RPCs a
xuanyuanking opened a new pull request, #42819:
URL: https://github.com/apache/spark/pull/42819
### What changes were proposed in this pull request?
Compare the 3.4 API doc with the 3.5 RC3 cut. Fix the following issues:
- Remove the leaking class/object in API doc
### Wh
srielau commented on PR #41683:
URL: https://github.com/apache/spark/pull/41683#issuecomment-1706980076
+1 on using a WITH clause.
For UPDATE:
> WITH (OPTIONS (
Why the nesting?
--
This is an automated message from the Apache Git Service.
To respond to the message, please
juliuszsompolski commented on PR #42772:
URL: https://github.com/apache/spark/pull/42772#issuecomment-170760
We maintain backwards compatibility, where older clients can connect to
newer server. These older clients will not provide such UUIDs.
What will happen then? Does it break any
agubichev commented on code in PR #42778:
URL: https://github.com/apache/spark/pull/42778#discussion_r1316176643
##
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/TransposeWindowSuite.scala:
##
@@ -160,4 +160,18 @@ class TransposeWindowSuite extends PlanTest
juliuszsompolski commented on PR #42772:
URL: https://github.com/apache/spark/pull/42772#issuecomment-1707008850
... although, the currently existing (Spark 3.4) clients never generate
operationId client side, so we can get away with adding an assertion that the
client side id is UUID7 in `
srowen commented on PR #42815:
URL: https://github.com/apache/spark/pull/42815#issuecomment-1707031614
Are you saying 0.6.4 doesn't work well? is this just for your testing then
and not to merge?
--
This is an automated message from the Apache Git Service.
To respond to the message, pleas
srowen commented on PR #42819:
URL: https://github.com/apache/spark/pull/42819#issuecomment-1707033259
Seems OK in principle, just need tests to pass
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
dillitz commented on PR #42772:
URL: https://github.com/apache/spark/pull/42772#issuecomment-1707033407
We agreed that the benefits of adding this are not big enough because we can
not rely on the operation ID being UUIDv7 and need to sort by startDate anyway.
Closing this PR.
--
This is
dillitz closed pull request #42772: [SPARK-45051][CONNECT] Use UUIDv7 by
default for operation IDs to make operations chronologically sortable
URL: https://github.com/apache/spark/pull/42772
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
mridulm commented on code in PR #42529:
URL: https://github.com/apache/spark/pull/42529#discussion_r1316224064
##
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala:
##
@@ -1618,9 +1618,9 @@ private[spark] object Client extends Logging {
retur
xuanyuanking commented on PR #42819:
URL: https://github.com/apache/spark/pull/42819#issuecomment-1707142988
The test `On pull request update / Notify test workflow
(pull_request_target)` that failed has passed for the initial commit. I think
it's good to go. @srowen, could you give your ap
srowen commented on PR #42819:
URL: https://github.com/apache/spark/pull/42819#issuecomment-1707147907
I'm concerned that this may not pass mima tests and I don't see that this
test was run because of other errors. Have you checked that it passes in both
branches?
--
This is an automated
xuanyuanking commented on PR #42819:
URL: https://github.com/apache/spark/pull/42819#issuecomment-1707160026
good point, let me run Mima test manually on both master and 3.5
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
xuanyuanking commented on PR #42819:
URL: https://github.com/apache/spark/pull/42819#issuecomment-1707175717
@srowen Checked manually for both master and branch-3.5, the Mima test
passed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
WweiL commented on PR #42664:
URL: https://github.com/apache/spark/pull/42664#issuecomment-1707179668
fixed in
https://github.com/apache/spark/commit/7be69bf7da036282c2c7c0b62c32e7666fa1b579
--
This is an automated message from the Apache Git Service.
To respond to the message, please log
WweiL closed pull request #42664: [SPARK-44435][SPARK-44484][3.5][SS][CONNECT]
Tests for foreachBatch and Listener
URL: https://github.com/apache/spark/pull/42664
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL ab
pan3793 opened a new pull request, #42820:
URL: https://github.com/apache/spark/pull/42820
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How was
xuanyuanking closed pull request #42819: [SPARK-45082][DOC] Review and fix
issues in API docs for 3.5.0
URL: https://github.com/apache/spark/pull/42819
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
xuanyuanking commented on PR #42819:
URL: https://github.com/apache/spark/pull/42819#issuecomment-1707217892
Thanks, merged in master and branch-3.5
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
planga82 commented on code in PR #42759:
URL: https://github.com/apache/spark/pull/42759#discussion_r1316342993
##
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala:
##
@@ -117,12 +117,20 @@ class CacheManager extends Logging with
AdaptiveSparkPlanHelper
andylam-db commented on code in PR #42725:
URL: https://github.com/apache/spark/pull/42725#discussion_r1316384305
##
sql/catalyst/src/main/scala/org/apache/spark/sql/errors/QueryCompilationErrors.scala:
##
@@ -3751,4 +3751,14 @@ private[sql] object QueryCompilationErrors extends
dtenedor commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1316435058
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableChan
allisonwang-db opened a new pull request, #42821:
URL: https://github.com/apache/spark/pull/42821
### What changes were proposed in this pull request?
This PR refines the function `min` docstring by adding more examples.
### Why are the changes needed?
To improve
itholic commented on code in PR #42798:
URL: https://github.com/apache/spark/pull/42798#discussion_r1316539576
##
python/pyspark/pandas/groupby.py:
##
@@ -3534,7 +3534,12 @@ def _reduce_for_stat_function(
for label in psdf._internal.column_labels:
p
itholic commented on code in PR #42798:
URL: https://github.com/apache/spark/pull/42798#discussion_r1316539867
##
python/pyspark/pandas/groupby.py:
##
@@ -3534,7 +3534,12 @@ def _reduce_for_stat_function(
for label in psdf._internal.column_labels:
p
zhengruifeng commented on PR #42815:
URL: https://github.com/apache/spark/pull/42815#issuecomment-1707476622
cc @gengliangwang @jasonli-db
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the spe
Hisoka-X commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1316557650
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableChan
Hisoka-X commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1316557800
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableChan
rangadi commented on code in PR #42779:
URL: https://github.com/apache/spark/pull/42779#discussion_r1316564483
##
python/pyspark/sql/tests/connect/streaming/worker_for_testing.py:
##
@@ -0,0 +1,63 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# con
zhengruifeng commented on code in PR #42798:
URL: https://github.com/apache/spark/pull/42798#discussion_r1316572356
##
python/pyspark/pandas/groupby.py:
##
@@ -3534,7 +3534,12 @@ def _reduce_for_stat_function(
for label in psdf._internal.column_labels:
zhengruifeng commented on code in PR #42798:
URL: https://github.com/apache/spark/pull/42798#discussion_r1316574489
##
python/pyspark/pandas/groupby.py:
##
@@ -3537,14 +3537,14 @@ def _reduce_for_stat_function(
if sfun.__name__ == "sum" and isinstance(
panbingkun commented on code in PR #42109:
URL: https://github.com/apache/spark/pull/42109#discussion_r1315780224
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:
##
@@ -1134,20 +1134,21 @@ class Analyzer(override val catalogManager:
Catalog
zhengruifeng closed pull request #42821: [SPARK-45083][PYTHON][DOCS] Refine the
docstring of function `min`
URL: https://github.com/apache/spark/pull/42821
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
zhengruifeng commented on PR #42821:
URL: https://github.com/apache/spark/pull/42821#issuecomment-1707515898
merged to master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
itholic commented on code in PR #42798:
URL: https://github.com/apache/spark/pull/42798#discussion_r1316586840
##
python/pyspark/pandas/groupby.py:
##
@@ -3537,14 +3537,14 @@ def _reduce_for_stat_function(
if sfun.__name__ == "sum" and isinstance(
yaooqinn commented on PR #42815:
URL: https://github.com/apache/spark/pull/42815#issuecomment-1707530280
also cc @sarutak @HyukjinKwon and @dongjoon-hyun
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
yaooqinn commented on PR #42815:
URL: https://github.com/apache/spark/pull/42815#issuecomment-1707529974
> Are you saying 0.6.4 doesn't work well? is this just for your testing then
and not to merge?
Hi @srowen, I apologize for any confusion caused. This pull request is for
merging p
HeartSaVioR opened a new pull request, #42823:
URL: https://github.com/apache/spark/pull/42823
### What changes were proposed in this pull request?
This PR proposes to override `Scan.columnarSupportMode` for DSv2 streaming
data sources. All of them don't support columnar.
Ratio
yliou commented on code in PR #40502:
URL: https://github.com/apache/spark/pull/40502#discussion_r1316647094
##
core/src/main/scala/org/apache/spark/ui/scope/RDDOperationGraph.scala:
##
@@ -221,6 +226,24 @@ private[spark] object RDDOperationGraph extends Logging {
RDDOperat
yaooqinn commented on code in PR #42481:
URL: https://github.com/apache/spark/pull/42481#discussion_r1316655772
##
sql/core/src/main/scala/org/apache/spark/sql/execution/SQLExecution.scala:
##
@@ -124,7 +136,7 @@ object SQLExecution {
physicalPlanDescription =
quer
panbingkun opened a new pull request, #42824:
URL: https://github.com/apache/spark/pull/42824
### What changes were proposed in this pull request?
The pr aims to:
- Merge UNSUPPORTED_TEMP_VIEW_OPERATION into UNSUPPORTED_VIEW_OPERATION in
error classes.
- Refactor some code.
- Fix
HeartSaVioR commented on PR #42823:
URL: https://github.com/apache/spark/pull/42823#issuecomment-1707580885
cc. @cloud-fan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
yaooqinn opened a new pull request, #42825:
URL: https://github.com/apache/spark/pull/42825
### What changes were proposed in this pull request?
This is a followup to clean up comment for generating plan info in
SQLExecution, which is currently wrapped with try-cat
yaooqinn commented on PR #42825:
URL: https://github.com/apache/spark/pull/42825#issuecomment-1707584651
cc @cloud-fan and thanks for the post review of
https://github.com/apache/spark/pull/42481/files#r1315972356
--
This is an automated message from the Apache Git Service.
To respond to
yaooqinn closed pull request #42825: [SPARK-44801][SQL][FOLLOWUP] Remove
overdue comments for generating plan info in SQLExecution
URL: https://github.com/apache/spark/pull/42825
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub an
HeartSaVioR commented on PR #42823:
URL: https://github.com/apache/spark/pull/42823#issuecomment-1707590753
cc. @zsxwing @viirya @xuanyuanking as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
cloud-fan commented on code in PR #42804:
URL: https://github.com/apache/spark/pull/42804#discussion_r1316665134
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala:
##
@@ -234,11 +240,7 @@ abstract class BinaryArithmetic extends BinaryOpera
cloud-fan commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1316665187
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableCha
Hisoka-X commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1316669968
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableChan
Hisoka-X commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1316669968
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableChan
Hisoka-X commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1316673105
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableChan
Hisoka-X commented on code in PR #42810:
URL: https://github.com/apache/spark/pull/42810#discussion_r1316669968
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2AlterTableCommands.scala:
##
@@ -228,6 +228,15 @@ case class AlterColumn(
TableChan
wangyum closed pull request #42804: [SPARK-45071][SQL] Optimize the processing
speed of `BinaryArithmetic#dataType` when processing multi-column data
URL: https://github.com/apache/spark/pull/42804
--
This is an automated message from the Apache Git Service.
To respond to the message, please
wangyum commented on PR #42804:
URL: https://github.com/apache/spark/pull/42804#issuecomment-1707606993
Merged to master, branch-3.5 and branch-3.4.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
LuciferYang closed pull request #42766: [SPARK-45046][BUILD] Set `shadeTestJar`
of `core` module to `false`
URL: https://github.com/apache/spark/pull/42766
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
LuciferYang commented on PR #42766:
URL: https://github.com/apache/spark/pull/42766#issuecomment-1707607819
Merged into master. Thanks @gengliangwang @HyukjinKwon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
UR
LuciferYang commented on PR #42766:
URL: https://github.com/apache/spark/pull/42766#issuecomment-1707613904
@gengliangwang After further investigation, there are three modules that
depend on `spark-streaming_2.12:test-jar`: `mllib`, `streaming-kafka-0-10` and
`kinesis-asl`. As I lack the ne
yaooqinn opened a new pull request, #42826:
URL: https://github.com/apache/spark/pull/42826
### What changes were proposed in this pull request?
This PR fixes the stringify method for MonitorInfo/LockInfo to use
`toString` which contains an extra step of Integer.toHexStrin
LuciferYang opened a new pull request, #42827:
URL: https://github.com/apache/spark/pull/42827
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How
zhengruifeng opened a new pull request, #42828:
URL: https://github.com/apache/spark/pull/42828
### What changes were proposed in this pull request?
- Make `getitem` work with duplicated columns
- Disallow bool type index
- Disallow negative index
### Why are the chang
HyukjinKwon commented on PR #42806:
URL: https://github.com/apache/spark/pull/42806#issuecomment-1707679262
Merged to master and branch-3.5.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
HyukjinKwon closed pull request #42806: [SPARK-44833][CONNECT] Fix sending
Reattach too fast after Execute
URL: https://github.com/apache/spark/pull/42806
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to g
MaxGekk commented on PR #42801:
URL: https://github.com/apache/spark/pull/42801#issuecomment-1707683221
Merging to master. Thank you, @dongjoon-hyun and @cloud-fan for review.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub an
MaxGekk closed pull request #42801: [SPARK-45070][SQL][DOCS] Describe the
binary and datetime formats of `to_char`/`to_varchar`
URL: https://github.com/apache/spark/pull/42801
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and u
1 - 100 of 107 matches
Mail list logo