ulysses-you commented on pull request #35729:
URL: https://github.com/apache/spark/pull/35729#issuecomment-1058909560
cc @HyukjinKwon @cloud-fan @yaooqinn
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
LuciferYang commented on pull request #35580:
URL: https://github.com/apache/spark/pull/35580#issuecomment-1058909472
@dongjoon-hyun Thank you for syncing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
ulysses-you commented on a change in pull request #35719:
URL: https://github.com/apache/spark/pull/35719#discussion_r819326181
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/ShuffledRowRDD.scala
##
@@ -177,19 +177,36 @@ class ShuffledRowRDD(
val tra
martin-g commented on pull request #35560:
URL: https://github.com/apache/spark/pull/35560#issuecomment-1058899649
Agreed! I will work on this soon!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
martin-g commented on a change in pull request #34622:
URL: https://github.com/apache/spark/pull/34622#discussion_r819314166
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SQLAppStatusListener.scala
##
@@ -138,6 +139,30 @@ class SQLAppStatusListener(
martin-g commented on a change in pull request #35728:
URL: https://github.com/apache/spark/pull/35728#discussion_r819304189
##
File path: docs/running-on-kubernetes.md
##
@@ -1707,6 +1707,30 @@ Spark automatically handles translating the Spark
configs spark.{driver/ex
Kube
chenjunbiao001 commented on pull request #35721:
URL: https://github.com/apache/spark/pull/35721#issuecomment-1058871514
这是来自QQ邮箱的假期自动回复邮件。
您好,邮件已收到,感谢您的来信!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
AmplabJenkins commented on pull request #35721:
URL: https://github.com/apache/spark/pull/35721#issuecomment-1058871372
Can one of the admins verify this patch?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
HeartSaVioR commented on a change in pull request #35673:
URL: https://github.com/apache/spark/pull/35673#discussion_r819293042
##
File path:
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingSessionWindowDistributionSuite.scala
##
@@ -0,0 +1,232 @@
+/*
+ * Licen
HeartSaVioR opened a new pull request #35731:
URL: https://github.com/apache/spark/pull/35731
### What changes were proposed in this pull request?
This PR fixes the StateSchemaCompatibilityChecker which mistakenly swapped
`from` (should be provided schema) and `to` (should be existin
GabeChurch removed a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun thank you! This is golden.
I know you are active on apache orc project so if you have any additional
wisdom to share please do.
I've be
GabeChurch edited a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun thank you! This is golden.
I know you are active on apache orc project so if you have any additional
wisdom to share please do.
I've bee
pralabhkumar commented on pull request #35191:
URL: https://github.com/apache/spark/pull/35191#issuecomment-1058865169
done the changes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specif
pralabhkumar commented on a change in pull request #35191:
URL: https://github.com/apache/spark/pull/35191#discussion_r819290416
##
File path: python/pyspark/pandas/series.py
##
@@ -5228,10 +5229,22 @@ def asof(self, where: Union[Any, List]) ->
Union[Scalar, "Series"]:
GabeChurch edited a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun thank you! This is golden.
I know you are active on apache orc project so if you have any additional
wisdom to share please do.
I've bee
GabeChurch edited a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun thank you! This is golden.
I've been testing with Spark 3.2 major and 3.3 fork on Kubernetes (couple
TB writes) for awhile now and seeing signific
GabeChurch edited a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun thank you! This is golden.
I've been testing with Spark 3.2 major and 3.3 fork on Kubernetes (couple
TB writes) for awhile now and seeing signific
GabeChurch edited a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun I'm curious, have you done any benchmarks for the magic s3
committer with ORC? I know you are pretty active on apache ORC project as well.
I've be
GabeChurch edited a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun I'm curious, have you done any benchmarks for the magic s3
committer with ORC? I know you are pretty active on apache ORC project as well.
I've be
GabeChurch edited a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun I'm curious, have you done any benchmarks for the magic s3
committer with ORC? I know you are pretty active on apache ORC project as well.
I've be
GabeChurch edited a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun I'm curious, have you done any benchmarks for the magic s3
committer with ORC? I know you are pretty active on apache ORC project as well.
I've be
GabeChurch edited a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun I'm curious, have you done any benchmarks for the magic s3
committer with ORC? I know you are pretty active on apache ORC project.
I've been testin
huaxingao commented on a change in pull request #35691:
URL: https://github.com/apache/spark/pull/35691#discussion_r819281553
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PruneFileSourcePartitions.scala
##
@@ -83,7 +89,7 @@ private[sql] obje
mridulm commented on pull request #35637:
URL: https://github.com/apache/spark/pull/35637#issuecomment-1058847727
Since the existing test was not catching this issue, I want to make sure
that we are testing for this behavior.
Given that we have exhaustively tested the current metrics - i
Ngone51 commented on a change in pull request #35719:
URL: https://github.com/apache/spark/pull/35719#discussion_r819279830
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/ShuffledRowRDD.scala
##
@@ -177,19 +177,36 @@ class ShuffledRowRDD(
val tracker
beliefer commented on pull request #35727:
URL: https://github.com/apache/spark/pull/35727#issuecomment-1058846261
ping @huaxingao cc @cloud-fan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
mridulm commented on a change in pull request #35637:
URL: https://github.com/apache/spark/pull/35637#discussion_r819277689
##
File path: core/src/test/scala/org/apache/spark/status/AppStatusStoreSuite.scala
##
@@ -227,32 +268,41 @@ class AppStatusStoreSuite extends SparkFunSui
stczwd edited a comment on pull request #35669:
URL: https://github.com/apache/spark/pull/35669#issuecomment-1058842991
> Seems to me that data filters and partition filters are separated
differently in V1 and V2 file sources and your optimization only work for V2
file source?
Yes,
stczwd commented on pull request #35669:
URL: https://github.com/apache/spark/pull/35669#issuecomment-1058842991
> Seems to me that data filters and partition filters are separated
differently in V1 and V2 file sources and your optimization only work for V2
file source?
Yes, this i
GabeChurch edited a comment on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun I'm curious, have you done any benchmarks for the magic s3
committer with ORC?
I've been testing with Spark 3.2 major and 3.3 fork on Kubernetes (
GabeChurch commented on pull request #32518:
URL: https://github.com/apache/spark/pull/32518#issuecomment-1058840240
@dongjoon-hyun I'm curious, have you done any benchmarks for the magic s3
committer with ORC?
I've been testing with Spark 3.2 major and 3.3 fork on Kubernetes (couple
xinrong-databricks commented on a change in pull request #35671:
URL: https://github.com/apache/spark/pull/35671#discussion_r819266462
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
##
@@ -133,6 +133,33 @@ object
huaxingao commented on pull request #35669:
URL: https://github.com/apache/spark/pull/35669#issuecomment-1058827776
@stczwd The PR makes sense to me. I have one question: does your
optimization work for V1 file source? Seems to me that data filters and
partition filters are separated diffe
pan3793 commented on pull request #35730:
URL: https://github.com/apache/spark/pull/35730#issuecomment-1058822211
cc @HeartSaVioR
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific co
pan3793 opened a new pull request #35730:
URL: https://github.com/apache/spark/pull/35730
### What changes were proposed in this pull request?
Use UTF-8 instead of system default encoding to read event log
### Why are the changes needed?
After SPARK-29160, we should alwa
ulysses-you opened a new pull request #35729:
URL: https://github.com/apache/spark/pull/35729
### What changes were proposed in this pull request?
Pass `initialNumPartitions` into `RebalancePartitions`.
### Why are the changes needed?
Rebalance partitions resolve
Yikun closed pull request #35639:
URL: https://github.com/apache/spark/pull/35639
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr
Yikun commented on pull request #35639:
URL: https://github.com/apache/spark/pull/35639#issuecomment-1058801691
Replace by https://github.com/apache/spark/pull/35728
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
Yikun opened a new pull request #35728:
URL: https://github.com/apache/spark/pull/35728
### What changes were proposed in this pull request?
Document how to set the priority class with the pod template.
### Why are the changes needed?
Currently, we didn't have a certain doc to h
sleep1661 commented on pull request #32923:
URL: https://github.com/apache/spark/pull/32923#issuecomment-1058800304
> @cloud-fan We are migrating from 2.4.7 to 3.0.2, and observed a
significant regression in some cases due to this issue.
>
>
![image](https://user-images.githubuserco
LuciferYang commented on pull request #35713:
URL: https://github.com/apache/spark/pull/35713#issuecomment-1058793733
cc @srowen
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific com
wangshengjie123 commented on pull request #21893:
URL: https://github.com/apache/spark/pull/21893#issuecomment-1058793345
> We have some use cases for it and internally we have the fix with a
smaller scope.
@shangxinli, sorry to bother, would you submit a PR to solve this problem?
wangshengjie123 removed a comment on pull request #21893:
URL: https://github.com/apache/spark/pull/21893#issuecomment-1058790556
> We have some use cases for it and internally we have the fix with a
smaller scope.
@shangxinli
--
This is an automated message from the Apache Git Servi
wangshengjie123 commented on pull request #21893:
URL: https://github.com/apache/spark/pull/21893#issuecomment-1058790556
> We have some use cases for it and internally we have the fix with a
smaller scope.
@shangxinli
--
This is an automated message from the Apache Git Service.
To r
beliefer commented on pull request #35696:
URL: https://github.com/apache/spark/pull/35696#issuecomment-1058773907
https://github.com/apache/spark/pull/35727 used to replace this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to G
beliefer closed pull request #35696:
URL: https://github.com/apache/spark/pull/35696
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsub
beliefer opened a new pull request #35727:
URL: https://github.com/apache/spark/pull/35727
### What changes were proposed in this pull request?
At present, the parameter of the factory method for obtaining JDBC
connection is empty because the JDBC URL of some databases is fixed and uniqu
ulysses-you commented on pull request #35719:
URL: https://github.com/apache/spark/pull/35719#issuecomment-1058755893
thank you @cloud-fan @mridulm for review, addressed comments.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitH
xinrong-databricks commented on a change in pull request #35706:
URL: https://github.com/apache/spark/pull/35706#discussion_r819205905
##
File path: python/pyspark/pandas/series.py
##
@@ -992,8 +993,10 @@ def map(self, arg: Union[Dict, Callable]) -> "Series":
Paramet
xinrong-databricks commented on a change in pull request #35706:
URL: https://github.com/apache/spark/pull/35706#discussion_r819205751
##
File path: python/pyspark/pandas/series.py
##
@@ -1045,8 +1048,18 @@ def map(self, arg: Union[Dict, Callable]) -> "Series":
2
xinrong-databricks commented on a change in pull request #35706:
URL: https://github.com/apache/spark/pull/35706#discussion_r819201744
##
File path: python/pyspark/pandas/tests/test_series.py
##
@@ -1161,13 +1161,29 @@ def test_append(self):
def test_map(self):
ps
sunchao commented on pull request #34855:
URL: https://github.com/apache/spark/pull/34855#issuecomment-1058739724
hmm somehow `YarnClustereSuite` started failing after 3.3.2. I'll need to
check what caused the issue.
--
This is an automated message from the Apache Git Service.
To respond
AmplabJenkins commented on pull request #35726:
URL: https://github.com/apache/spark/pull/35726#issuecomment-1058726624
Can one of the admins verify this patch?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
huaxingao commented on a change in pull request #35726:
URL: https://github.com/apache/spark/pull/35726#discussion_r819190168
##
File path:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/v2/jdbc/JDBCTableCatalogSuite.scala
##
@@ -425,4 +425,20 @@ class JDBC
dtenedor commented on pull request #35690:
URL: https://github.com/apache/spark/pull/35690#issuecomment-1058723452
This is ready for another review round @gengliangwang @viirya @wangyum
@HyukjinKwon @dongjoon-hyun :)
--
This is an automated message from the Apache Git Service.
To respond
github-actions[bot] commented on pull request #34396:
URL: https://github.com/apache/spark/pull/34396#issuecomment-1058691919
We're closing this PR because it hasn't been updated in a while. This isn't
a judgement on the merit of the PR in any way. It's just a way of keeping the
PR queue m
stczwd commented on pull request #35669:
URL: https://github.com/apache/spark/pull/35669#issuecomment-1058666337
> I think the optimization should be able to add for ORC as well.
Great. I will create a new JIRA for ORC optimization, this PR will only
support parquet optimization.
-
c21 commented on pull request #35669:
URL: https://github.com/apache/spark/pull/35669#issuecomment-1058577352
I think the optimization should be able to add for ORC as well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
yliou commented on pull request #34622:
URL: https://github.com/apache/spark/pull/34622#issuecomment-1058561177
@tgravescs do you have time to take a quick look?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
anchovYu commented on pull request #35707:
URL: https://github.com/apache/spark/pull/35707#issuecomment-1058558335
Thanks @cloud-fan for the review. I feel sorry for all the linting problem..
Before I commit, I ran the dev/scalastyle and it shows all style has passed,
then I thought it is
dongjoon-hyun commented on pull request #35580:
URL: https://github.com/apache/spark/pull/35580#issuecomment-1058540179
We got the official confirmation like the following. `6.29.3` fails. We need
a new version of rocksDB and rocksDB JNI will arrive after that one or two
months.
- https
anchovYu commented on a change in pull request #35707:
URL: https://github.com/apache/spark/pull/35707#discussion_r819095750
##
File path:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/DDLParserSuite.scala
##
@@ -1774,7 +1777,7 @@ class DDLParserSuite extend
HeartSaVioR commented on pull request #35560:
URL: https://github.com/apache/spark/pull/35560#issuecomment-1058523917
Follow-up fix sounds good to me. Easier to work based on this since we now
just need to try finding `Symbol(` and replace there. Finding shorthand of
Symbol `'` would be mu
srowen commented on pull request #35560:
URL: https://github.com/apache/spark/pull/35560#issuecomment-1058516997
Hm, I think you have a point. We definitely need Symbol in some parts of the
Scala code, but I think they're rare and limited to parts that reason about
closures, etc. For colum
HeartSaVioR commented on pull request #35560:
URL: https://github.com/apache/spark/pull/35560#issuecomment-1058514200
Right, but what else we use Symbol except representing Column? I might be
missing something, but from what I've seen from test codes, majority of usage
has been the same fo
srowen commented on pull request #35560:
URL: https://github.com/apache/spark/pull/35560#issuecomment-1058491957
Is that the same thing? $".." is shorthand for a Column, not Scala Symbol
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
HeartSaVioR commented on pull request #35560:
URL: https://github.com/apache/spark/pull/35560#issuecomment-1058480954
Just to see our preference, given `$"..."` is not mentioned at all for
deprecation and it is simpler than `Symbol("...")`, why not consistently using
`$"..."`? My intuition
martin-g commented on a change in pull request #35725:
URL: https://github.com/apache/spark/pull/35725#discussion_r819039329
##
File path: pom.xml
##
@@ -163,6 +163,10 @@
2.12.15
2.12
2.0.2
+
+
+4.4.0
Review comment:
Why not 4.5.6 ?
https://se
srowen commented on pull request #35725:
URL: https://github.com/apache/spark/pull/35725#issuecomment-1058442968
Weird, but OK by me
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
sunchao commented on a change in pull request #35725:
URL: https://github.com/apache/spark/pull/35725#discussion_r819028128
##
File path: pom.xml
##
@@ -3430,6 +3433,7 @@
hadoop-client
hadoop-yarn-api
hadoop-client
+4.3.0
Review comment:
dongjoon-hyun commented on pull request #35640:
URL: https://github.com/apache/spark/pull/35640#issuecomment-1058422005
Please check the dev mailing list . Ramping down for Apache Spark 3.3
release started, @Yikun .
- https://lists.apache.org/thread/ffdk52hkvgsc5ncjh1z0nv120jowtrld
--
dongjoon-hyun commented on pull request #35639:
URL: https://github.com/apache/spark/pull/35639#issuecomment-1058421664
Please check the dev mailing list . Ramping down for Apache Spark 3.3
release started, @Yikun .
- https://lists.apache.org/thread/ffdk52hkvgsc5ncjh1z0nv120jowtrld
--
sunchao commented on pull request #35657:
URL: https://github.com/apache/spark/pull/35657#issuecomment-1058397619
Gently ping @cloud-fan @viirya @dongjoon-hyun @c21 @rdblue @aokolnychyi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on t
dongjoon-hyun commented on pull request #35483:
URL: https://github.com/apache/spark/pull/35483#issuecomment-1058396543
Thank you for the decision, @sunchao .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL ab
dtenedor commented on pull request #35690:
URL: https://github.com/apache/spark/pull/35690#issuecomment-1058390966
> > Creating NULL default value for NOT NULL column
> > Type mismatch between default value literal and column type.
> > Upcasting or not in case of type mismatch
>
sunchao closed pull request #35483:
URL: https://github.com/apache/spark/pull/35483
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubs
sunchao commented on pull request #35483:
URL: https://github.com/apache/spark/pull/35483#issuecomment-1058390811
Took a while to get back to this PR: I investigated more on why I needed
this change originally from Parquet side, and turned out it's for handling
cases like array of structs,
planga82 commented on pull request #35726:
URL: https://github.com/apache/spark/pull/35726#issuecomment-1058389209
CC @cloud-fan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific com
dtenedor commented on pull request #35690:
URL: https://github.com/apache/spark/pull/35690#issuecomment-1058387995
> This PR doesn't seem to have the full body yet, what is your release
target for this, @dtenedor and @gengliangwang ? I'm curious about the general
error handling.
>
>
planga82 opened a new pull request #35726:
URL: https://github.com/apache/spark/pull/35726
### What changes were proposed in this pull request?
The problem happens when you have a column that is quoted because it has
special characters.
```
select view1.`Имя1` , vie
dtenedor commented on pull request #35690:
URL: https://github.com/apache/spark/pull/35690#issuecomment-1058385738
> Thanks for the work.
>
> For the parser change itself, looks okay. As this is a breaking change,
I'd like to see some clarification on why this is necessary to have. W
dtenedor commented on a change in pull request #35690:
URL: https://github.com/apache/spark/pull/35690#discussion_r818973943
##
File path:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/DDLParserSuite.scala
##
@@ -2235,4 +2236,57 @@ class DDLParserSuite exten
mridulm commented on a change in pull request #35719:
URL: https://github.com/apache/spark/pull/35719#discussion_r818967642
##
File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala
##
@@ -1022,101 +1022,105 @@ private[spark] class MapOutputTrackerMaster(
mridulm commented on a change in pull request #35719:
URL: https://github.com/apache/spark/pull/35719#discussion_r818966635
##
File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala
##
@@ -1022,101 +1022,105 @@ private[spark] class MapOutputTrackerMaster(
ueshin commented on a change in pull request #35706:
URL: https://github.com/apache/spark/pull/35706#discussion_r818958752
##
File path: python/pyspark/pandas/series.py
##
@@ -1045,8 +1048,18 @@ def map(self, arg: Union[Dict, Callable]) -> "Series":
2 I am a None
dongjoon-hyun closed pull request #35720:
URL: https://github.com/apache/spark/pull/35720
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-
attilapiros commented on pull request #35723:
URL: https://github.com/apache/spark/pull/35723#issuecomment-1058355951
The failure in `BasicSchedulerIntegrationSuite` must be a know flaky test:
https://issues.apache.org/jira/browse/SPARK-36375.
--
This is an automated message from
steveloughran opened a new pull request #35725:
URL: https://github.com/apache/spark/pull/35725
### What changes were proposed in this pull request?
This sets scala-maven-plugin.version to 4.4.0 except when the hadoop-2.7
profile is used, because SPARK-36547 shows that only
mridulm commented on pull request #35714:
URL: https://github.com/apache/spark/pull/35714#issuecomment-1058353273
Late LGTM, thanks @attilapiros !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
dtenedor commented on a change in pull request #35690:
URL: https://github.com/apache/spark/pull/35690#discussion_r818922112
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala
##
@@ -2756,6 +2763,41 @@ class AstBuilder extends SqlBa
dtenedor commented on a change in pull request #35690:
URL: https://github.com/apache/spark/pull/35690#discussion_r818919712
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala
##
@@ -3651,12 +3695,20 @@ class AstBuilder extends SqlB
dtenedor commented on a change in pull request #35690:
URL: https://github.com/apache/spark/pull/35690#discussion_r818919421
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala
##
@@ -3813,6 +3871,9 @@ class AstBuilder extends SqlBas
dtenedor commented on a change in pull request #35690:
URL: https://github.com/apache/spark/pull/35690#discussion_r818916692
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala
##
@@ -2756,6 +2763,41 @@ class AstBuilder extends SqlBa
heyihong commented on pull request #35687:
URL: https://github.com/apache/spark/pull/35687#issuecomment-1058300837
> Emm, PR's description is really unfriendly for me. lol, after take a deep
look, it enables usage logger in Pandas on Spark for ContextManager usage,
record in `__enter__` an
dongjoon-hyun commented on pull request #35720:
URL: https://github.com/apache/spark/pull/35720#issuecomment-1058297847
Thank you, @attilapiros and @HyukjinKwon .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
UR
stczwd commented on a change in pull request #35669:
URL: https://github.com/apache/spark/pull/35669#discussion_r818881906
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilters.scala
##
@@ -557,6 +562,7 @@ class ParquetFilters(
huaxingao commented on a change in pull request #35691:
URL: https://github.com/apache/spark/pull/35691#discussion_r818864088
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PruneFileSourcePartitions.scala
##
@@ -83,7 +89,7 @@ private[sql] obje
cloud-fan commented on a change in pull request #35719:
URL: https://github.com/apache/spark/pull/35719#discussion_r818798463
##
File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala
##
@@ -1022,101 +1022,105 @@ private[spark] class MapOutputTrackerMaster(
gengliangwang commented on pull request #35724:
URL: https://github.com/apache/spark/pull/35724#issuecomment-1058186343
cc @entong as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the spe
gengliangwang opened a new pull request #35724:
URL: https://github.com/apache/spark/pull/35724
### What changes were proposed in this pull request?
When ANSI mode is off, `ArrayType(DoubleType, containsNull = false)` can't
cast as `ArrayType(IntegerType, containsNull = false
1 - 100 of 151 matches
Mail list logo