user
Thread
Date
Earlier messages
Later messages
Messages by Date
2022/12/12
UNSUBSCRIBE
Ricardo Sardenberg
2022/12/12
How to see user defined variables in spark shell
Salil Surendran
2022/12/12
Spark-on-Yarn ClassNotFound Exception
Hariharan
2022/12/10
Can we upload a csv dataset into Hive using SparkSQL?
sam smith
2022/12/09
Re: Increasing Spark history resources
Artemis User
2022/12/09
Untraceable NullPointerException
Alberto Huélamo
2022/12/08
Unsubscribe
benson fang
2022/12/08
[Spark SQL]: unpredictable errors: java.io.IOException: can not read class org.apache.parquet.format.PageHeader
Eric Hanchrow
2022/12/08
Increasing Spark history resources
Nikhil Goyal
2022/12/08
Re: [EXTERNAL] [SPARK Memory management] Does Spark support setting limits/requests for driver/executor memory ?
Shay Elbaz
2022/12/07
Re: RDD block has negative value in Spark UI
Stelios Philippou
2022/12/07
[SPARK Memory management] Does Spark support setting limits/requests for driver/executor memory ?
Yosr Kchaou
2022/12/06
Re: [PySpark] Reader/Writer for bgzipped data
Oliver Ruebenacker
2022/12/06
Re: [PySpark] Reader/Writer for bgzipped data
Holden Karau
2022/12/06
Re: [PySpark] Reader/Writer for bgzipped data
Oliver Ruebenacker
2022/12/06
Re: [PySpark] Reader/Writer for bgzipped data
Holden Karau
2022/12/06
Re: [PySpark] Reader/Writer for bgzipped data
Oliver Ruebenacker
2022/12/05
Re: [PySpark] Reader/Writer for bgzipped data
Chris Nauroth
2022/12/05
Re: [PySpark] Reader/Writer for bgzipped data
Oliver Ruebenacker
2022/12/05
Re: How can I use backticks in column names?
Bjørn Jørgensen
2022/12/04
How can I use backticks in column names?
한승후
2022/12/02
Re: [PySpark] Reader/Writer for bgzipped data
Chris Nauroth
2022/12/02
[PySpark] Reader/Writer for bgzipped data
Oliver Ruebenacker
2022/12/01
Re: Create a Jira account
Jungtaek Lim
2022/12/01
Create a Jira account
ideal
2022/11/30
Re: [ANNOUNCE] Apache Spark 3.2.3 released
L. C. Hsieh
2022/11/30
Re: [ANNOUNCE] Apache Spark 3.2.3 released
huaxin gao
2022/11/30
Re: [ANNOUNCE] Apache Spark 3.2.3 released
Dongjoon Hyun
2022/11/30
Re: [SPARK STRUCTURED STREAMING] : Rocks DB uses off-heap usage
Adam Binford
2022/11/30
Re: [ANNOUNCE] Apache Spark 3.2.3 released
Yang,Jie(INF)
2022/11/30
unsubsrcibe
Suryanarayana Garlapati (Nokia)
2022/11/30
Re: Error using SPARK with Rapid GPU
Alessandro Bellina
2022/11/30
Error using SPARK with Rapid GPU
Vajiha Begum S A
2022/11/30
Error - using Spark with GPU
Vajiha Begum S A
2022/11/30
Re: [ANNOUNCE] Apache Spark 3.2.3 released
Maxim Gekk
2022/11/30
Re: [ANNOUNCE] Apache Spark 3.2.3 released
Jungtaek Lim
2022/11/30
Re: [ANNOUNCE] Apache Spark 3.2.3 released
Wenchen Fan
2022/11/29
[ANNOUNCE] Apache Spark 3.2.3 released
Chao Sun
2022/11/28
Re: Dataproc serverless for Spark
Mich Talebzadeh
2022/11/28
Re: Dataproc serverless for Spark
Holden Karau
2022/11/28
Re: Create Jira account
Sean Owen
2022/11/28
Create Jira account
Gerben van der Huizen
2022/11/28
Implement custom datasource (writer) for Spark3
guenterh.lists
2022/11/28
Re: [PySpark] Join using condition where each record may be joined multiple times
Oliver Ruebenacker
2022/11/27
Spark Partitions Size control
vijay khatri
2022/11/27
Re: [PySpark] Join using condition where each record may be joined multiple times
Artemis User
2022/11/27
[PySpark] Join using condition where each record may be joined multiple times
Oliver Ruebenacker
2022/11/26
Unsubscribe
Peter Kovgan
2022/11/25
[PySpark] [applyInPandas] Regression Bug: Cogroup in pandas drops columns from the first dataframe
Michael Bílý
2022/11/24
Unable to run Spark Job(3.3.2 SNAPSHOT) with Volcano scheduler in Kubernetes
Gnana Kumar
2022/11/23
Re: Creating a Spark 3 Connector
Jungtaek Lim
2022/11/23
Re: Creating a Spark 3 Connector
Bjørn Jørgensen
2022/11/23
Creating a Spark 3 Connector
Mitch Shepherd
2022/11/23
Re: Unable to use GPU with pyspark in windows
Sean Owen
2022/11/23
Stack Overflow Question
liang...@yy.com
2022/11/23
Unable to use GPU with pyspark in windows
Vajiha Begum S A
2022/11/23
[sparklyR] broadcast table for temporary table -> can you compute statistics for temporary table?
Joris Billen
2022/11/22
Re: Driver takes long time to finish once job ends
Pralabh Kumar
2022/11/22
Re: Driver takes long time to finish once job ends
Pralabh Kumar
2022/11/22
Re: EXT: Driver takes long time to finish once job ends
Vibhor Gupta
2022/11/22
Driver takes long time to finish once job ends
Nikhil Goyal
2022/11/22
RE: Re: [Spark Sql] Global Setting for Case-Insensitive String Compare
Patrick Tucci
2022/11/21
Re: [Spark Sql] Global Setting for Case-Insensitive String Compare
Andrew Melo
2022/11/21
RE: [Spark Sql] Global Setting for Case-Insensitive String Compare
Patrick Tucci
2022/11/21
Re: CVE-2022-33891 mitigation
Kostya Kortchinsky
2022/11/21
Re: Dataproc serverless for Spark
Mich Talebzadeh
2022/11/21
Re: CVE-2022-33891 mitigation
Sean Owen
2022/11/21
CVE-2022-33891 mitigation
Andrew Pomponio
2022/11/21
Re: Dataproc serverless for Spark
Stephen Boesch
2022/11/21
Dataproc serverless for Spark
Mich Talebzadeh
2022/11/20
Spark performance on small dataset
Prarthi Jain
2022/11/20
Re: VolcanoFeatureStep( Custom Scheduler ) not found in Spark 3.3.1 archive
Gnana Kumar
2022/11/18
Re: VolcanoFeatureStep( Custom Scheduler ) not found in Spark 3.3.1 archive
Chris Nauroth
2022/11/18
Re: [Spark SQL]: Is it possible that spark SQL appends "SELECT 1 " to the query
Sean Owen
2022/11/18
pyspark read.csv() doesn't respect locale when reading float
Weiand, Markus
2022/11/17
Re: [Spark SQL]: Is it possible that spark SQL appends "SELECT 1 " to the query
Sean Owen
2022/11/17
Re: [Spark SQL]: Is it possible that spark SQL appends "SELECT 1 " to the query
Sean Owen
2022/11/17
Re: [Spark SQL]: Is it possible that spark SQL appends "SELECT 1 " to the query
Ramakrishna Rayudu
2022/11/17
Re: [Spark SQL]: Is it possible that spark SQL appends "SELECT 1 " to the query
Sean Owen
2022/11/17
Re: [Spark SQL]: Is it possible that spark SQL appends "SELECT 1 " to the query
Sean Owen
2022/11/17
[Spark SQL]: Is it possible that spark SQL appends "SELECT 1 " to the query
Ramakrishna Rayudu
2022/11/16
Re: Pyspark ML model Save Error
Raja bhupati
2022/11/16
Re: Pyspark ML model Save Error
Artemis User
2022/11/16
VolcanoFeatureStep( Custom Scheduler ) not found in Spark 3.3.1 archive
Gnana Kumar
2022/11/16
[ANNOUNCE] Apache Kyuubi (Incubating) released 1.6.1-incubating
Shaoyun Chen
2022/11/16
Registering native UDF in PySpark
Pavel Penkov
2022/11/16
Pyspark ML model Save Error
Vajiha Begum S A
2022/11/14
Re: [EXTERNAL] Re: Re: Re: Stage level scheduling - lower the number of executors when using GPUs
Shay Elbaz
2022/11/14
Re: sequence file write
Jie Han
2022/11/14
Re: sequence file write
Shrikant Prasad
2022/11/14
Re: sequence file write
Jie Han
2022/11/14
sequence file write
Shrikant Prasad
2022/11/13
Spark Structured Streaming Duplicate in ForEachBatch with BatchId
Vedant Shirodkar
2022/11/12
[Spark Sql] Global Setting for Case-Insensitive String Compare
Patrick Tucci
2022/11/11
Re: [Spark Core] Adaptive dynamic partition pruning
Jie Han
2022/11/11
Re: [Spark Core] Adaptive dynamic partition pruning
hajyoussef amine
2022/11/11
Re: [Spark Core] Adaptive dynamic partition pruning
Jie Han
2022/11/11
Re: [Spark Core] Adaptive dynamic partition pruning
hajyoussef amine
2022/11/10
Re: [Spark Core] Adaptive dynamic partition pruning
Jie Han
2022/11/10
Re: Spark Scala Contract Opportunity @USA
Stephen Boesch
2022/11/10
Re: cannot write spark log to s3a
Chris Nauroth
2022/11/10
Spark Scala Contract Opportunity @USA
sri hari kali charan Tummala
2022/11/10
Re: Offline elastic index creation
Debasish Das
2022/11/09
cannot write spark log to s3a
second_co...@yahoo.com.INVALID
2022/11/09
[Spark Core] Adaptive dynamic partition pruning
hajyoussef amine
2022/11/09
Offline elastic index creation
Vibhor Gupta
2022/11/08
[Spark Version] Which version should I choose?
zzuly2010
2022/11/07
Re: ClassCastException while reading parquet data via Hive metastore
Naresh Peshwe
2022/11/07
Re: ClassCastException while reading parquet data via Hive metastore
Naresh Peshwe
2022/11/07
Unsubscribe
Pedro Tuero
2022/11/07
Re: ClassCastException while reading parquet data via Hive metastore
Evy M
2022/11/07
Re: ClassCastException while reading parquet data via Hive metastore
Evy M
2022/11/06
Re: [EXTERNAL] Re: Re: Re: Re: Re: Stage level scheduling - lower the number of executors when using GPUs
Shay Elbaz
2022/11/06
Re: [EXTERNAL] Re: Re: Re: Re: Stage level scheduling - lower the number of executors when using GPUs
ayan guha
2022/11/06
ClassCastException while reading parquet data via Hive metastore
Naresh Peshwe
2022/11/05
Re: spark - local question
Bjørn Jørgensen
2022/11/05
Re: [EXTERNAL] Re: Re: Re: Re: Stage level scheduling - lower the number of executors when using GPUs
Shay Elbaz
2022/11/04
Re: spark - local question
Bjørn Jørgensen
2022/11/04
Re: [EXTERNAL] Re: Re: Re: Stage level scheduling - lower the number of executors when using GPUs
Tom Graves
2022/11/03
Re: Re: should one every make a spark streaming job in pyspark
Lingzhe Sun
2022/11/03
Re: [EXTERNAL] Re: Re: Re: Stage level scheduling - lower the number of executors when using GPUs
Shay Elbaz
2022/11/03
Re: [EXTERNAL] Re: Re: Stage level scheduling - lower the number of executors when using GPUs
Artemis User
2022/11/03
Re: [EXTERNAL] Re: Re: Stage level scheduling - lower the number of executors when using GPUs
Tom Graves
2022/11/03
Re: [EXTERNAL] Re: Re: Stage level scheduling - lower the number of executors when using GPUs
Sean Owen
2022/11/03
Re: [EXTERNAL] Re: Re: Stage level scheduling - lower the number of executors when using GPUs
bo yang
2022/11/03
Re: [EXTERNAL] Re: Re: Stage level scheduling - lower the number of executors when using GPUs
Shay Elbaz
2022/11/03
Re: [EXTERNAL] Re: Stage level scheduling - lower the number of executors when using GPUs
Artemis User
2022/11/03
Re: should one every make a spark streaming job in pyspark
Mich Talebzadeh
2022/11/03
Unsubscribe
sanjeev shrestha
2022/11/03
unsubscribe
Huajian Mao
2022/11/02
Re: [EXTERNAL] Re: Stage level scheduling - lower the number of executors when using GPUs
Shay Elbaz
2022/11/02
Re: Stage level scheduling - lower the number of executors when using GPUs
Artemis User
2022/11/02
Stage level scheduling - lower the number of executors when using GPUs
Shay Elbaz
2022/11/02
[*IMPORTANT*] update Streaming Query Statistics url
Priyanshi Shahu
2022/11/02
should one every make a spark streaming job in pyspark
Joris Billen
2022/11/01
Re: Ctrl - left and right now working in Spark Shell in Windows 10
Sean Owen
2022/11/01
Ctrl - left and right now working in Spark Shell in Windows 10
Salil Surendran
2022/11/01
Re: The Dataset unit test is much slower than the RDD unit test (in Scala)
Cheng Pan
2022/11/01
Re: The Dataset unit test is much slower than the RDD unit test (in Scala)
Enrico Minack
2022/10/31
Re: spark - local question
Sean Owen
2022/10/31
spark - local question
张健BJ
2022/10/28
Re: How to find final status (Driver's) for an application
Artemis User
2022/10/28
RE: Apache Spark Operator for Kubernetes?
Jim Halfpenny
2022/10/28
How to find final status (Driver's) for an application
Violet Vin
2022/10/27
Re: Prometheus with spark
Denny Lee
2022/10/26
Re: Dynamic allocation on K8
Shrikant Prasad
2022/10/26
Re: Dynamic Scaling without Kubernetes
Artemis User
2022/10/26
Re: Dynamic Scaling without Kubernetes
Holden Karau
2022/10/26
Dynamic Scaling without Kubernetes
Artemis User
2022/10/26
Re: Running 30 Spark applications at the same time is slower than one on average
Sean Owen
2022/10/26
Re: Running 30 Spark applications at the same time is slower than one on average
Artemis User
2022/10/26
Re: [ANNOUNCE] Apache Spark 3.3.1 released
Chao Sun
2022/10/26
Re:[ANNOUNCE] Apache Spark 3.3.1 released
beliefer
2022/10/26
Re: Running 30 Spark applications at the same time is slower than one on average
Sean Owen
2022/10/26
Running 30 Spark applications at the same time is slower than one on average
eab...@163.com
2022/10/26
Re: [ANNOUNCE] Apache Spark 3.3.1 released
Jacek Laskowski
2022/10/26
Re: [ANNOUNCE] Apache Spark 3.3.1 released
Yang,Jie(INF)
2022/10/26
Re: [ANNOUNCE] Apache Spark 3.3.1 released
Maxim Gekk
2022/10/26
Re: [ANNOUNCE] Apache Spark 3.3.1 released
Hyukjin Kwon
2022/10/26
Re: [ANNOUNCE] Apache Spark 3.3.1 released
L. C. Hsieh
2022/10/25
Re: [ANNOUNCE] Apache Spark 3.3.1 released
Dongjoon Hyun
2022/10/25
[ANNOUNCE] Apache Spark 3.3.1 released
Yuming Wang
2022/10/25
The Dataset unit test is much slower than the RDD unit test (in Scala)
Tanin Na Nakorn
2022/10/25
Dynamic allocation on K8
Nikhil Goyal
2022/10/25
Re: Prometheus with spark
Raja bhupati
2022/10/25
Re: Prometheus with spark
Jacek Laskowski
2022/10/21
Prometheus with spark
Raj ks
2022/10/21
[PySpark, Spark Streaming] Bug in timestamp handling in Structured Streaming?
kai-michael.roes...@sap.com.INVALID
2022/10/21
Re: pyspark connect to spark thrift server port
Artemis User
2022/10/20
Re: pyspark connect to spark thrift server port
second_co...@yahoo.com.INVALID
2022/10/20
Re: pyspark connect to spark thrift server port
Artemis User
2022/10/20
Spark partitioned By
venkatesh bandaru
2022/10/20
pyspark connect to spark thrift server port
second_co...@yahoo.com.INVALID
2022/10/19
RE: Encoded data retrieved when reading Parquet file
Nipuna Shantha
2022/10/19
Encoded data retrieved when reading Parquet file
Nipuna Shantha
2022/10/18
Re: [SparkListener] Calculating the total amount of re-computations / waste
Emil Ejbyfeldt
2022/10/16
Re: [Feature Request] make unix_micros() and unix_millis() available in PySpark (pyspark.sql.functions)
Hyukjin Kwon
2022/10/16
Re: spark on kubernetes
Qian Sun
2022/10/16
Re: How to use neo4j cypher/opencypher to query spark RDD/graphdb
Artemis User
2022/10/15
How to use neo4j cypher/opencypher to query spark RDD/graphdb
ERSyrfw212oe
2022/10/15
Re: spark on kubernetes
Qian Sun
2022/10/15
spark on kubernetes
Mohammad Abdollahzade Arani
2022/10/14
[Feature Request] make unix_micros() and unix_millis() available in PySpark (pyspark.sql.functions)
Martin
2022/10/14
Re: Apache Spark Operator for Kubernetes?
Artemis User
2022/10/14
Apache Spark Operator for Kubernetes?
Clayton Wohl
2022/10/14
[SparkListener] Calculating the total amount of re-computations / waste
Faiz Halde
2022/10/13
Re: Executor heartbeats on Kubernetes
Qian SUN
2022/10/13
Executor heartbeats on Kubernetes
Kristopher Kane
2022/10/13
Re: Efficiently updating running sums only on new data
Igor Calabria
2022/10/12
Re: Efficiently updating running sums only on new data
Artemis User
2022/10/12
Re: Why the same INSERT OVERWRITE sql , final table file produced by spark sql is larger than hive sql?
Chartist
2022/10/11
Efficiently updating running sums only on new data
Greg Kopff
2022/10/11
Re: Why the same INSERT OVERWRITE sql , final table file produced by spark sql is larger than hive sql?
Sadha Chilukoori
2022/10/11
Re: As a Scala newbie starting to work with Spark does it make more sense to learn Scala 2 or Scala 3?
Sean Owen
2022/10/11
Re: As a Scala newbie starting to work with Spark does it make more sense to learn Scala 2 or Scala 3?
Henrik Park
2022/10/11
Re: As a Scala newbie starting to work with Spark does it make more sense to learn Scala 2 or Scala 3?
Sean Owen
2022/10/11
Re: As a Scala newbie starting to work with Spark does it make more sense to learn Scala 2 or Scala 3?
Никита Романов
2022/10/11
Why the same INSERT OVERWRITE sql , final table file produced by spark sql is larger than hive sql?
Chartist
2022/10/10
As a Scala newbie starting to work with Spark does it make more sense to learn Scala 2 or Scala 3?
Oliver Plohmann
2022/10/06
ERROR MicroBatchExecution
Ravi Chandran
Earlier messages
Later messages