user
Thread
Date
Earlier messages
Later messages
Messages by Date
2022/08/29
deciding Spark tasks & optimization resource
rajat kumar
2022/08/29
RE: Profiling PySpark Pandas UDF
Luca Canali
2022/08/26
Spark 3.3.0 with Structure Streaming from Kafka Issue on commons-pools2
Raymond Tang
2022/08/26
Spark SQL Predict Pushdown for Hive Bucketed Table
Raymond Tang
2022/08/26
Structured Streaming - data not being read (offsets not getting committed ?)
karan alang
2022/08/26
Re: Profiling PySpark Pandas UDF
Abdeali Kothari
2022/08/26
回复:Re: Spark got incorrect scala version while using spark 3.2.1 and spark 3.2.2
ckgppl_yan
2022/08/26
Re: Spark got incorrect scala version while using spark 3.2.1 and spark 3.2.2
pengyh
2022/08/26
Re: Spark got incorrect scala version while using spark 3.2.1 and spark 3.2.2
Sean Owen
2022/08/26
Spark got incorrect scala version while using spark 3.2.1 and spark 3.2.2
ckgppl_yan
2022/08/26
RE: Profiling PySpark Pandas UDF
Luca Canali
2022/08/25
Re: Profiling PySpark Pandas UDF
Abdeali Kothari
2022/08/25
Re: Profiling PySpark Pandas UDF
Subash Prabanantham
2022/08/25
Re: Profiling PySpark Pandas UDF
Russell Jurney
2022/08/25
Re: Profiling PySpark Pandas UDF
Sean Owen
2022/08/25
Re: Profiling PySpark Pandas UDF
Takuya UESHIN
2022/08/25
Re: Profiling PySpark Pandas UDF
Russell Jurney
2022/08/25
Re: Profiling PySpark Pandas UDF
Sean Owen
2022/08/25
Re: Profiling PySpark Pandas UDF
Andrew Melo
2022/08/25
Re: Profiling PySpark Pandas UDF
Gourav Sengupta
2022/08/25
Profiling PySpark Pandas UDF
Subash Prabanantham
2022/08/24
Re: spark-3.2.2-bin-without-hadoop : NoClassDefFoundError: org/apache/log4j/spi/Filter when starting the master
Sean Owen
2022/08/24
spark-3.2.2-bin-without-hadoop : NoClassDefFoundError: org/apache/log4j/spi/Filter when starting the master
FLORANCE Grégory
2022/08/22
Question regarding checkpointing with kafka structured streaming
Martin Andersson
2022/08/20
Re: Spark streaming
Gourav Sengupta
2022/08/20
Re: [EXTERNAL] Re: Spark streaming
sandra sukumaran
2022/08/19
[Spark SQL]: Does Spark preserve the order in a nested ORDER BY?
Vinay Londhe
2022/08/19
Re: [EXTERNAL] Re: Spark streaming
Saurabh Gulati
2022/08/19
Re: Spark streaming
Ajit Kumar Amit
2022/08/19
Spark streaming
sandra sukumaran
2022/08/18
Filtering by job group in the Spark UI / API
Yeachan Park
2022/08/17
Re: Spark streaming
ミユナ (alice)
2022/08/17
Re: Data ingestion
Pasha Finkelshtein
2022/08/17
Spark streaming
Prajith Vellukkai
2022/08/17
Re: Data ingestion
pengyh
2022/08/17
Re: Data ingestion
Yuri Oleynikov (יורי אולייניקוב)
2022/08/17
Re: Data ingestion
Pasha Finkelshtein
2022/08/17
Data ingestion
Akash Vellukai
2022/08/17
Re: [EXTERNAL] Re: Spark streaming - Data Ingestion
Akash Vellukai
2022/08/17
Re: [EXTERNAL] Re: Spark streaming - Data Ingestion
Gibson
2022/08/17
Re: [EXTERNAL] Re: Spark streaming - Data Ingestion
Saurabh Gulati
2022/08/17
Re: Spark streaming - Data Ingestion
Gibson
2022/08/17
Spark streaming - Data Ingestion
Akash Vellukai
2022/08/15
Unsubscribe
Mohd Shukri Hasan
2022/08/15
Unsubscribe
Nadeem Lalani
2022/08/15
Re: Supported Hadoop versions for Spark 3.3
pengyh
2022/08/15
Supported Hadoop versions for Spark 3.3
Håkan Nordgren
2022/08/13
PySpark schema sanitization
Shay Elbaz
2022/08/13
Re: Spark with GPU
Gourav Sengupta
2022/08/13
Re: Spark with GPU
Alessandro Bellina
2022/08/13
Re: Spark with GPU
Sean Owen
2022/08/13
Re: Spark with GPU
rajat kumar
2022/08/13
Re: Spark with GPU
Sean Owen
2022/08/13
Spark with GPU
rajat kumar
2022/08/12
Unsubscribe
Pascal Taddei
2022/08/12
[no subject]
GAURAV GUPTA
2022/08/12
unsubscribe
Sivakumar Ganesan
2022/08/12
unsubscribe
Alexey Milogradov
2022/08/11
pyspark not starting
Kelum Perera
2022/08/11
Joins internally
Sid
2022/08/10
Re: Unsubscribe
pengyh
2022/08/10
Unsubscribe
Shrikar archak
2022/08/10
Memory leak while caching in foreachBatch block
kineret M
2022/08/09
High number of tasks when ran on a hybrid cluster
murat migdisoglu
2022/08/09
Re: Spark program not receiving messages from Cloud Pubsub
Pramod Biligiri
2022/08/08
Re: [Spark SQL] Omit Create Table Statement in Spark Sql
pengyh
2022/08/08
[Spark SQL] Omit Create Table Statement in Spark Sql
阿强
2022/08/06
Spark program not receiving messages from Cloud Pubsub
Pramod Biligiri
2022/08/03
Re: Salting technique doubt
Sid
2022/08/02
Re: Spark Scala API still not updated for 2.13 or it's a mistake?
pengyh
2022/08/02
Re: Spark Scala API still not updated for 2.13 or it's a mistake?
Sean Owen
2022/08/02
Re: Spark Scala API still not updated for 2.13 or it's a mistake?
Roman I
2022/08/02
Re: Spark Scala API still not updated for 2.13 or it's a mistake?
Sean Owen
2022/08/02
Spark Scala API still not updated for 2.13 or it's a mistake?
Roman I
2022/08/02
Re: log transfering into hadoop/spark
Gourav Sengupta
2022/08/02
Re: log transfering into hadoop/spark
ayan guha
2022/08/02
Re: [pyspark delta] [delta][Spark SQL]: Getting an Analysis Exception. The associated location (path) is not empty
Sean Owen
2022/08/02
Re: [pyspark delta] [delta][Spark SQL]: Getting an Analysis Exception. The associated location (path) is not empty
Stelios Philippou
2022/08/02
Re: [pyspark delta] [delta][Spark SQL]: Getting an Analysis Exception. The associated location (path) is not empty
Sean Owen
2022/08/02
Re: [pyspark delta] [delta][Spark SQL]: Getting an Analysis Exception. The associated location (path) is not empty
ayan guha
2022/08/01
log transfering into hadoop/spark
pengyh
2022/08/01
Re: [pyspark delta] [delta][Spark SQL]: Getting an Analysis Exception. The associated location (path) is not empty
Kumba Janga
2022/08/01
Re: [pyspark delta] [delta][Spark SQL]: Getting an Analysis Exception. The associated location (path) is not empty
Sean Owen
2022/08/01
[pyspark delta] [delta][Spark SQL]: Getting an Analysis Exception. The associated location (path) is not empty
Kumba Janga
2022/08/01
Re: WARN: netlib.BLAS
Sean Owen
2022/08/01
WARN: netlib.BLAS
陈刚
2022/08/01
Re: Use case idea
pengyh
2022/08/01
Re: Use case idea
Gourav Sengupta
2022/08/01
Re: unsubscribe
pengyh
2022/08/01
unsubscribe
Martin Soch
2022/07/31
Re: Use case idea
pengyh
2022/07/31
Re: Use case idea
Gourav Sengupta
2022/07/31
Re: Use case idea
pengyh
2022/07/31
Use case idea
Gioele Sal. Perri
2022/07/31
Re: Salting technique doubt
Vinod KC
2022/07/31
Re: Salting technique doubt
ayan guha
2022/07/31
Re: Salting technique doubt
Jacob Lynn
2022/07/31
Re: Salting technique doubt
Amit Joshi
2022/07/31
Re: Salting technique doubt
Sid
2022/07/30
Re: Salting technique doubt
Amit Joshi
2022/07/30
Salting technique doubt
Sid
2022/07/29
Re: PySpark cores
Gourav Sengupta
2022/07/29
[no subject]
Milin Korath
2022/07/29
Re: PySpark cores
Jacob Lynn
2022/07/28
PySpark cores
Andrew Melo
2022/07/28
Unsubscribe
Ashish
2022/07/28
Unsubscribe
Karthik Jayaraman
2022/07/28
Re: spark can't connect to kafka via sasl_ssl
wilson
2022/07/27
spark can't connect to kafka via sasl_ssl
wilson
2022/07/27
Re: Spark Avro Java 17 Compatibility
Sean Owen
2022/07/27
RE: Spark Avro Java 17 Compatibility
Shivaraj Sivasankaran
2022/07/27
[Spark thread pool configurations]: I would like to configure all ThreadPoolExecutor parameters for each thread pool started in Spark
Alex Peelman
2022/07/26
Re: [EXTERNAL] Partial data with ADLS Gen2
hwl17801341688
2022/07/25
Spark SQL Query filter behavior with special characters
prashanth reddy
2022/07/24
Re: [EXTERNAL] Partial data with ADLS Gen2
Tufan Rakshit
2022/07/24
Re: [EXTERNAL] Partial data with ADLS Gen2
Shay Elbaz
2022/07/24
Partial data with ADLS Gen2
kineret M
2022/07/24
Re: external table with parquet files: problem querying in sparksql since data is stored as integer while hive schema expects a timestamp
Gourav Sengupta
2022/07/22
Re: Updating Broadcast Variable in Spark Streaming 2.4.4
Sean Owen
2022/07/22
Updating Broadcast Variable in Spark Streaming 2.4.4
Dipl.-Inf. Rico Bergmann
2022/07/21
Re: Spark Structured Streaming -- Cannot consume next messages
KhajaAsmath Mohammed
2022/07/21
Re: Pyspark and multiprocessing
Khalid Mammadov
2022/07/21
Re: Spark Structured Streaming -- Cannot consume next messages
Artemis User
2022/07/21
Re: Pyspark and multiprocessing
Bjørn Jørgensen
2022/07/21
Spark Structured Streaming -- Cannot consume next messages
KhajaAsmath Mohammed
2022/07/21
Re: Pyspark and multiprocessing
Khalid Mammadov
2022/07/20
external table with parquet files: problem querying in sparksql since data is stored as integer while hive schema expects a timestamp
Joris Billen
2022/07/20
Fwd: Pyspark and multiprocessing
Bjørn Jørgensen
2022/07/20
Pyspark and multiprocessing
Bjørn Jørgensen
2022/07/20
Re: Dependencies issue in spark
rajat kumar
2022/07/20
Re: [MLlib] Differences after version upgrade
Sean Owen
2022/07/20
[MLlib] Differences after version upgrade
Roger Wechsler
2022/07/20
Re: Building a ML pipeline with no training
Sean Owen
2022/07/20
Dependencies issue in spark
rajat kumar
2022/07/20
Building a ML pipeline with no training
Edgar H
2022/07/19
Re: Issue while building spark project
rajat kumar
2022/07/19
Re: spark.executor.pyspark.memory not added to the executor resource request on Kubernetes
Shay Elbaz
2022/07/19
spark.executor.pyspark.memory not added to the executor resource request on Kubernetes
Shay Elbaz
2022/07/18
Re: [Building] Building with JDK11
Sean Owen
2022/07/18
Re: [Building] Building with JDK11
Gera Shegalov
2022/07/18
Re: [Building] Building with JDK11
Szymon Kuryło
2022/07/18
Re: very simple UI on webpage to display x/y plots+histogram of data stored in hive
ayan guha
2022/07/18
Re: very simple UI on webpage to display x/y plots+histogram of data stored in hive
Joris Billen
2022/07/18
Re: very simple UI on webpage to display x/y plots+histogram of data stored in hive
Sean Owen
2022/07/18
very simple UI on webpage to display x/y plots+histogram of data stored in hive
Joris Billen
2022/07/18
Re: Issue while building spark project
Sean Owen
2022/07/18
Issue while building spark project
rajat kumar
2022/07/18
Re: [Building] Building with JDK11
Stephen Coy
2022/07/17
Re: [Building] Building with JDK11
Sergey B.
2022/07/17
Re: [Building] Building with JDK11
Stephen Coy
2022/07/17
CVE-2022-33891: Apache Spark shell command injection vulnerability via Spark UI
Sean Owen
2022/07/17
Re: Question regarding how to make spar Scala to evenly divide the spark job between executors
Tufan Rakshit
2022/07/17
[ANNOUNCE] Apache Spark 3.2.2 released
Dongjoon Hyun
2022/07/16
Question regarding how to make spar Scala to evenly divide the spark job between executors
Orkhan Dadashov
2022/07/16
Re: [EXTERNAL] RDD.pipe() for binary data
Andrew Melo
2022/07/16
Re: [EXTERNAL] RDD.pipe() for binary data
Sebastian Piu
2022/07/16
Re: [EXTERNAL] RDD.pipe() for binary data
Sean Owen
2022/07/16
Re: [EXTERNAL] RDD.pipe() for binary data
Yuhao Zhang
2022/07/16
Re: [EXTERNAL] spark re-use shuffle files not happening
Koert Kuipers
2022/07/16
Re: [EXTERNAL] spark re-use shuffle files not happening
Shay Elbaz
2022/07/16
spark re-use shuffle files not happening
Koert Kuipers
2022/07/16
Spark Convert Column to String
Gibson
2022/07/15
Re: [Building] Building with JDK11
Tufan Rakshit
2022/07/15
Re: [Building] Building with JDK11
Sean Owen
2022/07/15
[Building] Building with JDK11
Szymon Kuryło
2022/07/15
Re: [Spark][Core] Resource Allocation
Sungwoo Park
2022/07/14
unsubscribe
randy clinton
2022/07/14
Re: How use pattern matching in spark
Bjørn Jørgensen
2022/07/14
Re: Spark (K8S) IPv6 support
Sean Owen
2022/07/14
Spark (K8S) IPv6 support
Valer
2022/07/13
Re: Spark streaming pending mircobatches queue max length
Anil Dasari
2022/07/13
[Spark Structured Continous Processing] Plans for future left join support.
Mikołaj Błaszczyk
2022/07/13
Re: reading each JSON file from dataframe...
Gourav Sengupta
2022/07/12
How use pattern matching in spark
Sid
2022/07/12
Re: How reading works?
Sid
2022/07/12
Re: reading each JSON file from dataframe...
Muthu Jayakumar
2022/07/12
Spark streaming pending mircobatches queue max length
Anil Dasari
2022/07/12
Re: reading each JSON file from dataframe...
ayan guha
2022/07/12
Re: reading each JSON file from dataframe...
Enrico Minack
2022/07/12
Re: reading each JSON file from dataframe...
Muthu Jayakumar
2022/07/12
[Spark][Core] Resource Allocation
Amin Borjian
2022/07/11
Re: reading each JSON file from dataframe...
Enrico Minack
2022/07/11
Re: about cpu cores
Gourav Sengupta
2022/07/11
Re: about cpu cores
Tufan Rakshit
2022/07/11
Re: about cpu cores
Yong Walt
2022/07/10
Re: about cpu cores
Tufan Rakshit
2022/07/10
Re: about cpu cores
Sean Owen
2022/07/10
Re: [EXTERNAL] RDD.pipe() for binary data
Shay Elbaz
2022/07/10
about cpu cores
Yong Walt
2022/07/10
reading each JSON file from dataframe...
Muthu Jayakumar
2022/07/08
RDD.pipe() for binary data
Yuhao Zhang
2022/07/06
Re: Migration from Spark 2.4.0 to Spark 3.1.1 caused SortMergeJoin to change to BroadcastHashJoin
igor cabral uchoa
2022/07/06
Re: Migration from Spark 2.4.0 to Spark 3.1.1 caused SortMergeJoin to change to BroadcastHashJoin
Tufan Rakshit
2022/07/06
Migration from Spark 2.4.0 to Spark 3.1.1 caused SortMergeJoin to change to BroadcastHashJoin
igor cabral uchoa
2022/07/05
Reading parquet strips non-nullability from schema
Greg Kopff
2022/07/05
Re: How reading works?
Bjørn Jørgensen
2022/07/05
Re: How reading works?
Bjørn Jørgensen
2022/07/05
Re: How reading works?
Sid
2022/07/05
Reading snappy/lz4 compressed csv/json files
Yeachan Park
2022/07/05
Re: How is Spark a memory based solution if it writes data to disk before shuffles?
Apostolos N. Papadopoulos
Earlier messages
Later messages