unsubscribe

2023-11-07 Thread Kelvin Qin
unsubscribe

Re:Question about how parquet files are read and processed

2020-04-15 Thread Kelvin Qin
Hi, The advantage of Parquet is that it only scans the required columns, it is a file in a column storage format. The fewer columns you select, the less memory is required. Developers do not need to care about the details of loading data, they are well-designed and imperceptible to users.

Re:[Structured Streaming] Checkpoint file compact file grows big

2020-04-15 Thread Kelvin Qin
SEE:http://spark.apache.org/docs/2.3.1/streaming-programming-guide.html#checkpointing "Note that checkpointing of RDDs incurs the cost of saving to reliable storage. This may cause an increase in the processing time of those batches where RDDs get checkpointed." As far as I know, the

Re:RE: Going it alone.

2020-04-15 Thread Kelvin Qin
No wonder I said why I can't understand what the mail expresses, it feels like a joke…… 在 2020-04-16 02:28:49,seemanto.ba...@nomura.com.INVALID 写道: Have we been tricked by a bot ? From: Matt Smith Sent: Wednesday, April 15, 2020 2:23 PM To: jane thorpe Cc: