Repository: spark
Updated Branches:
refs/heads/branch-1.2 f0eb0a79c - 07ba50f7e
[SPARK-3954][Streaming] Optimization to FileInputDStream
about convert files to RDDS there are 3 loops with files sequence in spark
source.
loops files sequence:
1.files.map(...)
2.files.zip(fileRDDs)
Repository: spark
Updated Branches:
refs/heads/master a1fc059b6 - ce6ed2abd
[SPARK-3954][Streaming] Optimization to FileInputDStream
about convert files to RDDS there are 3 loops with files sequence in spark
source.
loops files sequence:
1.files.map(...)
2.files.zip(fileRDDs)
Repository: spark
Updated Branches:
refs/heads/branch-1.1 64945f868 - 3d889dfc1
[SPARK-3954][Streaming] Optimization to FileInputDStream
about convert files to RDDS there are 3 loops with files sequence in spark
source.
loops files sequence:
1.files.map(...)
2.files.zip(fileRDDs)