spark git commit: [SPARK-3954][Streaming] Optimization to FileInputDStream

2014-11-10 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.2 f0eb0a79c - 07ba50f7e [SPARK-3954][Streaming] Optimization to FileInputDStream about convert files to RDDS there are 3 loops with files sequence in spark source. loops files sequence: 1.files.map(...) 2.files.zip(fileRDDs)

spark git commit: [SPARK-3954][Streaming] Optimization to FileInputDStream

2014-11-10 Thread tdas
Repository: spark Updated Branches: refs/heads/master a1fc059b6 - ce6ed2abd [SPARK-3954][Streaming] Optimization to FileInputDStream about convert files to RDDS there are 3 loops with files sequence in spark source. loops files sequence: 1.files.map(...) 2.files.zip(fileRDDs)

spark git commit: [SPARK-3954][Streaming] Optimization to FileInputDStream

2014-11-10 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.1 64945f868 - 3d889dfc1 [SPARK-3954][Streaming] Optimization to FileInputDStream about convert files to RDDS there are 3 loops with files sequence in spark source. loops files sequence: 1.files.map(...) 2.files.zip(fileRDDs)