[GitHub] spark issue #22331: [SPARK-25331][SS] Make FileStreamSink ignore partitions ...

2018-12-07 Thread misutoth
Github user misutoth commented on the issue: https://github.com/apache/spark/pull/22331 So I am considering this as the recommended way to read a file sink's output. If there is a need to include the protocol in this PR as an alternative we can still reopen it. ---

[GitHub] spark issue #22331: [SPARK-25331][SS] Make FileStreamSink ignore partitions ...

2018-11-14 Thread gaborgsomogyi
Github user gaborgsomogyi commented on the issue: https://github.com/apache/spark/pull/22331 I've taken a look at the things and I think the issue solved in the mentioned PR but not yet documented. If somebody would like to use the output directory of a spark application which uses a

[GitHub] spark issue #22331: [SPARK-25331][SS] Make FileStreamSink ignore partitions ...

2018-09-28 Thread misutoth
Github user misutoth commented on the issue: https://github.com/apache/spark/pull/22331 @lw-lin , @marmbrus , in the meantime I found that you have been discussing about having deterministic file names in a [PR](https://github.com/apache/spark/pull/16987#issuecomment-282094165).

[GitHub] spark issue #22331: [SPARK-25331][SS] Make FileStreamSink ignore partitions ...

2018-09-25 Thread misutoth
Github user misutoth commented on the issue: https://github.com/apache/spark/pull/22331 @rxin could you please look into this change? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional