[GitHub] spark pull request #15680: sync

2016-10-28 Thread zhangxinyu1
Github user zhangxinyu1 closed the pull request at: https://github.com/apache/spark/pull/15680 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request #15680: sync

2016-10-28 Thread zhangxinyu1
GitHub user zhangxinyu1 opened a pull request: https://github.com/apache/spark/pull/15680 sync ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this patch

[GitHub] spark pull request #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in exter...

2016-10-24 Thread zhangxinyu1
Github user zhangxinyu1 closed the pull request at: https://github.com/apache/spark/pull/15483 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in external kaf...

2016-10-24 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15483 Sure. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in external kaf...

2016-10-24 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15483 @marmbrus I write a short deasign doc of KafkaSink in jira https://issues.apache.org/jira/browse/SPARK-17935 Could you please take a look? --- If your project is set up for it, you

[GitHub] spark issue #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in external kaf...

2016-10-21 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15483 @marmbrus Yes, I also think `KafkaSink` is better than `KafkaForeachWriter` for users. I 'm trying to complete `KafkaSink` these days. Like `KafkaSource` in external kafka-0-10-sql

[GitHub] spark issue #15483: [SPARK-17935][SQL]Add KafkaForeachWriter in external kaf...

2016-10-14 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15483 @marmbrus Could you take a look? Please tell me if you hava any suggestions? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #15483: Add KafkaForeachWriter in external kafka-0.8.0 fo...

2016-10-14 Thread zhangxinyu1
GitHub user zhangxinyu1 opened a pull request: https://github.com/apache/spark/pull/15483 Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module ## What changes were proposed in this pull request? I propose a `KafkaForeachWriter.scala` in external

[GitHub] spark issue #15197: [SPARK-17631] [SQL] Add HttpStreamSink for structured st...

2016-09-26 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15197 @marmbrus Thanks for all your sugguestion! I have done the following things: - Write a short desing on [JIRA](https://issues.apache.org/jira/browse/SPARK-17631) - I replace

[GitHub] spark issue #15197: [SPARK-17631] [SQL] Add HttpStreamSink for structured st...

2016-09-22 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15197 @marmbrus I propose this feature mainly because we require output streaming query results via http api. One of use cases is real-time alarm. It's essential to send alarm messages in real

[GitHub] spark pull request #15197: [SPARK-17631] [SQL] Add HttpStreamSink for struct...

2016-09-22 Thread zhangxinyu1
GitHub user zhangxinyu1 opened a pull request: https://github.com/apache/spark/pull/15197 [SPARK-17631] [SQL] Add HttpStreamSink for structured streaming. Streaming query results can be sinked to http server ## What changes were proposed in this pull request? Add a class

[GitHub] spark pull request #15194: [SPARK-17631] [SQL] New feature for structured st...

2016-09-22 Thread zhangxinyu1
Github user zhangxinyu1 closed the pull request at: https://github.com/apache/spark/pull/15194 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15194: New feature for structured streaming: add http stream si...

2016-09-22 Thread zhangxinyu1
Github user zhangxinyu1 commented on the issue: https://github.com/apache/spark/pull/15194 @marmbrus I propose this feature mainly because we require output streaming query results via http api. One of use cases is real-time alarm. It's essential to send alarm messages in real

[GitHub] spark pull request #15194: New feature for structured streaming: add http st...

2016-09-21 Thread zhangxinyu1
GitHub user zhangxinyu1 opened a pull request: https://github.com/apache/spark/pull/15194 New feature for structured streaming: add http stream sink ## What changes were proposed in this pull request? Add http stream sink for structured streaming. Streaming query