[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/2695 ---

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-11 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r216736902 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/StreamSQLExample.scala --- @@ -0,0 +1,124 @@ +/* + * Licensed to the Ap

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-11 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r216598273 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/StreamSQLExample.scala --- @@ -0,0 +1,124 @@ +/* + * Licensed to the

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-10 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r216310962 --- Diff: integration/spark2/src/main/scala/org/apache/carbondata/stream/StreamJobManager.scala --- @@ -52,19 +52,24 @@ object StreamJobManager {

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-10 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r216310510 --- Diff: core/src/main/java/org/apache/carbondata/core/metadata/schema/table/CarbonTable.java --- @@ -1182,6 +1182,15 @@ private static void setLocalD

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-10 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r216309957 --- Diff: streaming/src/main/java/org/apache/carbondata/streaming/CarbonStreamRecordWriter.java --- @@ -316,6 +316,10 @@ private void appendBlockletToD

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-10 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r216306167 --- Diff: pom.xml --- @@ -217,6 +217,12 @@ ${spark.version} ${spark.deps.scope} + --- End diff --

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-07 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r215970886 --- Diff: core/src/main/java/org/apache/carbondata/core/metadata/schema/table/CarbonTable.java --- @@ -1182,6 +1182,15 @@ private static void setLoc

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-07 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r215973495 --- Diff: streaming/src/main/java/org/apache/carbondata/streaming/CarbonStreamRecordWriter.java --- @@ -316,6 +316,10 @@ private void appendBlocklet

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-07 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r215972515 --- Diff: integration/spark2/src/main/scala/org/apache/carbondata/stream/StreamJobManager.scala --- @@ -52,19 +52,24 @@ object StreamJobManager {

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-07 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r215971533 --- Diff: integration/spark2/src/main/scala/org/apache/carbondata/stream/StreamJobManager.scala --- @@ -102,14 +107,22 @@ object StreamJobManager {

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-07 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r215974054 --- Diff: pom.xml --- @@ -217,6 +217,12 @@ ${spark.version} ${spark.deps.scope} + --- End diff --

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-07 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r215973078 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/stream/CarbonCreateStreamCommand.scala --- @@ -82,24 +91,37 @@ ca

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-05 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r215507635 --- Diff: examples/spark2/pom.xml --- @@ -53,6 +53,11 @@ org.apache.spark spark-sql_${scala.binary.version} +

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-05 Thread QiangCai
Github user QiangCai commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r215484019 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/StreamSQLExample.scala --- @@ -0,0 +1,190 @@ +/* + * Licensed to the A

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-05 Thread QiangCai
Github user QiangCai commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2695#discussion_r215483849 --- Diff: examples/spark2/pom.xml --- @@ -53,6 +53,11 @@ org.apache.spark spark-sql_${scala.binary.version} +

[GitHub] carbondata pull request #2695: [CARBONDATA-2919] Support ingest from Kafka i...

2018-09-05 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/carbondata/pull/2695 [CARBONDATA-2919] Support ingest from Kafka in StreamSQL WIP - [ ] Any interfaces changed? - [ ] Any backward compatibility impacted? - [ ] Document update requir