[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1566 ---

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153094993 --- Diff: processing/src/main/java/org/apache/carbondata/processing/merger/CompactionResultSortProcessor.java --- @@ -196,9 +196,16 @@ private void del

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153094868 --- Diff: streaming/src/main/scala/org/apache/carbondata/streaming/StreamHandoffRDD.scala --- @@ -0,0 +1,193 @@ +/* + * Licensed to the Apache

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153094776 --- Diff: streaming/src/main/scala/org/apache/carbondata/streaming/StreamHandoffRDD.scala --- @@ -0,0 +1,193 @@ +/* + * Licensed to the Apache

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153094639 --- Diff: streaming/src/main/scala/org/apache/carbondata/streaming/StreamHandoffRDD.scala --- @@ -0,0 +1,193 @@ +/* + * Licensed to the Apache

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153094199 --- Diff: integration/spark2/src/test/scala/org/apache/spark/carbondata/TestStreamingTableOperation.scala --- @@ -849,7 +892,13 @@ class TestStreamingT

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153093812 --- Diff: streaming/src/main/scala/org/apache/carbondata/streaming/StreamHandoffUtil.scala --- @@ -0,0 +1,236 @@ +/* + * Licensed to the Apache

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153093767 --- Diff: streaming/src/main/scala/org/apache/carbondata/streaming/StreamHandoffUtil.scala --- @@ -0,0 +1,236 @@ +/* + * Licensed to the Apache

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153093578 --- Diff: streaming/src/main/scala/org/apache/carbondata/streaming/StreamHandoffUtil.scala --- @@ -0,0 +1,236 @@ +/* + * Licensed to the Apache

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153093394 --- Diff: integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/CarbonMergerRDD.scala --- @@ -116,7 +116,7 @@ class CarbonMergerRDD[K

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153093237 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/streaming/CarbonStreamRecordReader.java --- @@ -342,7 +349,11 @@ private boolean nextRow()

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1566#discussion_r153092758 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/result/iterator/RawResultIterator.java --- @@ -64,6 +64,10 @@ public RawResultIterator(Car

[GitHub] carbondata pull request #1566: [CARBONDATA-1586][Streaming] Support handoff ...

2017-11-24 Thread QiangCai
GitHub user QiangCai opened a pull request: https://github.com/apache/carbondata/pull/1566 [CARBONDATA-1586][Streaming] Support handoff from row format to columnar format 1. configuration carbon.handoff.size =>carbon.streaming.segment.max.size 2. SQL command alter table