[CARBONDATA-636]Fixed testcase issues in spark 1.6 and 2.1 of no kettle. And also refactored of insert into flow in no kettle This closes #529
Project: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/commit/6d29fa2f Tree: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/tree/6d29fa2f Diff: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/diff/6d29fa2f Branch: refs/heads/master Commit: 6d29fa2f004cfd721dff476c9a8218b2e34a9727 Parents: 32354b3 8100d94 Author: jackylk <jacky.li...@huawei.com> Authored: Fri Jan 13 23:52:37 2017 +0800 Committer: jackylk <jacky.li...@huawei.com> Committed: Fri Jan 13 23:52:37 2017 +0800 ---------------------------------------------------------------------- .../core/constants/CarbonCommonConstants.java | 10 +++++ .../spark/rdd/CarbonDataLoadRDD.scala | 18 ++++---- .../spark/rdd/NewCarbonDataLoadRDD.scala | 30 ++++--------- .../processing/csvreaderstep/CsvInput.java | 11 ++--- .../csvreaderstep/JavaRddIterator.java | 32 -------------- .../processing/csvreaderstep/RddInputUtils.java | 12 +++--- .../processing/model/CarbonLoadModel.java | 15 +++++++ .../newflow/CarbonDataLoadConfiguration.java | 10 +++++ .../newflow/DataLoadProcessBuilder.java | 1 + .../sort/impl/ParallelReadMergeSorterImpl.java | 3 -- .../newflow/steps/InputProcessorStepImpl.java | 45 +++++++++++++++----- .../sortandgroupby/sortdata/SortDataRows.java | 7 ++- .../util/CarbonDataProcessorUtil.java | 30 ------------- 13 files changed, 105 insertions(+), 119 deletions(-) ----------------------------------------------------------------------