[GitHub] carbondata issue #2083: [WIP]Pre-Aggregate Streaming table handling
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2083 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3979/ ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2071 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3229/ ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2071 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4462/ ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user chenliang613 commented on the issue: https://github.com/apache/carbondata/pull/2071 retest this please ---
[GitHub] carbondata issue #2083: [WIP]Pre-Aggregate Streaming table handling
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2083 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3228/ ---
[GitHub] carbondata issue #2083: [WIP]Pre-Aggregate Streaming table handling
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2083 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4461/ ---
[GitHub] carbondata pull request #2083: [WIP]Pre-Aggregate Streaming table handling
GitHub user kumarvishal09 opened a pull request: https://github.com/apache/carbondata/pull/2083 [WIP]Pre-Aggregate Streaming table handling Pre-Aggregate Streaming table handling Be sure to do all of the following checklist to help us incorporate your contribution quickly and easily: - [ ] Any interfaces changed? - [ ] Any backward compatibility impacted? - [ ] Document update required? - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - How it is tested? Please attach test report. - Is it a performance related change? Please attach the performance test report. - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. You can merge this pull request into a Git repository by running: $ git pull https://github.com/kumarvishal09/incubator-carbondata PreAggregate_Streaming Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/2083.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2083 ---
[jira] [Assigned] (CARBONDATA-1522) 6. Loading aggregation tables for streaming data tables.
[ https://issues.apache.org/jira/browse/CARBONDATA-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kumar vishal reassigned CARBONDATA-1522: Assignee: Kunal Kapoor > 6. Loading aggregation tables for streaming data tables. > > > Key: CARBONDATA-1522 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1522 > Project: CarbonData > Issue Type: Sub-task >Reporter: Ravindra Pesala >Assignee: Kunal Kapoor >Priority: Major > > we can finish the segment load after receives configurable amount of data > and create a new segment to load new streaming data. While finishing the > segment we can trigger the agg tables on it. So there would not be any agg > tables on ongoing streaming segment but querying can be done on the streaming > segment of actual table. > For example user configures stream_segment size as 1 GB, so for every 1 GB of > stream data it receives it creates a new segment and finishes the current > segment. While finishing the current segment we can trigger agg table loading > and compaction of segments. > While querying of data we change the query plan to apply union of agg table > and streaming segment of actual table to get the current data. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user xubo245 commented on the issue: https://github.com/apache/carbondata/pull/2078 @jackylk Please review it. ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user xubo245 commented on the issue: https://github.com/apache/carbondata/pull/2080 @jackylk Please review it. ---
[GitHub] carbondata issue #2081: [CARBONDATA-2262] Support the syntax of 'using CARBO...
Github user xubo245 commented on the issue: https://github.com/apache/carbondata/pull/2081 @jackylk Please review it. ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2071 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3978/ ---
[GitHub] carbondata issue #2076: [CARBONDATA-2230][BACKPORT-1.3]Add a path into table...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2076 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3977/ ---
[GitHub] carbondata issue #2072: [CARBONDATA-1998][SDK] Support CarbonReader to read ...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2072 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3976/ ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2071 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4460/ ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2071 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3227/ ---
[GitHub] carbondata issue #2076: [CARBONDATA-2230][BACKPORT-1.3]Add a path into table...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2076 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3226/ ---
[GitHub] carbondata issue #2072: [CARBONDATA-1998][SDK] Support CarbonReader to read ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2072 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3225/ ---
[GitHub] carbondata issue #2076: [CARBONDATA-2230][BACKPORT-1.3]Add a path into table...
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/2076 retest sdv please ---
[GitHub] carbondata issue #2076: [CARBONDATA-2230][BACKPORT-1.3]Add a path into table...
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/2076 retest this please ---
[GitHub] carbondata issue #2076: [CARBONDATA-2230][BACKPORT-1.3]Add a path into table...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2076 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3974/ ---
[GitHub] carbondata issue #2082: [CARBONDATA-2265] [DFX]-Load]: Load job fails if 1 f...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2082 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3973/ ---
[GitHub] carbondata issue #2076: [CARBONDATA-2230][BACKPORT-1.3]Add a path into table...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2076 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3224/ ---
[GitHub] carbondata issue #2079: [Documentation] Editorial Review
Github user jackylk commented on the issue: https://github.com/apache/carbondata/pull/2079 LGTM ---
[GitHub] carbondata issue #2072: [CARBONDATA-1998][SDK] Support CarbonReader to read ...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2072 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3972/ ---
[GitHub] carbondata issue #2076: [CARBONDATA-2230][BACKPORT-1.3]Add a path into table...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2076 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4457/ ---
[GitHub] carbondata issue #2076: [CARBONDATA-2230][BACKPORT-1.3]Add a path into table...
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/2076 retest this please ---
[GitHub] carbondata issue #2082: [CARBONDATA-2265] [DFX]-Load]: Load job fails if 1 f...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2082 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4455/ ---
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2078 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3970/ ---
[jira] [Resolved] (CARBONDATA-2223) Adding Listener Support for Partition
[ https://issues.apache.org/jira/browse/CARBONDATA-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manish Gupta resolved CARBONDATA-2223. -- Resolution: Fixed Fix Version/s: 1.3.1 1.4.0 > Adding Listener Support for Partition > - > > Key: CARBONDATA-2223 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2223 > Project: CarbonData > Issue Type: Improvement >Reporter: dhatchayani >Assignee: dhatchayani >Priority: Minor > Fix For: 1.4.0, 1.3.1 > > Time Spent: 8h 50m > Remaining Estimate: 0h > > Remove unused listeners -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata pull request #2031: [CARBONDATA-2223] Adding Listener Support for...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/2031 ---
[GitHub] carbondata issue #2031: [CARBONDATA-2223] Adding Listener Support for Partit...
Github user manishgupta88 commented on the issue: https://github.com/apache/carbondata/pull/2031 LGTM ---
[GitHub] carbondata issue #2082: [CARBONDATA-2265] [DFX]-Load]: Load job fails if 1 f...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2082 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3222/ ---
[GitHub] carbondata issue #2081: [CARBONDATA-2262] Support the syntax of 'using CARBO...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2081 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3969/ ---
[GitHub] carbondata issue #2077: [CARBONDATA-2263] Fixed bug for incorrect data in da...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2077 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3221/ ---
[GitHub] carbondata issue #2077: [CARBONDATA-2263] Fixed bug for incorrect data in da...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2077 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4454/ ---
[GitHub] carbondata pull request #2082: [CARBONDATA-2265] [DFX]-Load]: Load job fails...
GitHub user dhatchayani opened a pull request: https://github.com/apache/carbondata/pull/2082 [CARBONDATA-2265] [DFX]-Load]: Load job fails if 1 folder contains 1000 files Problem : We are keeping the rawTablePages also in memory, but we are no where using it Solution : Removed storing rawTablePages - [ ] Any interfaces changed? - [ ] Any backward compatibility impacted? - [ ] Document update required? - [x] Testing done Manual Testing - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhatchayani/incubator-carbondata load_fails Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/2082.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2082 commit b0bf4c6c21fb89a771ee6a0ed05c29cae3bba3cf Author: dhatchayaniDate: 2018-03-20T12:41:58Z [CARBONDATA-2265] [DFX]-Load]: Load job fails if 1 folder contains 1000 files ---
[GitHub] carbondata issue #2072: [CARBONDATA-1998][SDK] Support CarbonReader to read ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2072 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4453/ ---
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2078 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3968/ ---
[jira] [Assigned] (CARBONDATA-2265) [DFX]-Load]: Load job fails if 1 folder contains 1000 files
[ https://issues.apache.org/jira/browse/CARBONDATA-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhatchayani reassigned CARBONDATA-2265: --- Assignee: dhatchayani > [DFX]-Load]: Load job fails if 1 folder contains 1000 files > > > Key: CARBONDATA-2265 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2265 > Project: CarbonData > Issue Type: Bug > Environment: 3 node ant cluster >Reporter: Ajeet Rai >Assignee: dhatchayani >Priority: Major > Labels: DFX > > Load job fails if 1 folder contains 1000 files. > 【Precondition】:Thrift server should be running > 【Test step】: > 1: Create a carbon table > 2: Start a load where 1 folder contains 1000 files > 3: Observe that load fails > > Observe that Out of Memory exception is thrown. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata issue #2077: [CARBONDATA-2263] Fixed bug for incorrect data in da...
Github user SangeetaGulia commented on the issue: https://github.com/apache/carbondata/pull/2077 retest this please. ---
[GitHub] carbondata issue #2065: [CARBONDATA-2256] Adding sdv Testcases for SET_Param...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2065 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3967/ ---
[GitHub] carbondata issue #2072: [CARBONDATA-1998][SDK] Support CarbonReader to read ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2072 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3220/ ---
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2078 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4452/ ---
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2078 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3219/ ---
[GitHub] carbondata issue #2081: [CARBONDATA-2262] Support the syntax of 'using CARBO...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2081 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4450/ ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2080 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3218/ ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2080 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3966/ ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2080 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4451/ ---
[GitHub] carbondata issue #2081: [CARBONDATA-2262] Support the syntax of 'using CARBO...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2081 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3217/ ---
[jira] [Created] (CARBONDATA-2265) [DFX]-Load]: Load job fails if 1 folder contains 1000 files
Ajeet Rai created CARBONDATA-2265: - Summary: [DFX]-Load]: Load job fails if 1 folder contains 1000 files Key: CARBONDATA-2265 URL: https://issues.apache.org/jira/browse/CARBONDATA-2265 Project: CarbonData Issue Type: Bug Environment: 3 node ant cluster Reporter: Ajeet Rai Load job fails if 1 folder contains 1000 files. 【Precondition】:Thrift server should be running 【Test step】: 1: Create a carbon table 2: Start a load where 1 folder contains 1000 files 3: Observe that load fails Observe that Out of Memory exception is thrown. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user xubo245 commented on the issue: https://github.com/apache/carbondata/pull/2078 retest this please ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user xubo245 commented on the issue: https://github.com/apache/carbondata/pull/2080 Retest this please. ---
[GitHub] carbondata issue #2081: [CARBONDATA-2262] Support the syntax of 'using CARBO...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2081 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3965/ ---
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2078 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3216/ ---
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2078 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4449/ ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2080 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4446/ ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2080 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3213/ ---
[GitHub] carbondata issue #2065: [CARBONDATA-2256] Adding sdv Testcases for SET_Param...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2065 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3212/ ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2080 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3964/ ---
[GitHub] carbondata issue #2065: [CARBONDATA-2256] Adding sdv Testcases for SET_Param...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2065 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4445/ ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user xubo245 commented on the issue: https://github.com/apache/carbondata/pull/2080 Retest this please. ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2080 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1// ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2080 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3211/ ---
[GitHub] carbondata issue #2081: [CARBONDATA-2262] Support the syntax of 'using CARBO...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2081 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3210/ ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2071 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3963/ ---
[GitHub] carbondata issue #2081: [CARBONDATA-2262] Support the syntax of 'using CARBO...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2081 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4443/ ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2071 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3208/ ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2071 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4441/ ---
[GitHub] carbondata pull request #2081: [CARBONDATA-2262] Support the syntax of 'usin...
GitHub user xubo245 opened a pull request: https://github.com/apache/carbondata/pull/2081 [CARBONDATA-2262] Support the syntax of 'using CARBONDATA' to create table Add new function to Support the syntax of 'using CARBONDATA' to create table, for example: `CREATE TABLE src_carbondata1(key INT, value STRING) using CarbonData OPTIONS('tableName'='src_carbondata1')` Be sure to do all of the following checklist to help us incorporate your contribution quickly and easily: - [ ] Any interfaces changed? - [ ] Any backward compatibility impacted? - [ ] Document update required? - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - How it is tested? Please attach test report. - Is it a performance related change? Please attach the performance test report. - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. You can merge this pull request into a Git repository by running: $ git pull https://github.com/xubo245/carbondata CARBONDATA-2262UsingCarbonData Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/2081.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2081 ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2071 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3962/ ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2080 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3209/ ---
[GitHub] carbondata issue #2080: [CARBONDATA-2264] Support create table using CarbonS...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2080 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4442/ ---
[GitHub] carbondata pull request #2080: [CARBONDATA-2264] Support create table using ...
GitHub user xubo245 opened a pull request: https://github.com/apache/carbondata/pull/2080 [CARBONDATA-2264] Support create table using CarbonSource Without TableName Be sure to do all of the following checklist to help us incorporate your contribution quickly and easily: - [ ] Any interfaces changed? - [ ] Any backward compatibility impacted? - [ ] Document update required? - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - How it is tested? Please attach test report. - Is it a performance related change? Please attach the performance test report. - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. You can merge this pull request into a Git repository by running: $ git pull https://github.com/xubo245/carbondata CARBONDATA-2264UsingCarbonSourceWithoutTableName Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/2080.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2080 commit 0ea1ec617276b13fe5884f7d588c969b25d86ead Author: root <601450868@...> Date: 2018-03-20T07:53:40Z [CARBONDATA-2264] Support create table using CarbonSource Without TableName ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2071 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4440/ ---
[GitHub] carbondata issue #2071: [CARBONDATA-2259] Add auto CI for examples
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2071 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3207/ ---
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2078 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3961/ ---
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2078 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4439/ ---
[GitHub] carbondata issue #2078: [CARBONDATA-2262] Support the syntax of 'STORED AS C...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2078 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3206/ ---
[jira] [Updated] (CARBONDATA-2264) There is error when we create table using CarbonSource
[ https://issues.apache.org/jira/browse/CARBONDATA-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xubo245 updated CARBONDATA-2264: Description: There is error when we create table using CarbonSource . Test code: {code:java} test("test create table with complex datatype withour tablename in options") { sql("drop table if exists create_source") sql("create table create_source(intField int, stringField string, complexField array) USING org.apache.spark.sql.CarbonSource") sql("drop table create_source") } {code} Error: {code:java} Table creation failed. Table name is not specified; org.apache.spark.sql.AnalysisException: Table creation failed. Table name is not specified; at org.apache.spark.sql.util.CarbonException$.analysisException(CarbonException.scala:23) at org.apache.spark.sql.CarbonSource.createRelation(CarbonSource.scala:141) at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:305) at org.apache.spark.sql.execution.command.CreateDataSourceTableCommand.run(createDataSourceTables.scala:78) at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:58) at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:56) at org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:67) at org.apache.spark.sql.Dataset.(Dataset.scala:183) at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:68) at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:632) at org.apache.spark.sql.test.Spark2TestQueryExecutor.sql(Spark2TestQueryExecutor.scala:35) at org.apache.spark.sql.test.util.QueryTest.sql(QueryTest.scala:103) at org.apache.spark.carbondata.CarbonDataSourceSuite$$anonfun$8.apply$mcV$sp(CarbonDataSourceSuite.scala:207) at org.apache.spark.carbondata.CarbonDataSourceSuite$$anonfun$8.apply(CarbonDataSourceSuite.scala:205) at org.apache.spark.carbondata.CarbonDataSourceSuite$$anonfun$8.apply(CarbonDataSourceSuite.scala:205) at org.scalatest.Transformer$$anonfun$apply$1.apply$mcV$sp(Transformer.scala:22) at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85) at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) at org.scalatest.Transformer.apply(Transformer.scala:22) at org.scalatest.Transformer.apply(Transformer.scala:20) at org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:166) at org.apache.spark.sql.test.util.CarbonFunSuite.withFixture(CarbonFunSuite.scala:41) at org.scalatest.FunSuiteLike$class.invokeWithFixture$1(FunSuiteLike.scala:163) at org.scalatest.FunSuiteLike$$anonfun$runTest$1.apply(FunSuiteLike.scala:175) at org.scalatest.FunSuiteLike$$anonfun$runTest$1.apply(FunSuiteLike.scala:175) at org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) at org.scalatest.FunSuiteLike$class.runTest(FunSuiteLike.scala:175) at org.scalatest.FunSuite.runTest(FunSuite.scala:1555) at org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:208) at org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:208) at org.scalatest.SuperEngine$$anonfun$traverseSubNodes$1$1.apply(Engine.scala:413) at org.scalatest.SuperEngine$$anonfun$traverseSubNodes$1$1.apply(Engine.scala:401) at scala.collection.immutable.List.foreach(List.scala:381) at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) at org.scalatest.SuperEngine.org$scalatest$SuperEngine$$runTestsInBranch(Engine.scala:396) at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:483) at org.scalatest.FunSuiteLike$class.runTests(FunSuiteLike.scala:208) at org.scalatest.FunSuite.runTests(FunSuite.scala:1555) at org.scalatest.Suite$class.run(Suite.scala:1424) at org.scalatest.FunSuite.org$scalatest$FunSuiteLike$$super$run(FunSuite.scala:1555) at org.scalatest.FunSuiteLike$$anonfun$run$1.apply(FunSuiteLike.scala:212) at org.scalatest.FunSuiteLike$$anonfun$run$1.apply(FunSuiteLike.scala:212) at org.scalatest.SuperEngine.runImpl(Engine.scala:545) at org.scalatest.FunSuiteLike$class.run(FunSuiteLike.scala:212) at org.apache.spark.carbondata.CarbonDataSourceSuite.org$scalatest$BeforeAndAfterAll$$super$run(CarbonDataSourceSuite.scala:29) at org.scalatest.BeforeAndAfterAll$class.liftedTree1$1(BeforeAndAfterAll.scala:257) at org.scalatest.BeforeAndAfterAll$class.run(BeforeAndAfterAll.scala:256) at org.apache.spark.carbondata.CarbonDataSourceSuite.run(CarbonDataSourceSuite.scala:29) at org.scalatest.tools.SuiteRunner.run(SuiteRunner.scala:55) at
[jira] [Created] (CARBONDATA-2264) There is error when we create table using CarbonSource
xubo245 created CARBONDATA-2264: --- Summary: There is error when we create table using CarbonSource Key: CARBONDATA-2264 URL: https://issues.apache.org/jira/browse/CARBONDATA-2264 Project: CarbonData Issue Type: Bug Reporter: xubo245 Assignee: xubo245 There is error when we create table using CarbonSource -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata issue #2079: [Documentation] Editorial Review
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2079 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3960/ ---
[GitHub] carbondata issue #2065: [CARBONDATA-2256] Adding sdv Testcases for SET_Param...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2065 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3205/ ---
[GitHub] carbondata issue #2065: [CARBONDATA-2256] Adding sdv Testcases for SET_Param...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2065 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4438/ ---
[GitHub] carbondata issue #2079: [Documentation] Editorial Review
Github user kunal642 commented on the issue: https://github.com/apache/carbondata/pull/2079 LGTM ---
[GitHub] carbondata issue #2031: [CARBONDATA-2223] Adding Listener Support for Partit...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2031 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3959/ ---
[GitHub] carbondata issue #2079: [Documentation] Editorial Review
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2079 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3204/ ---
[GitHub] carbondata issue #2079: [Documentation] Editorial Review
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2079 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4436/ ---
[GitHub] carbondata issue #2031: [CARBONDATA-2223] Adding Listener Support for Partit...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2031 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4437/ ---
[GitHub] carbondata issue #2031: [CARBONDATA-2223] Adding Listener Support for Partit...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2031 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3203/ ---