[ https://issues.apache.org/jira/browse/CARBONDATA-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jihong MA updated CARBONDATA-322: --------------------------------- Issue Type: New Feature (was: Improvement) > Integration with spark 2.x > ---------------------------- > > Key: CARBONDATA-322 > URL: https://issues.apache.org/jira/browse/CARBONDATA-322 > Project: CarbonData > Issue Type: New Feature > Components: spark-integration > Affects Versions: 0.2.0-incubating > Reporter: Fei Wang > Assignee: Fei Wang > Fix For: 1.0.0-incubating > > > Since spark 2.0 released. there are many nice features such as more efficient > parser, vectorized execution, adaptive execution. > It is good to integrate with spark 2.x > current integration up to Spark v1.6 is tightly coupled with spark, we would > like to cleanup the interface with following design points in mind: > 1. decoupled with Spark, integration based on Spark's v2 datasource API > 2. Enable vectorized carbon reader > 3. Support saving DataFrame to Carbondata file through Carbondata's output > format. > ... -- This message was sent by Atlassian JIRA (v6.3.4#6332)