[jira] [Created] (HAWQ-1631) Support Hive protocol using pluggable storage framework
Ruilong Huo created HAWQ-1631: - Summary: Support Hive protocol using pluggable storage framework Key: HAWQ-1631 URL: https://issues.apache.org/jira/browse/HAWQ-1631 Project: Apache HAWQ Issue Type: Sub-task Reporter: Ruilong Huo Assignee: Radar Lei Add Hive protocol using pluggable storage framework so that user can access data in Hive from hawq efficiently. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1629) Support ORC format using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1629: -- Fix Version/s: backlog > Support ORC format using pluggable storage framework > > > Key: HAWQ-1629 > URL: https://issues.apache.org/jira/browse/HAWQ-1629 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > Add ORC format using pluggable storage framework so that user can store data > in table with ORC format, which is a commonly adopted format and has > potential performance gain with statistics. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1629) Support ORC format using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1629: -- Affects Version/s: 2.3.0.0-incubating > Support ORC format using pluggable storage framework > > > Key: HAWQ-1629 > URL: https://issues.apache.org/jira/browse/HAWQ-1629 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > Add ORC format using pluggable storage framework so that user can store data > in table with ORC format, which is a commonly adopted format and has > potential performance gain with statistics. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1630) Support TEXT/CSV format using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1630: -- Fix Version/s: backlog > Support TEXT/CSV format using pluggable storage framework > - > > Key: HAWQ-1630 > URL: https://issues.apache.org/jira/browse/HAWQ-1630 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > Add TEXT/CSV format using pluggable storage framework so that user can store > data in table with TEXT/CSV format. The TEXT/CSV format in pluggable storage > framework will have better performance and extensibility comparing with that > in external table framework. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1628) Support HDFS protocol using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1628: -- Affects Version/s: 2.3.0.0-incubating > Support HDFS protocol using pluggable storage framework > --- > > Key: HAWQ-1628 > URL: https://issues.apache.org/jira/browse/HAWQ-1628 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > The purpose of supporting HDFS protocol using pluggable storage framework can > be in two folds: > 1. demonstrate an example on how to add a protocol in pluggable storage > framework > 2. data formats including orc, text, csv etc can be added to hawq using > pluggable storage framework -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1630) Support TEXT/CSV format using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1630: -- Affects Version/s: 2.3.0.0-incubating > Support TEXT/CSV format using pluggable storage framework > - > > Key: HAWQ-1630 > URL: https://issues.apache.org/jira/browse/HAWQ-1630 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > Add TEXT/CSV format using pluggable storage framework so that user can store > data in table with TEXT/CSV format. The TEXT/CSV format in pluggable storage > framework will have better performance and extensibility comparing with that > in external table framework. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1628) Support HDFS protocol using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1628: -- Fix Version/s: backlog > Support HDFS protocol using pluggable storage framework > --- > > Key: HAWQ-1628 > URL: https://issues.apache.org/jira/browse/HAWQ-1628 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > The purpose of supporting HDFS protocol using pluggable storage framework can > be in two folds: > 1. demonstrate an example on how to add a protocol in pluggable storage > framework > 2. data formats including orc, text, csv etc can be added to hawq using > pluggable storage framework -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1631) Support Hive protocol using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1631: -- Affects Version/s: 2.3.0.0-incubating > Support Hive protocol using pluggable storage framework > --- > > Key: HAWQ-1631 > URL: https://issues.apache.org/jira/browse/HAWQ-1631 > Project: Apache HAWQ > Issue Type: Sub-task >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > Add Hive protocol using pluggable storage framework so that user can access > data in Hive from hawq efficiently. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1631) Support Hive protocol using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1631: -- Fix Version/s: backlog > Support Hive protocol using pluggable storage framework > --- > > Key: HAWQ-1631 > URL: https://issues.apache.org/jira/browse/HAWQ-1631 > Project: Apache HAWQ > Issue Type: Sub-task >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > Add Hive protocol using pluggable storage framework so that user can access > data in Hive from hawq efficiently. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HAWQ-1632) Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support
Ruilong Huo created HAWQ-1632: - Summary: Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support Key: HAWQ-1632 URL: https://issues.apache.org/jira/browse/HAWQ-1632 Project: Apache HAWQ Issue Type: Sub-task Reporter: Ruilong Huo Assignee: Radar Lei Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support to add user guide. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1632) Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support
[ https://issues.apache.org/jira/browse/HAWQ-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1632: -- Affects Version/s: 2.3.0.0-incubating > Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support > -- > > Key: HAWQ-1632 > URL: https://issues.apache.org/jira/browse/HAWQ-1632 > Project: Apache HAWQ > Issue Type: Sub-task >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support to add > user guide. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1632) Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support
[ https://issues.apache.org/jira/browse/HAWQ-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1632: -- Fix Version/s: backlog > Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support > -- > > Key: HAWQ-1632 > URL: https://issues.apache.org/jira/browse/HAWQ-1632 > Project: Apache HAWQ > Issue Type: Sub-task >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support to add > user guide. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1632) Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support
[ https://issues.apache.org/jira/browse/HAWQ-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1632: -- Component/s: Documentation > Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support > -- > > Key: HAWQ-1632 > URL: https://issues.apache.org/jira/browse/HAWQ-1632 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Documentation, Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support to add > user guide. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1632) Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support
[ https://issues.apache.org/jira/browse/HAWQ-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1632: -- Component/s: Storage > Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support > -- > > Key: HAWQ-1632 > URL: https://issues.apache.org/jira/browse/HAWQ-1632 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Documentation, Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Assignee: Radar Lei >Priority: Major > Fix For: backlog > > > Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support to add > user guide. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1566) Include Pluggable Storage Format Framework in External Table Insert
[ https://issues.apache.org/jira/browse/HAWQ-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1566: -- Affects Version/s: 2.3.0.0-incubating > Include Pluggable Storage Format Framework in External Table Insert > --- > > Key: HAWQ-1566 > URL: https://issues.apache.org/jira/browse/HAWQ-1566 > Project: Apache HAWQ > Issue Type: Sub-task > Components: External Tables, Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Chiyang Wan >Assignee: Chiyang Wan >Priority: Major > Fix For: 2.3.0.0-incubating > > > There are 2 types of operation related to external table, i.e. scan, insert. > Including pluggable storage framework in these operations is necessary. > We add the external table insert and copy from(write into external table) > related feature here. > In the following steps, we still need to specify some of the critical info > that comes from the planner and the file splits info in the pluggable > filesystem. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (HAWQ-1566) Include Pluggable Storage Format Framework in External Table Insert
[ https://issues.apache.org/jira/browse/HAWQ-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo resolved HAWQ-1566. --- Resolution: Fixed Resolved as the commit is merged to master. > Include Pluggable Storage Format Framework in External Table Insert > --- > > Key: HAWQ-1566 > URL: https://issues.apache.org/jira/browse/HAWQ-1566 > Project: Apache HAWQ > Issue Type: Sub-task > Components: External Tables, Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Chiyang Wan >Assignee: Chiyang Wan >Priority: Major > Fix For: 2.3.0.0-incubating > > > There are 2 types of operation related to external table, i.e. scan, insert. > Including pluggable storage framework in these operations is necessary. > We add the external table insert and copy from(write into external table) > related feature here. > In the following steps, we still need to specify some of the critical info > that comes from the planner and the file splits info in the pluggable > filesystem. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HAWQ-1576) Add demo for pluggable format scan
[ https://issues.apache.org/jira/browse/HAWQ-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-1576: -- Affects Version/s: 2.3.0.0-incubating > Add demo for pluggable format scan > -- > > Key: HAWQ-1576 > URL: https://issues.apache.org/jira/browse/HAWQ-1576 > Project: Apache HAWQ > Issue Type: Sub-task > Components: External Tables, Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Chiyang Wan >Assignee: Chiyang Wan >Priority: Major > Fix For: 2.4.0.0-incubating > > > Once the new feature of pluggable storage framework ready, It is necessary to > add a demo on how to implement external scan on a new format using the > pluggable framework. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HAWQ-1576) Add demo for pluggable format scan
[ https://issues.apache.org/jira/browse/HAWQ-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521943#comment-16521943 ] Ruilong Huo commented on HAWQ-1576: --- This issue is deprecated by [HAWQ-1628|https://issues.apache.org/jira/browse/HAWQ-1628] ~ [HAWQ-1632|https://issues.apache.org/jira/browse/HAWQ-1632] which add HDFS/Hive protocol and ORC/TEXT/CSV format using pluggable storage framework. > Add demo for pluggable format scan > -- > > Key: HAWQ-1576 > URL: https://issues.apache.org/jira/browse/HAWQ-1576 > Project: Apache HAWQ > Issue Type: Sub-task > Components: External Tables, Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Chiyang Wan >Assignee: Chiyang Wan >Priority: Major > Fix For: 2.4.0.0-incubating > > > Once the new feature of pluggable storage framework ready, It is necessary to > add a demo on how to implement external scan on a new format using the > pluggable framework. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (HAWQ-1576) Add demo for pluggable format scan
[ https://issues.apache.org/jira/browse/HAWQ-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo resolved HAWQ-1576. --- Resolution: Duplicate > Add demo for pluggable format scan > -- > > Key: HAWQ-1576 > URL: https://issues.apache.org/jira/browse/HAWQ-1576 > Project: Apache HAWQ > Issue Type: Sub-task > Components: External Tables, Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Chiyang Wan >Assignee: Chiyang Wan >Priority: Major > Fix For: 2.4.0.0-incubating > > > Once the new feature of pluggable storage framework ready, It is necessary to > add a demo on how to implement external scan on a new format using the > pluggable framework. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HAWQ-1577) Add demo for pluggable format insert
[ https://issues.apache.org/jira/browse/HAWQ-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521947#comment-16521947 ] Ruilong Huo commented on HAWQ-1577: --- This issue is deprecated by [HAWQ-1628|https://issues.apache.org/jira/browse/HAWQ-1628] ~ [HAWQ-1632|https://issues.apache.org/jira/browse/HAWQ-1632] which add HDFS/Hive protocol and ORC/TEXT/CSV format using pluggable storage framework. > Add demo for pluggable format insert > > > Key: HAWQ-1577 > URL: https://issues.apache.org/jira/browse/HAWQ-1577 > Project: Apache HAWQ > Issue Type: Sub-task > Components: External Tables, Storage >Reporter: Chiyang Wan >Assignee: Chiyang Wan >Priority: Major > Fix For: 2.4.0.0-incubating > > > Once the new feature of pluggable storage framework ready, It is necessary to > add a demo on how to implement external insert on a new format using the > pluggable framework. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (HAWQ-1577) Add demo for pluggable format insert
[ https://issues.apache.org/jira/browse/HAWQ-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo resolved HAWQ-1577. --- Resolution: Duplicate > Add demo for pluggable format insert > > > Key: HAWQ-1577 > URL: https://issues.apache.org/jira/browse/HAWQ-1577 > Project: Apache HAWQ > Issue Type: Sub-task > Components: External Tables, Storage >Reporter: Chiyang Wan >Assignee: Chiyang Wan >Priority: Major > Fix For: 2.4.0.0-incubating > > > Once the new feature of pluggable storage framework ready, It is necessary to > add a demo on how to implement external insert on a new format using the > pluggable framework. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HAWQ-1629) Support ORC format using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo reassigned HAWQ-1629: - Assignee: (was: Radar Lei) > Support ORC format using pluggable storage framework > > > Key: HAWQ-1629 > URL: https://issues.apache.org/jira/browse/HAWQ-1629 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Priority: Major > Fix For: backlog > > > Add ORC format using pluggable storage framework so that user can store data > in table with ORC format, which is a commonly adopted format and has > potential performance gain with statistics. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HAWQ-1630) Support TEXT/CSV format using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo reassigned HAWQ-1630: - Assignee: (was: Radar Lei) > Support TEXT/CSV format using pluggable storage framework > - > > Key: HAWQ-1630 > URL: https://issues.apache.org/jira/browse/HAWQ-1630 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Priority: Major > Fix For: backlog > > > Add TEXT/CSV format using pluggable storage framework so that user can store > data in table with TEXT/CSV format. The TEXT/CSV format in pluggable storage > framework will have better performance and extensibility comparing with that > in external table framework. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HAWQ-1628) Support HDFS protocol using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo reassigned HAWQ-1628: - Assignee: (was: Radar Lei) > Support HDFS protocol using pluggable storage framework > --- > > Key: HAWQ-1628 > URL: https://issues.apache.org/jira/browse/HAWQ-1628 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Priority: Major > Fix For: backlog > > > The purpose of supporting HDFS protocol using pluggable storage framework can > be in two folds: > 1. demonstrate an example on how to add a protocol in pluggable storage > framework > 2. data formats including orc, text, csv etc can be added to hawq using > pluggable storage framework -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HAWQ-1632) Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support
[ https://issues.apache.org/jira/browse/HAWQ-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo reassigned HAWQ-1632: - Assignee: (was: Radar Lei) > Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support > -- > > Key: HAWQ-1632 > URL: https://issues.apache.org/jira/browse/HAWQ-1632 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Documentation, Storage >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Priority: Major > Fix For: backlog > > > Wrap up pluggable storage framework and HDFS/Hive ORC/TEXT/CSV support to add > user guide. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HAWQ-1631) Support Hive protocol using pluggable storage framework
[ https://issues.apache.org/jira/browse/HAWQ-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo reassigned HAWQ-1631: - Assignee: (was: Radar Lei) > Support Hive protocol using pluggable storage framework > --- > > Key: HAWQ-1631 > URL: https://issues.apache.org/jira/browse/HAWQ-1631 > Project: Apache HAWQ > Issue Type: Sub-task >Affects Versions: 2.3.0.0-incubating >Reporter: Ruilong Huo >Priority: Major > Fix For: backlog > > > Add Hive protocol using pluggable storage framework so that user can access > data in Hive from hawq efficiently. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
