Re: [discuss] Data Source V2 write path

2017-09-24 Thread Reynold Xin
Can there be an explicit create function? On Sun, Sep 24, 2017 at 7:17 PM, Wenchen Fan wrote: > I agree it would be a clean approach if data source is only responsible to > write into an already-configured table. However, without catalog > federation, Spark doesn't have an API to ask an externa

Re: [discuss] Data Source V2 write path

2017-09-24 Thread Wenchen Fan
I agree it would be a clean approach if data source is only responsible to write into an already-configured table. However, without catalog federation, Spark doesn't have an API to ask an external system(like Cassandra) to create a table. Currently it's all done by data source write API. Data sourc