[jira] [Commented] (SPARK-19154) support read and overwrite a same table
[ https://issues.apache.org/jira/browse/SPARK-19154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817213#comment-15817213 ] Wenchen Fan commented on SPARK-19154: - it turns out that we still remove all the files before overwrite, and there is no easy way to support this feature unless we overwrite data to a temp directory first. I'm closing this ticket as "later". > support read and overwrite a same table > --- > > Key: SPARK-19154 > URL: https://issues.apache.org/jira/browse/SPARK-19154 > Project: Spark > Issue Type: Improvement > Components: SQL >Reporter: Wenchen Fan > > In SPARK-5746 , we forbid users to read and overwrite a same table. It seems > like we don't need this limitation now, we can remove the check and add > regression tests. We may need to take care of partitioned table though. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19154) support read and overwrite a same table
[ https://issues.apache.org/jira/browse/SPARK-19154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816961#comment-15816961 ] Wenchen Fan commented on SPARK-19154: - Please investigate first, I haven't gone through all of the details, and this feature may be very hard to implement. If it's very hard, we should close this ticket as "later". > support read and overwrite a same table > --- > > Key: SPARK-19154 > URL: https://issues.apache.org/jira/browse/SPARK-19154 > Project: Spark > Issue Type: Improvement > Components: SQL >Reporter: Wenchen Fan > > In SPARK-5746 , we forbid users to read and overwrite a same table. It seems > like we don't need this limitation now, we can remove the check and add > regression tests. We may need to take care of partitioned table though. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19154) support read and overwrite a same table
[ https://issues.apache.org/jira/browse/SPARK-19154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816942#comment-15816942 ] Song Jun commented on SPARK-19154: -- I am working on this~ > support read and overwrite a same table > --- > > Key: SPARK-19154 > URL: https://issues.apache.org/jira/browse/SPARK-19154 > Project: Spark > Issue Type: Improvement > Components: SQL >Reporter: Wenchen Fan > > In SPARK-5746 , we forbid users to read and overwrite a same table. It seems > like we don't need this limitation now, we can remove the check and add > regression tests. We may need to take care of partitioned table though. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
