Re: Add spark dependency on on org.opencypher:okapi-shade.okapi

2019-10-18 Thread Weichen Xu
Attach the design doc here https://docs.google.com/document/d/1Wxzghj0PvpOVu7XD1iA8uonRYhexwn18utdcTxtkxlI/edit# I think the initial design intention is to replace graphx in spark. At first, we plan to merge graphframe project into spark, now this design is improved to not only include graphframe,

Re: DataSourceV2 sync notes - 2 October 2019

2019-10-18 Thread Wenchen Fan
Hi Ryan, Thanks for summarizing and sending out the notes! I've created the JIRA ticket to add v2 statements for all the commands that need to resolve a table: https://issues.apache.org/jira/browse/SPARK-29481 Contributions to it are appreciated! Thanks, Wenchen On Fri, Oct 11, 2019 at 7:05 AM