Re: V2.3 Scala API to Github Links Incorrect

[+Yuming] Will try to have some time to take a look as well. 2018-04-16 11:27 GMT+08:00 Thakrar, Jayesh : > Thanks Sameer! > > > > *From: *Sameer Agarwal > *Date: *Sunday, April 15, 2018 at 10:02 PM > *To: *"Thakrar, Jayesh"

Re: V2.3 Scala API to Github Links Incorrect

Thanks Sameer! From: Sameer Agarwal Date: Sunday, April 15, 2018 at 10:02 PM To: "Thakrar, Jayesh" Cc: "dev@spark.apache.org" , Hyukjin Kwon Subject: Re: V2.3 Scala API to Github Links Incorrect

Re: V2.3 Scala API to Github Links Incorrect

[+Hyukjin] Thanks for flagging this Jayesh. https://github.com/apache/spar k-website/pull/111 is tracking a short term fix to the API docs and https://issues.apache.org/jira/browse/SPARK-23732 tracks the fix to the release scripts. Regards, Sameer On 15 April 2018 at 18:50, Thakrar, Jayesh

[discuss][data source v2] remove type parameter in DataReader/WriterFactory

Hi all, I'd like to propose an API change to the data source v2. One design goal of data source v2 is API type safety. The FileFormat API is a bad example, it asks the implementation to return InternalRow even it's actually ColumnarBatch. In data source v2 we add a type parameter to

V2.3 Scala API to Github Links Incorrect

In browsing through the API docs, the links to Github source code seem to be pointing to a dev branch rather than the release branch. Here's one example Go to the API doc page below and click on the "ProcessingTime.scala" link which points to Sameer's dev branch.