GitHub user liancheng opened a pull request:
https://github.com/apache/spark/pull/12361
[SPARK-14407][SQL] Hides HadoopFsRelation related data source API into
execution/datasources package #12178
## What changes were proposed in this pull request?
This PR moves `HadoopFsRelation` related data source API into
`execution/datasources` package.
Note that to avoid conflicts, this PR is based on #12153. Effective commits
for this PR only consist of the last two. Will rebase after merging #12153.
## How was this patch tested?
Existing tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/liancheng/spark
spark-14407-hide-hadoop-fs-relation
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12361.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12361
----
commit 06b2afb9f3bd5dc4833e939f3f522168252eaa4b
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-04T15:33:18Z
Locality support for FileScanRDD
commit d94f7e95fc772d26c9d515a8ab9b6b96432fc8ff
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-04T17:21:22Z
Fixes import order
commit 5f214c12bdf133d90ceac441130af18af2fb7e6a
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-04T18:38:46Z
Fixes cases where block location list is empty
commit f036bb10304eb8f127a9956c178d6948a470ed9c
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-05T12:29:42Z
Adds withHadoopConf utility method
commit 426b52817d80b36f2c585ae498580a317e642312
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-05T14:27:36Z
Tests
commit 082d4a3ee7034dae3447cde68ae0bbcae3a80632
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-05T16:59:58Z
Moves the test case to HadoopFsRelationTest
commit f72d0ffbf15d599918f275ecf1a6c76223a6de97
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-06T14:54:53Z
Addresses PR comments
commit deb0f8509f6edff890f7882a3ce36d4cd0c6e403
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-06T14:59:22Z
Adjusts file partition size fraction threshold to 10%
commit 25224e1d09cd37beb4a922ad238f59c9e3732efb
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-07T16:44:56Z
Fixes test case flakiness
commit e666dea2241f400dd44abd2161db269ab7fb71af
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-11T13:29:17Z
Uses getLocatedStatus() instead of getStatus() + getBlockLocations()
commit 7cd40d989cc5008287547640ee47b0b89d59bdee
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-12T14:33:49Z
Fixes import order
commit 843e050b3baea14bff042e62c519518720d33c0a
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-13T13:55:01Z
Makes locality test case more robust
commit cef40bfb940a24e43ac01e4c521be6de51f5662d
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-13T13:59:09Z
Simplifies locality selection
commit af018f8b501ea3a396605e05889ac7cbed00cc78
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-13T15:23:23Z
Hides HadoopFsRelation related data source API
commit c5fba2f9ab821ef5c577a244b7c157549bb819e5
Author: Cheng Lian <l...@databricks.com>
Date: 2016-04-13T15:25:04Z
Fixes MiMA
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
