Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/12774
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/12774#issuecomment-216412492
Here is my version of the fix -
https://github.com/apache/spark/pull/12856/files
---
If your project is set up for it, you can reply to this email and have your
reply app
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/12774#issuecomment-216411689
@sbcd90 I dont get your example. Your example actually shows that only file
`/test_spark/join1.json` is considered in Spark 1.6.1. In Spark master, this is
broken as both
Github user gatorsmile commented on the pull request:
https://github.com/apache/spark/pull/12774#issuecomment-216099597
cc @yhuai
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/12774#issuecomment-216098660
@gatorsmile Does that maybe imply closing this for now and make a JIRA or
send a email to dev-mailing list in order to discuss this further?
---
If your project is
Github user gatorsmile commented on the pull request:
https://github.com/apache/spark/pull/12774#issuecomment-216096227
IMO, the current behavior is expected. If the document is not clear, we
should correct the document.
---
If your project is set up for it, you can reply to this em
Github user sbcd90 commented on the pull request:
https://github.com/apache/spark/pull/12774#issuecomment-215927369
Hello @HyukjinKwon , I am able to reproduce the same issue even in Spark
1.6.1. I had two files like this
```
/test_spark/join1.json
{"a": 1, "b": 2}
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/12774#issuecomment-215627856
(I think "(If this patch involves UI changes, please attach a screenshot;
otherwise, remove this)" can be removed in the PR description)
---
If your project is set
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/12774#discussion_r61534612
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -376,14 +376,10 @@ class HDFSFileCatalog(
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/12774#discussion_r61534248
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala
---
@@ -376,14 +376,10 @@ class HDFSFileCatalog(
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12774#issuecomment-215624123
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your p
GitHub user sbcd90 opened a pull request:
https://github.com/apache/spark/pull/12774
[SPARK-14997]Files in subdirectories are incorrectly considered in
sqlContext.read.json()
## What changes were proposed in this pull request?
This PR fixes the issue of "Files in subdirecto
12 matches
Mail list logo
