Github user zenglinxi0615 commented on the issue:
https://github.com/apache/spark/pull/18430
test please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user zenglinxi0615 commented on the issue:
https://github.com/apache/spark/pull/18430
sorry, it's a typing error, i mean the related JIRA: SPARK-21078.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user zenglinxi0615 commented on the issue:
https://github.com/apache/spark/pull/18430
@srowen thanks for your suggestions again! and should I address the problem
of SPARK-13988 in this PR?
---
If your project is set up for it, you can reply to this email and have your
reply
Github user zenglinxi0615 commented on the issue:
https://github.com/apache/spark/pull/18430
@jerryshao actually, this threading issue cause an infinite loop when we
restart historyserver and replaying event logs of spark apps. you can see the
jstack log in attachments of SPARK
Github user zenglinxi0615 commented on the issue:
https://github.com/apache/spark/pull/18430
@jerryshao do you mean that after fileToAppInfo.get(entry.getPath()) return
a value, other threads may add or change the value of entry.getPath(), which
cause an inconsistent issue
Github user zenglinxi0615 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18430#discussion_r124271386
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -321,7 +322,7 @@ private[history] class
GitHub user zenglinxi0615 opened a pull request:
https://github.com/apache/spark/pull/18430
[SPARK-21223]:Thread-safety issue in FsHistoryProvider
## What changes were proposed in this pull request?
fix the Thread-safety issue in FsHistoryProvider
Currently, Spark
Github user zenglinxi0615 commented on a diff in the pull request:
https://github.com/apache/spark/pull/14085#discussion_r122620464
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/commands.scala ---
@@ -113,8 +113,9 @@ case class AddFile(path: String) extends
Github user zenglinxi0615 closed the pull request at:
https://github.com/apache/spark/pull/17550
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user zenglinxi0615 commented on the issue:
https://github.com/apache/spark/pull/17550
okï¼going to close this PR and open a new PR using the master branch.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
GitHub user zenglinxi0615 opened a pull request:
https://github.com/apache/spark/pull/17550
[SPARK-20240][SQL] SparkSQL support limitations of max dynamic partitâ¦
â¦ions when inserting hive table
## What changes were proposed in this pull request?
support limitations
Github user zenglinxi0615 commented on the issue:
https://github.com/apache/spark/pull/14686
sorry for long time no response.
yes, you are right, when you can change the sql from using '/temp/test.py'
to using 'python /temp/test.py', there's no need for changing the spark source
Github user zenglinxi0615 commented on the issue:
https://github.com/apache/spark/pull/14686
Have you tried it on spark 1.6.2?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
GitHub user zenglinxi0615 opened a pull request:
https://github.com/apache/spark/pull/14686
[SPARK-16253][SQL] make spark sql compatible with hive sql that usingâ¦
## What changes were proposed in this pull request?
make spark sql compatible with hive sql that using python
Github user zenglinxi0615 commented on a diff in the pull request:
https://github.com/apache/spark/pull/14085#discussion_r69865365
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/commands.scala ---
@@ -113,8 +113,9 @@ case class AddFile(path: String) extends
Github user zenglinxi0615 commented on a diff in the pull request:
https://github.com/apache/spark/pull/14085#discussion_r69864435
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/commands.scala ---
@@ -113,8 +113,9 @@ case class AddFile(path: String) extends
GitHub user zenglinxi0615 opened a pull request:
https://github.com/apache/spark/pull/14085
[SPARK-16408][SQL] SparkSQL Added file get Exception: is a directory â¦
## What changes were proposed in this pull request?
This PR is for adding an parameter (spark.input.dir.recursive
17 matches
Mail list logo
