[GitHub] spark issue #18721: [SPARK-21516][SQL][Test] Overriding afterEach() in Datas...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18721 **[Test build #79899 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79899/testReport)** for PR 18721 at commit

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

Github user LantaoJin commented on the issue: https://github.com/apache/spark/pull/17953 @HyukjinKwon Sure. Thank you for reminding me. I almost forgot it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #18719: [SPARK-21512][SQL][TEST] DatasetCacheSuite needs ...

Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18719#discussion_r128953394 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetCacheSuite.scala --- @@ -25,6 +25,11 @@ import org.apache.spark.storage.StorageLevel class

[GitHub] spark pull request #18721: [SPARK-21516][SQL][Test] Overriding afterEach() i...

GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/18721 [SPARK-21516][SQL][Test] Overriding afterEach() in DatasetCacheSuite must call super.afterEach() ## What changes were proposed in this pull request? This PR ensures to call

[GitHub] spark issue #18711: [SPARK-21506][DOC]The description of "spark.executor.cor...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18711 **[Test build #79898 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79898/testReport)** for PR 18711 at commit

[GitHub] spark pull request #18711: [SPARK-21506][DOC]The description of "spark.execu...

Github user 10110346 commented on a diff in the pull request: https://github.com/apache/spark/pull/18711#discussion_r128952895 --- Diff: docs/configuration.md --- @@ -1106,7 +1106,7 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #18684: [SPARK-21475][Core] Use NIO's Files API to replace FileI...

Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18684 @srowen any further comment? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18649: [SPARK-21395][SQL] Spark SQL hive-thriftserver doesn't r...

Github user debugger87 commented on the issue: https://github.com/apache/spark/pull/18649 @cloud-fan @srowen If we can't find maintainer of hive-thriftserver in Spark, I may have to close this PR in few days later. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #18708: [SPARK-21339] [CORE] spark-shell --packages option does ...

Github user devaraj-kavali commented on the issue: https://github.com/apache/spark/pull/18708 Thanks @HyukjinKwon for checking this and for the link. > Are you saying "file:///C:/Users//.ivy2/jars/.jar" is not the correct form of URI on Windows? This URI form is

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

Github user ueshin commented on the issue: https://github.com/apache/spark/pull/18664 In my opinion, we should definitely specify the timezone to keep the correct timestamp. I'm not sure which is the suitable one yet, but the candidates would be: 1. `"UTC"` Spark SQL

[GitHub] spark issue #18711: [SPARK-21506][DOC]The description of "spark.executor.cor...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18711 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18711: [SPARK-21506][DOC]The description of "spark.executor.cor...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18711 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79895/ Test PASSed. ---

[GitHub] spark issue #18071: [SPARK-20855][Docs][DStream] Update the Spark kinesis do...

Github user yssharma commented on the issue: https://github.com/apache/spark/pull/18071 I noticed that now. Yes I will post an updated patch today. Thanks @HyukjinKwon --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #18711: [SPARK-21506][DOC]The description of "spark.executor.cor...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18711 **[Test build #79895 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79895/testReport)** for PR 18711 at commit

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18709 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18709 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79896/ Test PASSed. ---

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18709 **[Test build #79896 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79896/testReport)** for PR 18709 at commit

[GitHub] spark issue #18687: [SPARK-21484][SQL] Fix inconsistent query plans of Datas...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18687 This really depends on how you implement the global statement cache and management. All the compiled plans can be stored in the cache. The plans can be reused, if possible (the reused plans

[GitHub] spark issue #18612: [SPARK-21388][ML][PySpark] GBTs inherit from HasStepSize...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18612 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18612: [SPARK-21388][ML][PySpark] GBTs inherit from HasStepSize...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18612 **[Test build #79897 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79897/testReport)** for PR 18612 at commit

[GitHub] spark issue #18093: [WIP][SPARK-20774][SQL] Cancel all jobs when QueryExecti...

Github user liyichao commented on the issue: https://github.com/apache/spark/pull/18093 Sorry about that, I will test it when I have time. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #18612: [SPARK-21388][ML][PySpark] GBTs inherit from HasStepSize...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18612 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79897/ Test PASSed. ---

[GitHub] spark pull request #18540: [SPARK-19451][SQL] rangeBetween method should acc...

Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/18540#discussion_r128947347 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala --- @@ -106,173 +101,167 @@ case class

[GitHub] spark issue #18071: [SPARK-20855][Docs][DStream] Update the Spark kinesis do...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18071 It looks the last test was failed by style checking. Would you have some time to fix them up? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18071: [SPARK-20855][WIP][DStream] Update the Spark kinesis doc...

Github user yssharma commented on the issue: https://github.com/apache/spark/pull/18071 @HyukjinKwon The PR is ready. Just waiting for some 👍 from the reviewers. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18250: [SPARK-21024][SQL] CSV parse mode handles Univocity pars...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/18250 I think we could be back if we have better way to handle this, so I'll close this for now (we better keeping this discussion in jira). --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #18250: [SPARK-21024][SQL] CSV parse mode handles Univoci...

Github user maropu closed the pull request at: https://github.com/apache/spark/pull/18250 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #18711: [SPARK-21506][DOC]The description of "spark.execu...

Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/18711#discussion_r128945012 --- Diff: docs/configuration.md --- @@ -1106,7 +1106,7 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark pull request #18711: [SPARK-21506][DOC]The description of "spark.execu...

Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/18711#discussion_r128945886 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -580,7 +580,8 @@ private[deploy] class Master( * The number of

[GitHub] spark pull request #18711: [SPARK-21506][DOC]The description of "spark.execu...

Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/18711#discussion_r128943527 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -580,7 +580,8 @@ private[deploy] class Master( * The number of

[GitHub] spark issue #13320: [SPARK-13184][SQL] Add a datasource-specific option minP...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/13320 No, so I'll close this for now and we move this discussion to jira. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #13320: [SPARK-13184][SQL] Add a datasource-specific opti...

Github user maropu closed the pull request at: https://github.com/apache/spark/pull/13320 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17882: [WIP][SPARK-20079][yarn] Re registration of AM hangs spa...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17882 Thank you @jerryshao. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18154: [SPARK-20932][ML]CountVectorizer support handle persiste...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18154 I don't know ML as much as reviewing this. I just wanted to be sure if it is in progress in any way. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #16577: [SPARK-19214][SQL] Typed aggregate count output field na...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16577 @aray WDYT on ^? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16445: [SPARK-19043][SQL]Make SparkSQLSessionManager more confi...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16445 Hi @yaooqinn, is this PR active? if so, would you address or answer to the review comments above? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #18093: [SPARK-20774][SQL] Cancel all jobs when QueryExection th...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18093 I think a patch should at least be manually tested @liyichao. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #18071: [SPARK-20855][WIP][DStream] Update the Spark kinesis doc...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18071 Hi @yssharma, is it still WIP? I think we should make the PR on the mergable state at least. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #17882: [WIP][SPARK-20079][yarn] Re registration of AM hangs spa...

Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/17882 I think this could be closed, @vanzin already created a new PR based on this (#18663). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #18127: [SPARK-6628][SQL][Branch-2.1] Fix ClassCastException whe...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18127 Hi @weiqingy, I just wonder if it is in progress in any way. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #13706: [SPARK-15988] [SQL] Implement DDL commands: Create/Drop ...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13706 @gatorsmile, I just wonder if it is ready to proceed further this PR. It looks the PR you linked is merged properly. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #17371: [SPARK-19903][PYSPARK][SS] window operator miss the `wat...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17371 gentle ping @uncleGen, is this PR still active? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14601: [SPARK-13979][Core] Killed executor is re spawned withou...

Github user agsachin commented on the issue: https://github.com/apache/spark/pull/14601 Thanks @jiangxb2987 will add this test case by tomorrow and will be update the pr with results --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18154: [SPARK-20932][ML]CountVectorizer support handle persiste...

Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/18154 @hhbyyh @HyukjinKwon Sorry to reply late. I think it may be better to use a special logic if it is more efficient in performance. What is your opinion? @yanboliang @HyukjinKwon

[GitHub] spark issue #18242: Modify JavaModelSelectionViaCrossValidationExample

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18242 ping @arsinux --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17953 @LantaoJin do you have some time to address the review comment above? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17979: [SPARK-19320][MESOS][WIP]allow specifying a hard limit o...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17979 @yanji84, is this PR active? if so, would you answer to the question above? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #17180: [SPARK-19839][Core]release longArray in BytesToBytesMap

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17180 Hi @zhzhan is this PR active? if so, would you answer or address the review comment? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #13320: [SPARK-13184][SQL] Add a datasource-specific option minP...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13320 @maropu, I just wonder if it is in progress in any way. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16365: [SPARK-18950][SQL] Report conflicting fields when mergin...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16365 ping @bravo-zhang for adding the test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18154: [SPARK-20932][ML]CountVectorizer support handle persiste...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18154 @zhengruifeng Would you answer or address the review comments above? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #18717: [SPARK-21510] [SQL] Add isMaterialized() and eage...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18717#discussion_r128944222 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2739,6 +2752,26 @@ class Dataset[T] private[sql]( } /**

[GitHub] spark issue #12147: [SPARK-14361][SQL]Window function exclude clause

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/12147 Gentle ping @xwu0226, how is the update going? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17882: [WIP][SPARK-20079][yarn] Re registration of AM hangs spa...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17882 gentle ping @witgo for review comments above. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18612: [SPARK-21388][ML][PySpark] GBTs inherit from HasStepSize...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18612 **[Test build #79897 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79897/testReport)** for PR 18612 at commit

[GitHub] spark issue #11205: [SPARK-11334][Core] Handle maximum task failure situatio...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/11205 gentle ping @rustagi --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16766: [SPARK-19426][SQL] Custom coalesce for Dataset

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16766 Hi @mariusvniekerk, would you be able to fix the javadoc errors? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14239: [SPARK-16593] [CORE] [WIP] Provide a pre-fetch mechanism...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14239 Is it @f7753 ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14158 @HyukjinKwon It's still active. I'll fix it when I'm available. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14085: [SPARK-16408][SQL] SparkSQL Added file get Exception: is...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14085 @zenglinxi0615 Could you answer to the question above if you are active? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18328: [SPARK-21121][SQL] Support changing storage level via th...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18328 @dosoft Is this PR active? then would you mind if I ask to reply to the review comment above? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #18717: [SPARK-21510] [SQL] Add isMaterialized() and eage...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18717#discussion_r128943409 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2739,6 +2752,26 @@ class Dataset[T] private[sql]( } /**

[GitHub] spark issue #17530: [SPARK-5158] Access kerberized HDFS from Spark standalon...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17530 gentle ping @themodernlife on ^. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11494: [SPARK-10399][CORE][SQL] Introduce OffHeapMemoryBlock to...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/11494 gentle ping @yzotov. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14158 gentle ping @nblintao, is this PR active? If so, I guess the test failure should be fixed if related. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #18651: [SPARK-21383][Core] Fix the YarnAllocator allocat...

Github user djvulee commented on a diff in the pull request: https://github.com/apache/spark/pull/18651#discussion_r128943316 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -525,9 +534,11 @@ private[yarn] class

[GitHub] spark issue #15227: [SPARK-17655][SQL]Remove unused variables declarations a...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15227 gentle ping @yaooqinn on ^. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18269: [SPARK-21056][SQL] Use at most one spark job to list fil...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18269 gentle ping @bbossy, I just want to be sure if it is in progress in any way. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #14601: [SPARK-13979][Core] Killed executor is re spawned withou...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14601 gentle ping @agsachin. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18711: [SPARK-21506][DOC]The description of "spark.executor.cor...

Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18711 yea, I understand the issue now. Thank you for clarify! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #18717: [SPARK-21510] [SQL] Add isMaterialized() and eage...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18717#discussion_r128942266 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetCacheSuite.scala --- @@ -25,9 +25,22 @@ import org.apache.spark.storage.StorageLevel

[GitHub] spark issue #18250: [SPARK-21024][SQL] CSV parse mode handles Univocity pars...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/18250 ok, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #17519: [SPARK-15352][Doc] follow-up: add configuration docs for...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17519 Hi @lins05, is this PR active? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18354: [SPARK-18016][SQL][CATALYST][BRANCH-2.1] Code Generation...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18354 @bdrillard, sounds properly backported. Would you close this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #18687: [SPARK-21484][SQL] Fix inconsistent query plans of Datas...

Github user viirya commented on the issue: https://github.com/apache/spark/pull/18687 cc @cloud-fan Can you help review this too? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18383: [SPARK-21167][SS] Set kafka clientId while fetch message...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18383 gentle ping @dijingran. I want to be sure if it is in progress in any way. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #18250: [SPARK-21024][SQL] CSV parse mode handles Univocity pars...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18250 I am sorry @maropu. I can't think of a good way to handle this for now ... Will be back after thinking more maybe .. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #18668: [SPARK-21451][SQL]get `spark.hadoop.*` properties from s...

Github user yaooqinn commented on the issue: https://github.com/apache/spark/pull/18668 ping @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18687: [SPARK-21484][SQL][WIP] Fix inconsistent query plans of ...

Github user viirya commented on the issue: https://github.com/apache/spark/pull/18687 > So far, we do not support dynamic SQL statement, but this is a potential feature we can explore in the future. A global statement cache and management can reduce the optimization costs, especially

[GitHub] spark issue #17096: [SPARK-15243][ML][SQL][PYTHON] Add missing support for u...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17096 gentle ping ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16611: [SPARK-17967][SPARK-17878][SQL][PYTHON] Support for arra...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16611 gentle ping ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18592: [SPARK-21368][SQL] TPCDSQueryBenchmark can't refer query...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/18592 @gatorsmile Could we merge this first? I feel we could discuss more on jira? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18304 Would you mind if I ask to wait the resolution of `https://github.com/apache/spark/pull/18581` ? Strictly, they are orthogonal as that PR tries to not change the default line separator but I

[GitHub] spark issue #18711: [SPARK-21506][DOC]The description of "spark.executor.cor...

Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/18711 If the other application is finished, it will release cores --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #18713: [SPARK-21509][SQL] Add a config to enable adaptive query...

Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/18713 cc @cloud-fan @jiangxb1987 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18711: [SPARK-21506][DOC]The description of "spark.executor.cor...

Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18711 How can we wait for new free cores on the same worker, if we only start one executor for each worker initially? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #18687: [SPARK-21484][SQL][WIP] Fix inconsistent query plans of ...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18687 So far, we do not support dynamic SQL statement, but this is a potential feature we can explore in the future. A global statement cache and management can reduce the optimization costs,

[GitHub] spark issue #18719: [SPARK-21512][SQL][TEST] DatasetCacheSuite needs to exec...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18719 good catch, i will create a follow-up PR today. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18709 **[Test build #79896 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79896/testReport)** for PR 18709 at commit

[GitHub] spark issue #18711: [SPARK-21506][DOC]The description of "spark.executor.cor...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18711 **[Test build #79895 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79895/testReport)** for PR 18711 at commit

[GitHub] spark pull request #18719: [SPARK-21512][SQL][TEST] DatasetCacheSuite needs ...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18719#discussion_r128937203 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetCacheSuite.scala --- @@ -25,6 +25,11 @@ import org.apache.spark.storage.StorageLevel

[GitHub] spark issue #18711: [SPARK-21506][DOC]The description of "spark.executor.cor...

Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/18711 @jiangxb1987 If `app.coresLeft` is not zero and there is no more free cores left, it is not ending.Waiting for some workers have free cores, this app will be assigned cores continue, and this

[GitHub] spark issue #18687: [SPARK-21484][SQL][WIP] Fix inconsistent query plans of ...

Github user viirya commented on the issue: https://github.com/apache/spark/pull/18687 Do we have dynamic SQL statements? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18714: [SPARK-20236][SQL] hive style partition overwrite

Github user ericl commented on the issue: https://github.com/apache/spark/pull/18714 Got it. On Sun, Jul 23, 2017, 10:40 PM Wenchen Fan wrote: > *@cloud-fan* commented on this pull request. > -- > > In

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18717 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18717 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79894/ Test PASSed. ---

[GitHub] spark issue #18717: [SPARK-21510] [SQL] Add isMaterialized() and eager persi...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18717 **[Test build #79894 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79894/testReport)** for PR 18717 at commit

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18709 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18709 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79893/ Test FAILed. ---

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18709 **[Test build #79893 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79893/testReport)** for PR 18709 at commit

  1   2   3   >