[GitHub] spark issue #19789: [SPARK-22562][Streaming] CachedKafkaConsumer unsafe evic...

Github user daroo commented on the issue: https://github.com/apache/spark/pull/19789 It seems that your "magic spell" didn't work. No build was triggered --- - To unsubscribe, e-mail:

[GitHub] spark pull request #19747: [Spark-22431][SQL] Ensure that the datatype in th...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19747#discussion_r152734937 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -895,6 +898,19 @@ private[hive] object HiveClientImpl {

[GitHub] spark pull request #19747: [Spark-22431][SQL] Ensure that the datatype in th...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19747#discussion_r152734026 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -174,6 +174,87 @@ class HiveCatalogedDDLSuite extends

[GitHub] spark pull request #19747: [Spark-22431][SQL] Ensure that the datatype in th...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19747#discussion_r152734005 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -174,6 +174,87 @@ class HiveCatalogedDDLSuite extends

[GitHub] spark issue #19518: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

Github user viirya commented on the issue: https://github.com/apache/spark/pull/19518 I'd prefer inner class approach. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous ...

Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19788 @yucai would you mind adding more explanations to your PR description? --- - To unsubscribe, e-mail:

[GitHub] spark pull request #18692: [SPARK-21417][SQL] Infer join conditions using pr...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18692#discussion_r152725251 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -152,3 +152,71 @@ object EliminateOuterJoin extends

[GitHub] spark issue #19797: [SPARK-22570][SQL] Avoid to create a lot of global varia...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19797 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19797: [SPARK-22570][SQL] Avoid to create a lot of global varia...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19797 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84124/ Test FAILed. ---

[GitHub] spark issue #19797: [SPARK-22570][SQL] Avoid to create a lot of global varia...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19797 **[Test build #84124 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84124/testReport)** for PR 19797 at commit

[GitHub] spark pull request #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19370 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on Window...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19370 Seems there is a conflict while backporting to branch-2.2. @jsnowacki, mind opening a backporting PR to branch-2.2 please? I think this is important for many Windows users and I guess

[GitHub] spark issue #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on Window...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19370 Merged to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19797: [SPARK-22570][SQL] Avoid to create a lot of globa...

Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/19797#discussion_r152719853 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -799,9 +799,11 @@ case class Cast(child: Expression,

[GitHub] spark pull request #19797: [SPARK-22570][SQL] Avoid to create a lot of globa...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19797#discussion_r152719657 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -87,35 +87,41 @@ private [sql] object

[GitHub] spark pull request #19797: [SPARK-22570][SQL] Avoid to create a lot of globa...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19797#discussion_r152719475 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -799,9 +799,11 @@ case class Cast(child: Expression,

[GitHub] spark pull request #19797: [SPARK-22570][SQL] Avoid to create a lot of globa...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19797#discussion_r152719412 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -799,9 +799,11 @@ case class Cast(child: Expression,

[GitHub] spark issue #19757: [SPARK-22529] [SQL] Relation stats should be consistent ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19757 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84123/ Test FAILed. ---

[GitHub] spark issue #19757: [SPARK-22529] [SQL] Relation stats should be consistent ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19757 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19757: [SPARK-22529] [SQL] Relation stats should be consistent ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19757 **[Test build #84123 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84123/testReport)** for PR 19757 at commit

[GitHub] spark pull request #19621: [SPARK-11215][ML] Add multiple columns support to...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19621#discussion_r152717925 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/StringIndexer.scala --- @@ -130,21 +160,49 @@ class StringIndexer @Since("1.4.0") (

[GitHub] spark pull request #19621: [SPARK-11215][ML] Add multiple columns support to...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/19621#discussion_r152717985 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/StringIndexer.scala --- @@ -130,21 +160,49 @@ class StringIndexer @Since("1.4.0") (

[GitHub] spark issue #19518: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19518 @bdrillard @cloud-fan @maropu I created and run a benchmark program. I think that to use an array for a compaction is slower than to use scalar instance variables. In the following my case, 20%

[GitHub] spark issue #19746: [SPARK-22346][ML] VectorSizeHint Transformer for using V...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19746 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84122/ Test FAILed. ---

[GitHub] spark issue #19746: [SPARK-22346][ML] VectorSizeHint Transformer for using V...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19746 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19746: [SPARK-22346][ML] VectorSizeHint Transformer for using V...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19746 **[Test build #84122 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84122/testReport)** for PR 19746 at commit

[GitHub] spark pull request #19780: [SPARK-22551][SQL] Prevent possible 64kb compile ...

Github user viirya closed the pull request at: https://github.com/apache/spark/pull/19780 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19780: [SPARK-22551][SQL] Prevent possible 64kb compile error f...

Github user viirya commented on the issue: https://github.com/apache/spark/pull/19780 I can't reproduce the issue after #19767 is merged. Hopefully it solves this issue too, so I will close this. If not and I can reproduce it later, I will re-open this. ---

[GitHub] spark issue #19795: [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Backport PR...

Github user vinodkc commented on the issue: https://github.com/apache/spark/pull/19795 Thank you --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19795: [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Back...

Github user vinodkc closed the pull request at: https://github.com/apache/spark/pull/19795 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19756: [SPARK-22527][SQL] Reuse coordinated exchanges if possib...

Github user viirya commented on the issue: https://github.com/apache/spark/pull/19756 My first thought is also to fix `Exchange.sameResult`. But I realize soon that it is not a right fix. The reason is, the results of coordinated exchanges are dependent with all exchanges coordinated

[GitHub] spark issue #19717: [SPARK-18278] [Submission] Spark on Kubernetes - basic s...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19717 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84121/ Test PASSed. ---

[GitHub] spark issue #19717: [SPARK-18278] [Submission] Spark on Kubernetes - basic s...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19717 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19717: [SPARK-18278] [Submission] Spark on Kubernetes - basic s...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19717 **[Test build #84121 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84121/testReport)** for PR 19717 at commit

[GitHub] spark issue #19621: [SPARK-11215][ML] Add multiple columns support to String...

Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/19621 @MLnick Ah, I don't express it exactly, the first case, what I mean is, sort by frequency, but if the case frequency equal, sort by alphabet. ---

[GitHub] spark issue #19797: [SPARK-22570][SQL] Avoid to create a lot of global varia...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19797 **[Test build #84124 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84124/testReport)** for PR 19797 at commit

[GitHub] spark issue #19792: [SPARK-22566][PYTHON] Better error message for `_merge_t...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19792 @gberger, BTW, just to be clear, IIRC the type inference and merging code path here are shared for other data types, for example, dict, namedtuple, row and etc. ---

[GitHub] spark pull request #19797: [SPARK-22570][SQL] Avoid to create a lot of globa...

Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/19797#discussion_r152712011 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -851,9 +855,11 @@ case class Cast(child: Expression,

[GitHub] spark issue #19757: [SPARK-22529] [SQL] Relation stats should be consistent ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19757 **[Test build #84123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84123/testReport)** for PR 19757 at commit

[GitHub] spark issue #19792: [SPARK-22566][PYTHON] Better error message for `_merge_t...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19792 Thanks @ueshin. Yup, +1 for adding some tests. I just wonder if we could have a similar form of error message in type verification. I remember I fixed a similar issue for type

[GitHub] spark issue #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on Window...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19370 Build started: [SparkR] `ALL`

[GitHub] spark issue #19798: [SPARK-22583] First delegation token renewal time is not...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19798 **[Test build #3990 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3990/testReport)** for PR 19798 at commit

[GitHub] spark issue #19798: [SPARK-22583] First delegation token renewal time is not...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19798 **[Test build #3990 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3990/testReport)** for PR 19798 at commit

[GitHub] spark issue #19798: [SPARK-22583] First delegation token renewal time is not...

Github user ArtRand commented on the issue: https://github.com/apache/spark/pull/19798 @kalvinnchau thanks for catching this mistake. @vanzin can we get a quick merge? --- - To unsubscribe, e-mail:

[GitHub] spark pull request #19439: [SPARK-21866][ML][PySpark] Adding spark image rea...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19439 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on Window...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19370 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on Window...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19370 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84119/ Test PASSed. ---

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/19439 Merging with master This is awesome to get in---thanks a lot @imatiach-msft and everyone who contributed and reviewed!! ---

[GitHub] spark issue #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on Window...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19370 **[Test build #84119 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84119/testReport)** for PR 19370 at commit

[GitHub] spark pull request #19763: [SPARK-22537][core] Aggregation of map output sta...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/19763#discussion_r152702214 --- Diff: core/src/main/scala/org/apache/spark/MapOutputTracker.scala --- @@ -472,15 +475,66 @@ private[spark] class MapOutputTrackerMaster(

[GitHub] spark pull request #19588: [SPARK-12375][ML] VectorIndexerModel support hand...

Github user MrBago commented on a diff in the pull request: https://github.com/apache/spark/pull/19588#discussion_r152701758 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/VectorIndexer.scala --- @@ -311,22 +342,39 @@ class VectorIndexerModel private[ml] ( //

[GitHub] spark issue #19763: [SPARK-22537][core] Aggregation of map output statistics...

Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/19763 > We can shut down the pool after some certain idle time, but not sure if it's worth the complexity Yeah, that's just what the cached thread pool does :) ---

[GitHub] spark issue #19763: [SPARK-22537][core] Aggregation of map output statistics...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19763 OK to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19651: [SPARK-20682][SPARK-15474][SPARK-21791] Add new O...

Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/19651#discussion_r152699261 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcDeserializer.scala --- @@ -0,0 +1,226 @@ +/* + *

[GitHub] spark pull request #19651: [SPARK-20682][SPARK-15474][SPARK-21791] Add new O...

Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/19651#discussion_r152699116 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcDeserializer.scala --- @@ -0,0 +1,216 @@ +/* + *

[GitHub] spark pull request #19763: [SPARK-22537][core] Aggregation of map output sta...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/19763#discussion_r152693924 --- Diff: core/src/main/scala/org/apache/spark/MapOutputTracker.scala --- @@ -472,15 +475,66 @@ private[spark] class MapOutputTrackerMaster(

[GitHub] spark pull request #19763: [SPARK-22537][core] Aggregation of map output sta...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/19763#discussion_r152693851 --- Diff: core/src/main/scala/org/apache/spark/MapOutputTracker.scala --- @@ -472,15 +475,66 @@ private[spark] class MapOutputTrackerMaster(

[GitHub] spark issue #19746: [SPARK-22346][ML] VectorSizeHint Transformer for using V...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19746 **[Test build #84122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84122/testReport)** for PR 19746 at commit

[GitHub] spark issue #19746: [SPARK-22346][ML] VectorSizeHint Transformer for using V...

Github user MrBago commented on the issue: https://github.com/apache/spark/pull/19746 jenkins retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19439 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19439 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84118/ Test PASSed. ---

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19439 **[Test build #84118 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84118/testReport)** for PR 19439 at commit

[GitHub] spark issue #19717: [SPARK-18278] [Submission] Spark on Kubernetes - basic s...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19717 **[Test build #84121 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84121/testReport)** for PR 19717 at commit

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19439 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84117/ Test PASSed. ---

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19439 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19439 **[Test build #84117 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84117/testReport)** for PR 19439 at commit

[GitHub] spark issue #19717: [SPARK-18278] [Submission] Spark on Kubernetes - basic s...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19717 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19717: [SPARK-18278] [Submission] Spark on Kubernetes - basic s...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19717 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84120/ Test FAILed. ---

[GitHub] spark issue #19717: [SPARK-18278] [Submission] Spark on Kubernetes - basic s...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19717 **[Test build #84120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84120/testReport)** for PR 19717 at commit

[GitHub] spark issue #19717: [SPARK-18278] [Submission] Spark on Kubernetes - basic s...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19717 **[Test build #84120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84120/testReport)** for PR 19717 at commit

[GitHub] spark issue #19468: [SPARK-18278] [Scheduler] Spark on Kubernetes - Basic Sc...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19468 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84116/ Test PASSed. ---

[GitHub] spark issue #19468: [SPARK-18278] [Scheduler] Spark on Kubernetes - Basic Sc...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19468 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19468: [SPARK-18278] [Scheduler] Spark on Kubernetes - Basic Sc...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19468 **[Test build #84116 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84116/testReport)** for PR 19468 at commit

[GitHub] spark issue #19468: [SPARK-18278] [Scheduler] Spark on Kubernetes - Basic Sc...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19468 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19468: [SPARK-18278] [Scheduler] Spark on Kubernetes - Basic Sc...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19468 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84114/ Test PASSed. ---

[GitHub] spark issue #19468: [SPARK-18278] [Scheduler] Spark on Kubernetes - Basic Sc...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19468 **[Test build #84114 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84114/testReport)** for PR 19468 at commit

[GitHub] spark issue #19789: [SPARK-22562][Streaming] CachedKafkaConsumer unsafe evic...

Github user koeninger commented on the issue: https://github.com/apache/spark/pull/19789 ok to test On Wed, Nov 22, 2017 at 2:49 PM, Daroo wrote: > Cool. Could you please authorize it for testing? > > — > You are receiving this

[GitHub] spark issue #19789: [SPARK-22562][Streaming] CachedKafkaConsumer unsafe evic...

Github user daroo commented on the issue: https://github.com/apache/spark/pull/19789 Cool. Could you please authorize it for testing? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on Window...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19370 **[Test build #84119 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84119/testReport)** for PR 19370 at commit

[GitHub] spark issue #19370: [SPARK-22495] Fix setup of SPARK_HOME variable on Window...

Github user jsnowacki commented on the issue: https://github.com/apache/spark/pull/19370 Thanks for looking into it again. I've followed your suggestions and updated PR. It also seems to work for me now. --- - To

[GitHub] spark issue #19789: [SPARK-22562][Streaming] CachedKafkaConsumer unsafe evic...

Github user koeninger commented on the issue: https://github.com/apache/spark/pull/19789 Seems reasonable. On Wed, Nov 22, 2017 at 1:52 PM, Daroo wrote: > It fails on the current master branch and doesn't after the patch > > —

[GitHub] spark issue #19390: [SPARK-18935][MESOS] Fix dynamic reservations on mesos

Github user ArtRand commented on the issue: https://github.com/apache/spark/pull/19390 Just to reiterate our conversation here. The `AllocationInfo` tells the scheduler which `role`’s allocation of resources the `Offer` is coming from, whereas the `ReservationInfo` tells

[GitHub] spark pull request #19797: [SPARK-22570][SQL] Avoid to create a lot of globa...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19797#discussion_r152664308 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -851,9 +855,11 @@ case class Cast(child: Expression,

[GitHub] spark issue #19789: [SPARK-22562][Streaming] CachedKafkaConsumer unsafe evic...

Github user daroo commented on the issue: https://github.com/apache/spark/pull/19789 It fails on the current master branch and doesn't after the patch --- - To unsubscribe, e-mail:

[GitHub] spark issue #19789: [SPARK-22562][Streaming] CachedKafkaConsumer unsafe evic...

Github user koeninger commented on the issue: https://github.com/apache/spark/pull/19789 What are you actually asserting in that test and/or does it reliably fail if run on the version of your code before the patch? On Wed, Nov 22, 2017 at 1:33 PM, Daroo

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/19439 Thanks! LGTM pending tests --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #18692: [SPARK-21417][SQL] Infer join conditions using pr...

Github user aokolnychyi commented on a diff in the pull request: https://github.com/apache/spark/pull/18692#discussion_r152660385 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -152,3 +152,71 @@ object EliminateOuterJoin extends

[GitHub] spark issue #19789: [SPARK-22562][Streaming] CachedKafkaConsumer unsafe evic...

Github user daroo commented on the issue: https://github.com/apache/spark/pull/19789 I've added a test. @koeninger is it something you had in mind? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #19468: [SPARK-18278] [Scheduler] Spark on Kubernetes - Basic Sc...

Github user erikerlandson commented on the issue: https://github.com/apache/spark/pull/19468 @reviewers, just as a PSA we have to rebase the second PR (containing the submission client) _after_ this one merges, and then we can submit the second one against this upstream. This is a

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19439 **[Test build #84118 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84118/testReport)** for PR 19439 at commit

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/19439 @jkbradley good catch - I added the missing link to the license file and I rebased the code against the very very latest master. Thanks! ---

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19439 **[Test build #84117 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84117/testReport)** for PR 19439 at commit

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/19439 good catch, it's from here: https://ccsearch.creativecommons.org/image/detail/B2CVP_j5KjwZm7UAVJ3Hvw== let me add it to the list ---

[GitHub] spark pull request #19607: [SPARK-22395][SQL][PYTHON] Fix the behavior of ti...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19607#discussion_r152646370 --- Diff: python/setup.py --- @@ -201,7 +201,7 @@ def _supports_symlinks(): extras_require={ 'ml': ['numpy>=1.7'],

[GitHub] spark pull request #19607: [SPARK-22395][SQL][PYTHON] Fix the behavior of ti...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19607#discussion_r152645369 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -997,6 +997,14 @@ object SQLConf { .intConf

[GitHub] spark issue #19798: [SPARK-22583] First delegation token renewal time is not...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19798 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19798: [SPARK-22583] First delegation token renewal time...

GitHub user kalvinnchau opened a pull request: https://github.com/apache/spark/pull/19798 [SPARK-22583] First delegation token renewal time is not 75% of renewal time in Mesos The first scheduled renewal time is is set to the exact expiration time, and all subsequent renewal

[GitHub] spark pull request #19752: [SPARK-22520][SQL] Support code generation for la...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19752#discussion_r152643842 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -211,111 +231,61 @@ abstract class

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/19439 I just noticed: Where is data/mllib/images/kittens/DP153539.jpg from? (It's missing in the license list.) --- - To

[GitHub] spark issue #19797: [SPARK-22570][SQL] Avoid to create a lot of global varia...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19797 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84115/ Test FAILed. ---

  1   2   3   >