[GitHub] spark pull request #21055: [SPARK-23693][SQL] Functions to generate UUIDs

2018-04-12 Thread tashoyan
GitHub user tashoyan opened a pull request: https://github.com/apache/spark/pull/21055 [SPARK-23693][SQL] Functions to generate UUIDs ## What changes were proposed in this pull request? The following functions are implemented and available in the `functions` object of SQL

[GitHub] spark pull request #20578: [SPARK-23318][ML] FP-growth: WARN FPGrowth: Input...

2018-02-11 Thread tashoyan
Github user tashoyan commented on a diff in the pull request: https://github.com/apache/spark/pull/20578#discussion_r167442376 --- Diff: mllib/src/main/scala/org/apache/spark/ml/fpm/FPGrowth.scala --- @@ -158,18 +159,30 @@ class FPGrowth @Since("

[GitHub] spark pull request #20578: [SPARK-23318][ML] FP-growth: WARN FPGrowth: Input...

2018-02-11 Thread tashoyan
Github user tashoyan commented on a diff in the pull request: https://github.com/apache/spark/pull/20578#discussion_r167441224 --- Diff: mllib/src/main/scala/org/apache/spark/ml/fpm/FPGrowth.scala --- @@ -158,18 +159,30 @@ class FPGrowth @Since("

[GitHub] spark pull request #20578: [SPARK-23318][ML] FP-growth: WARN FPGrowth: Input...

2018-02-11 Thread tashoyan
Github user tashoyan commented on a diff in the pull request: https://github.com/apache/spark/pull/20578#discussion_r167439260 --- Diff: mllib/src/main/scala/org/apache/spark/ml/fpm/FPGrowth.scala --- @@ -158,18 +159,30 @@ class FPGrowth @Since("

[GitHub] spark pull request #20578: [SPARK-23318][ML] FP-growth: WARN FPGrowth: Input...

2018-02-11 Thread tashoyan
GitHub user tashoyan opened a pull request: https://github.com/apache/spark/pull/20578 [SPARK-23318][ML] FP-growth: WARN FPGrowth: Input data is not cached ## What changes were proposed in this pull request? Cache the RDD of items in ml.FPGrowth before passing

[GitHub] spark issue #20349: [Minor][DOC] Fix the path to the examples jar

2018-01-22 Thread tashoyan
Github user tashoyan commented on the issue: https://github.com/apache/spark/pull/20349 @jerryshao Not found yet --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark pull request #20349: Fix the path to the examples jar

2018-01-22 Thread tashoyan
GitHub user tashoyan opened a pull request: https://github.com/apache/spark/pull/20349 Fix the path to the examples jar ## What changes were proposed in this pull request? The example jar file is now in ./examples/jars directory of Spark distribution. You can merge

[GitHub] spark pull request #19711: [SPARK-22471][SQL] SQLListener consumes much memo...

2017-11-14 Thread tashoyan
Github user tashoyan closed the pull request at: https://github.com/apache/spark/pull/19711 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19711: [SPARK-22471][SQL] SQLListener consumes much memory caus...

2017-11-10 Thread tashoyan
Github user tashoyan commented on the issue: https://github.com/apache/spark/pull/19711 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews

[GitHub] spark issue #19711: [SPARK-22471][SQL] SQLListener consumes much memory caus...

2017-11-10 Thread tashoyan
Github user tashoyan commented on the issue: https://github.com/apache/spark/pull/19711 Corrupted build node? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark pull request #19700: [SPARK-22471][SQL] SQLListener consumes much memo...

2017-11-10 Thread tashoyan
Github user tashoyan closed the pull request at: https://github.com/apache/spark/pull/19700 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19700: [SPARK-22471][SQL] SQLListener consumes much memo...

2017-11-09 Thread tashoyan
Github user tashoyan commented on a diff in the pull request: https://github.com/apache/spark/pull/19700#discussion_r150100750 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SQLListener.scala --- @@ -101,6 +101,8 @@ class SQLListener(conf: SparkConf) extends

[GitHub] spark issue #19700: [SPARK-22471][SQL] SQLListener consumes much memory caus...

2017-11-09 Thread tashoyan
Github user tashoyan commented on the issue: https://github.com/apache/spark/pull/19700 Done for branch-2.2: #19711 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark pull request #19711: [SPARK-22471][SQL] SQLListener consumes much memo...

2017-11-09 Thread tashoyan
GitHub user tashoyan opened a pull request: https://github.com/apache/spark/pull/19711 [SPARK-22471][SQL] SQLListener consumes much memory causing OutOfMemoryError ## What changes were proposed in this pull request? This PR addresses the issue [SPARK-22471](https

[GitHub] spark issue #19700: [SPARK-22471][SQL] SQLListener consumes much memory caus...

2017-11-09 Thread tashoyan
Github user tashoyan commented on the issue: https://github.com/apache/spark/pull/19700 Well, it would be good to have this quick fix in a 2.2-compatible bugfix release, without waiting for 2.3.0

[GitHub] spark pull request #19700: [SPARK-22471][SQL] SQLListener consumes much memo...

2017-11-09 Thread tashoyan
Github user tashoyan commented on a diff in the pull request: https://github.com/apache/spark/pull/19700#discussion_r150052324 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SQLListener.scala --- @@ -101,6 +101,8 @@ class SQLListener(conf: SparkConf) extends

[GitHub] spark issue #19700: [SPARK-22471][SQL] SQLListener consumes much memory caus...

2017-11-09 Thread tashoyan
Github user tashoyan commented on the issue: https://github.com/apache/spark/pull/19700 @vanzin would you like to review? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e

[GitHub] spark pull request #19700: [SPARK-22471][SQL] SQLListener consumes much memo...

2017-11-08 Thread tashoyan
GitHub user tashoyan opened a pull request: https://github.com/apache/spark/pull/19700 [SPARK-22471][SQL] SQLListener consumes much memory causing OutOfMemoryError ## What changes were proposed in this pull request? This PR addresses the issue [SPARK-22471](https

[GitHub] spark pull request #18885: [SPARK-21668][CORE] Ability to run driver program...

2017-08-14 Thread tashoyan
Github user tashoyan closed the pull request at: https://github.com/apache/spark/pull/18885 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #18885: [SPARK-21668][CORE] Ability to run driver programs withi...

2017-08-14 Thread tashoyan
Github user tashoyan commented on the issue: https://github.com/apache/spark/pull/18885 So the working configuration is: * set `spark.driver.host` to the IP address of the host machine * set `spark.driver.bindAddress` to the IP address of the container I tried

[GitHub] spark issue #18885: [SPARK-21668][CORE] Ability to run driver programs withi...

2017-08-10 Thread tashoyan
Github user tashoyan commented on the issue: https://github.com/apache/spark/pull/18885 @vanzin @srowen @jerryshao would you you review please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #18885: [SPARK-21668][CORE] Ability to run driver program...

2017-08-08 Thread tashoyan
GitHub user tashoyan opened a pull request: https://github.com/apache/spark/pull/18885 [SPARK-21668][CORE] Ability to run driver programs within a container ## What changes were proposed in this pull request? When running inside a container, driver program provides a driver