[GitHub] spark issue #21033: [SPARK-19320][MESOS]allow specifying a hard limit on num...

2018-11-13 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/21033 any progress here ? @yanji84 @susanxhuynh --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21033: [SPARK-19320][MESOS]allow specifying a hard limit on num...

2018-11-12 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/21033 @yanji84 How do you identify the gpu if you have multiple gpus on the machine ? It would nice to have some docs

[GitHub] spark issue #14644: [SPARK-14082][MESOS] Enable GPU support with Mesos

2018-11-12 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/14644 We have some servers running 8 GPUs on mesos. I would like to run Spark on it but I need to be able from spark to allocate a GPU only per map phase. On Hadoop 3.0 you can do

[GitHub] spark pull request #19485: [SPARK-20055] [Docs] Added documentation for load...

2017-10-18 Thread jomach
Github user jomach closed the pull request at: https://github.com/apache/spark/pull/19485 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19485: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-18 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19485 @gatorsmile will do --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #19485: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-18 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19485 @gatorsmile: we will have a lot of duplication. Ist that Fine ? I will create a complete new Page like sql programming guide and name it Data sources guide and add all the data sources

[GitHub] spark issue #19485: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-17 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19485 Yes I'm viewing the docs with Jekyll. I addressed that on my previous comment. I really don't think we should make a huge example as the json does. It's a csv ... What do you think

[GitHub] spark issue #19485: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-15 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19485 So I removed the duplicated stuff and added the links. I do it on purpose not to add more example as the document is getting huge and hard to find stuff. What do you think

[GitHub] spark issue #19485: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-14 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19485 Ok so I will do: - Create a new Section for csv-datasets - add more example options on the code fromJavaSQLDataSourceExample.java (.scala .py and .r) - Make reference to the links

[GitHub] spark pull request #7842: [SPARK-8542][MLlib]PMML export for Decision Trees

2017-10-13 Thread jomach
Github user jomach commented on a diff in the pull request: https://github.com/apache/spark/pull/7842#discussion_r144641913 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/pmml/export/PMMLTreeModelUtils.scala --- @@ -0,0 +1,261 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #7842: [SPARK-8542][MLlib]PMML export for Decision Trees

2017-10-13 Thread jomach
Github user jomach commented on a diff in the pull request: https://github.com/apache/spark/pull/7842#discussion_r144642103 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/pmml/export/PMMLTreeModelUtils.scala --- @@ -0,0 +1,261 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #7842: [SPARK-8542][MLlib]PMML export for Decision Trees

2017-10-13 Thread jomach
Github user jomach commented on a diff in the pull request: https://github.com/apache/spark/pull/7842#discussion_r144642031 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/pmml/export/PMMLTreeModelUtils.scala --- @@ -0,0 +1,261 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #7842: [SPARK-8542][MLlib]PMML export for Decision Trees

2017-10-13 Thread jomach
Github user jomach commented on a diff in the pull request: https://github.com/apache/spark/pull/7842#discussion_r144642055 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/pmml/export/PMMLTreeModelUtils.scala --- @@ -0,0 +1,261 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #19485: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-13 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19485 @HyukjinKwon I came up with this. What do you think ? What I don't like on it is that I did not find anyway to read Javadocs into the markdown so that we don't have duplicates. Any ideia or should

[GitHub] spark issue #19485: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-12 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19485 Yes I will do it. give me some days please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19485: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-12 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19485 @HyukjinKwon Here is the enter as the other is closed / merged --- - To unsubscribe, e-mail: reviews-unsubscr

[GitHub] spark pull request #19485: [SPARK-20055] [Docs] Added documentation for load...

2017-10-12 Thread jomach
GitHub user jomach opened a pull request: https://github.com/apache/spark/pull/19485 [SPARK-20055] [Docs] Added documentation for loading csv files into DataFrames Fix ## What changes were proposed in this pull request? Small rendering fix ## How was this patch

[GitHub] spark pull request #19429: [SPARK-20055] [Docs] Added documentation for load...

2017-10-12 Thread jomach
Github user jomach commented on a diff in the pull request: https://github.com/apache/spark/pull/19429#discussion_r144321507 --- Diff: docs/sql-programming-guide.md --- @@ -479,6 +481,26 @@ source type can be converted into other types using this syntax

[GitHub] spark issue #19429: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-11 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19429 @gatorsmile pr comments fixed. The problem with the actual docs is that people wen start with spark usually don't start with JSON files but with CSV files to "see"

[GitHub] spark issue #19429: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-11 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19429 @gatorsmile pr comments fixed. Sorry but is my first time. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #19429: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-09 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19429 @gatorsmile I dressed your comments. Still I cannot use the jekyll build... `SKIP_API=1 jekyll build --incremental Configuration file: /Users/jorge/Downloads/spark/docs/_config.yml

[GitHub] spark issue #19429: [SPARK-20055] [Docs] Added documentation for loading csv...

2017-10-05 Thread jomach
Github user jomach commented on the issue: https://github.com/apache/spark/pull/19429 @felixcheung Sorry for that. Should be there now. Can you test ? thanks --- - To unsubscribe, e-mail: reviews-unsubscr

[GitHub] spark pull request #19429: [SPARK-20055] [Docs] Added documentation for load...

2017-10-04 Thread jomach
GitHub user jomach opened a pull request: https://github.com/apache/spark/pull/19429 [SPARK-20055] [Docs] Added documentation for loading csv files into DataFrames ## What changes were proposed in this pull request? Added documentation for loading csv files