[spark] Git Push Summary

[wenchen]

Repository: spark
Updated Tags:  refs/tags/v2.4.0-rc5 [deleted] 075447b39

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

[wenchen]

Repository: spark
Updated Tags:  refs/tags/v2.4.0-rc5 [created] 075447b39

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

[wenchen]

Repository: spark
Updated Tags:  refs/tags/v2.4.0-rc5 [created] 4a7ead480

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[GitHub] spark issue #22888: SPARK-25881

[351zyf]

Github user 351zyf commented on the issue:

https://github.com/apache/spark/pull/22888
  
OK


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #22888: SPARK-25881

[351zyf]

Github user 351zyf closed the pull request at:

https://github.com/apache/spark/pull/22888


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #22860: Branch 2.4

[srowen]

Github user srowen commented on the issue:

https://github.com/apache/spark/pull/22860
  
@sarojchand close this


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #22935: Branch 2.2

[litao1223]

Github user litao1223 closed the pull request at:

https://github.com/apache/spark/pull/22935


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #22935: Branch 2.2

[wangyum]

Github user wangyum commented on the issue:

https://github.com/apache/spark/pull/22935
  
@litao1223 Please close this.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[spark] Git Push Summary

[wenchen]

Repository: spark
Updated Tags:  refs/tags/v2.4.0 [created] 075447b39

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[GitHub] spark pull request #22811: Branch 2.4

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/22811


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #22968: Merge upstream

[justinuang]

Github user justinuang closed the pull request at:

https://github.com/apache/spark/pull/22968


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[spark] Git Push Summary

[wenchen]

Repository: spark
Updated Tags:  refs/tags/v2.4.0-rc3 [created] 8e4a99bd2

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

[jshao]

Repository: spark
Updated Tags:  refs/tags/v2.3.2 [created] 02b510728

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[GitHub] spark pull request #22460: DO NOT MERGE

[squito]

Github user squito closed the pull request at:

https://github.com/apache/spark/pull/22460


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[spark] Git Push Summary

[wenchen]

Repository: spark
Updated Tags:  refs/tags/v2.4.0-rc2 [created] 42f25f309

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

How to unsubscribe???

[Junior Alvarez]

Hi!

I've been sending an unsubscribe mail, to this address: 
user-unsubscr...@spark.apache.org<mailto:user-unsubscr...@spark.apache.org>, 
for the last months, and still...I don't manage to unsubscribe...Why???

B r
/Junior

[GitHub] spark pull request #23198: Branch 2.4

[edurekagithub]

Github user edurekagithub closed the pull request at:

https://github.com/apache/spark/pull/23198


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[spark] Git Push Summary

[wenchen]

Repository: spark
Updated Tags:  refs/tags/v2.4.0 [created] 075447b39

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[GitHub] spark pull request #22404: DO NOT MERGE

[squito]

Github user squito closed the pull request at:

https://github.com/apache/spark/pull/22404


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[spark] Git Push Summary

[jshao]

Repository: spark
Updated Tags:  refs/tags/v2.3.2-rc6 [created] 02b510728

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

[wenchen]

Repository: spark
Updated Tags:  refs/tags/v2.4.0-rc1 [created] 1220ab8a0

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[GitHub] spark pull request #22242: Branch 2.3

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/spark/pull/22242


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Please stop asking to unsubscribe

[Andrew Melo]

The correct way to unsubscribe is to mail

user-unsubscr...@spark.apache.org

Just mailing the list with "unsubscribe" doesn't actually do anything...

Thanks
Andrew

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

[GitHub] [spark] MichaelChirico commented on pull request #29007: [SPARK-XXXXX][SQL][DOCS] consistency in argument naming for time functions

[GitBox]

MichaelChirico commented on pull request #29007:
URL: https://github.com/apache/spark/pull/29007#issuecomment-654781966


   no, since there are subtle but important differences and the respective APIs 
are easy to find right alongside one another on the Spark docs website.
   
   I can personally assure I read 
[R](https://spark.apache.org/docs/latest/api/R/) for R reference, 
[SQL](https://spark.apache.org/docs/latest/api/sql/) for SQL reference, and 
[Python](https://spark.apache.org/docs/latest/api/python/) for python reference.
   
   I also see headings for 
[Java](https://spark.apache.org/docs/latest/api/java/) and 
[Scala](https://spark.apache.org/docs/latest/api/scala/) referenced in the 
[same directory](https://spark.apache.org/docs/latest/api/), but I rarely use 
those APIs so can't personally say I use them.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Re: Unsubscribe

[Wesley Peng]

Bhavya Jain wrote:

Unsubscribe


please send an email to: user-unsubscr...@spark.apache.org to 
unsubscribe yourself from the list. thanks.


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

[jira] [Assigned] (SPARK-36209) https://spark.apache.org/docs/latest/sql-programming-guide.html contains invalid link to Python doc

[Apache Spark (Jira)]

 [ 
https://issues.apache.org/jira/browse/SPARK-36209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-36209:


Assignee: Apache Spark

> https://spark.apache.org/docs/latest/sql-programming-guide.html contains 
> invalid link to Python doc
> ---
>
> Key: SPARK-36209
> URL: https://issues.apache.org/jira/browse/SPARK-36209
> Project: Spark
>  Issue Type: Bug
>  Components: Documentation
>Affects Versions: 3.1.2
>     Environment: On 
> https://spark.apache.org/docs/latest/sql-programming-guide.html, the link to 
> the python doc points to 
> https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame
>  which returns a "Not found"
>Reporter: Dominik Gehl
>Assignee: Apache Spark
>Priority: Major
>
> On https://spark.apache.org/docs/latest/sql-programming-guide.html , the link 
> to the python doc points to 
> https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame
>  which returns a "Not found"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Assigned] (SPARK-36209) https://spark.apache.org/docs/latest/sql-programming-guide.html contains invalid link to Python doc

[Apache Spark (Jira)]

 [ 
https://issues.apache.org/jira/browse/SPARK-36209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-36209:


Assignee: (was: Apache Spark)

> https://spark.apache.org/docs/latest/sql-programming-guide.html contains 
> invalid link to Python doc
> ---
>
> Key: SPARK-36209
> URL: https://issues.apache.org/jira/browse/SPARK-36209
> Project: Spark
>  Issue Type: Bug
>  Components: Documentation
>Affects Versions: 3.1.2
>     Environment: On 
> https://spark.apache.org/docs/latest/sql-programming-guide.html, the link to 
> the python doc points to 
> https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame
>  which returns a "Not found"
>Reporter: Dominik Gehl
>Priority: Major
>
> On https://spark.apache.org/docs/latest/sql-programming-guide.html , the link 
> to the python doc points to 
> https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame
>  which returns a "Not found"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-----
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-36209) https://spark.apache.org/docs/latest/sql-programming-guide.html contains invalid link to Python doc

[Apache Spark (Jira)]

[ 
https://issues.apache.org/jira/browse/SPARK-36209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383355#comment-17383355
 ] 

Apache Spark commented on SPARK-36209:
--

User 'dominikgehl' has created a pull request for this issue:
https://github.com/apache/spark/pull/33420

> https://spark.apache.org/docs/latest/sql-programming-guide.html contains 
> invalid link to Python doc
> ---
>
> Key: SPARK-36209
> URL: https://issues.apache.org/jira/browse/SPARK-36209
> Project: Spark
>  Issue Type: Bug
>  Components: Documentation
>Affects Versions: 3.1.2
>     Environment: On 
> https://spark.apache.org/docs/latest/sql-programming-guide.html, the link to 
> the python doc points to 
> https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame
>  which returns a "Not found"
>Reporter: Dominik Gehl
>Priority: Major
>
> On https://spark.apache.org/docs/latest/sql-programming-guide.html , the link 
> to the python doc points to 
> https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame
>  which returns a "Not found"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-----
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-36209) https://spark.apache.org/docs/latest/sql-programming-guide.html contains invalid link to Python doc

[Sean R. Owen (Jira)]

 [ 
https://issues.apache.org/jira/browse/SPARK-36209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean R. Owen updated SPARK-36209:
-
Priority: Minor  (was: Major)

> https://spark.apache.org/docs/latest/sql-programming-guide.html contains 
> invalid link to Python doc
> ---
>
> Key: SPARK-36209
> URL: https://issues.apache.org/jira/browse/SPARK-36209
> Project: Spark
>  Issue Type: Bug
>  Components: Documentation
>Affects Versions: 3.1.2
>     Environment: On 
> https://spark.apache.org/docs/latest/sql-programming-guide.html, the link to 
> the python doc points to 
> https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame
>  which returns a "Not found"
>Reporter: Dominik Gehl
>Priority: Minor
>
> On https://spark.apache.org/docs/latest/sql-programming-guide.html , the link 
> to the python doc points to 
> https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.DataFrame
>  which returns a "Not found"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-----
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Re: unsubscribe

[Bitfox]

The signature in your mail has showed the info:

To unsubscribe e-mail: user-unsubscr...@spark.apache.org



On Sun, Jan 30, 2022 at 8:50 PM Lucas Schroeder Rossi 
wrote:

> unsubscribe
>
> -
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
>
>

Re: unsubscribe

[Bitfox]

The signature in your messages has showed how to unsubscribe.

To unsubscribe e-mail: user-unsubscr...@spark.apache.org

On Mon, Jan 31, 2022 at 7:53 PM Lucas Schroeder Rossi 
wrote:

> unsubscribe
>
> -
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
>
>

Re: unsubscribe

[frakass]

please send an empty message to: user-unsubscr...@spark.apache.org to 
unsubscribe yourself from the list.


Thanks

On 2022/1/15 7:04, ALOK KUMAR SINGH wrote:

unsubscribe


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: unsubscribe

[capitnfrakass]

On 22/01/2022 11:07, Renan F. Souza wrote:

unsubscribe


You could be able to unsubscribe yourself from the list by sending an 
email to:

user-unsubscr...@spark.apache.org

thanks.

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: unsubscribe

[pengyh]

you could be able to unsubscribe yourself by using the signature below.



To unsubscribe e-mail: user-unsubscr...@spark.apache.org


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: [PR] [MINOR][DOCS] Remove the extra text on page sql-error-conditions-sqlstates [spark]

[via GitHub]

panbingkun commented on PR #45469:
URL: https://github.com/apache/spark/pull/45469#issuecomment-1989791290

   This issue has existed since version `3.4.0`.  After this PR, I will submit 
`a patch` to fix the doc in `spark-website`.
   https://spark.apache.org/docs/3.4.0/sql-error-conditions-sqlstates.html
   https://spark.apache.org/docs/3.4.1/sql-error-conditions-sqlstates.html
   https://spark.apache.org/docs/3.4.2/sql-error-conditions-sqlstates.html
   https://spark.apache.org/docs/3.5.0/sql-error-conditions-sqlstates.html
   https://spark.apache.org/docs/3.5.1/sql-error-conditions-sqlstates.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[2/2] spark-website git commit: Update sitemap and make it partly auto-generate; fix site URL

[srowen]

Update sitemap and make it partly auto-generate; fix site URL


Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/8d0a10ae
Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/8d0a10ae
Diff: http://git-wip-us.apache.org/repos/asf/spark-website/diff/8d0a10ae

Branch: refs/heads/asf-site
Commit: 8d0a10ae0be7df4058b38d298df391fe1fc1cdab
Parents: 3529c3f
Author: Sean Owen <so...@cloudera.com>
Authored: Sat Nov 19 19:14:33 2016 +
Committer: Sean Owen <so...@cloudera.com>
Committed: Sun Nov 20 12:32:55 2016 +

--
 _config.yml |9 +-
 _layouts/global.html|2 +-
 site/mailing-lists.html |2 +-
 site/sitemap.xml| 1602 +
 sitemap.xml | 1824 ++
 5 files changed, 245 insertions(+), 3194 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/spark-website/blob/8d0a10ae/_config.yml
--
diff --git a/_config.yml b/_config.yml
index cf7c694..18ba30f 100644
--- a/_config.yml
+++ b/_config.yml
@@ -6,11 +6,4 @@ permalink: none
 destination: site
 exclude: ['README.md','content']
 keep_files: ['docs']
-
-# The recommended way of viewing the website on your local machine is via 
jekyll using
-# a webserver, e.g. with a command like: jekyll serve --watch --trace
-# To compile the website such that it is viewable in a sane way via a file 
browser
-# replace '/' here with the url that represents the website root dir in your 
file browser.
-# E.g. on OS X this might be:
-#url: file:///Users/andyk/Development/spark-website/content/
-url: /
+url: http://spark.apache.org
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/spark-website/blob/8d0a10ae/_layouts/global.html
--
diff --git a/_layouts/global.html b/_layouts/global.html
index b35de94..6f02c16 100644
--- a/_layouts/global.html
+++ b/_layouts/global.html
@@ -13,7 +13,7 @@
 
   {% if page.redirect %}
 
-
+
   {% endif %}
 
   {% if page.description %}

http://git-wip-us.apache.org/repos/asf/spark-website/blob/8d0a10ae/site/mailing-lists.html
--
diff --git a/site/mailing-lists.html b/site/mailing-lists.html
index c0ce369..aec2aa0 100644
--- a/site/mailing-lists.html
+++ b/site/mailing-lists.html
@@ -12,7 +12,7 @@
 
   
 
-
+http://spark.apache.org/community.html; />
   
 
   

http://git-wip-us.apache.org/repos/asf/spark-website/blob/8d0a10ae/site/sitemap.xml
--
diff --git a/site/sitemap.xml b/site/sitemap.xml
index c2b271e..db7822b 100644
--- a/site/sitemap.xml
+++ b/site/sitemap.xml
@@ -1,1871 +1,649 @@
 
 http://www.sitemaps.org/schemas/sitemap/0.9;
-  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
-  xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9
+xmlns="http://www.sitemaps.org/schemas/sitemap/0.9;
+xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
+xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9
 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd;>
-
-
-  http://spark.apache.org/
-  2015-01-22T00:27:22+00:00
-  daily
-
-
-  http://spark.apache.org/downloads.html
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/sql/
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/streaming/
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/mllib/
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/graphx/
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/documentation.html
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/docs/latest/
-  1.0
-  2014-12-19T00:12:40+00:00
-  weekly
-
-
-  http://spark.apache.org/examples.html
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/community.html
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/faq.html
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/news/spark-summit-east-agenda-posted.html
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/news/spark-1-2-0-released.html
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/news/spark-1-1-1-released.html
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  
http://spark.apache.org/news/registration-open-for-spark-summit-east.html
-  2015-01-22T00:27:22+00:00
-  weekly
-
-
-  http://spark.apache.org/news/index.html
-  2015-01-22T00:27:22+00:00
-  daily
-
-
-  http://spark.apache.org/docs/latest/spark-s

Re: reducing number of output files

[Sean Owen]

One output file is produced per partition. If you want fewer, use
coalesce() before saving the RDD.

On Thu, Jan 22, 2015 at 10:46 PM, Kane Kim kane.ist...@gmail.com wrote:
 How I can reduce number of output files? Is there a parameter to 
 saveAsTextFile?

 Thanks.

 -
 To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
 For additional commands, e-mail: user-h...@spark.apache.org


-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

RE: Is SQLContext thread-safe?

[Cheng, Hao]

Yes it is thread safe, at least it's supposed to be.

-Original Message-
From: Haopu Wang [mailto:hw...@qilinsoft.com] 
Sent: Monday, March 2, 2015 4:43 PM
To: user
Subject: Is SQLContext thread-safe?

Hi, is it safe to use the same SQLContext to do Select operations in different 
threads at the same time? Thank you very much!

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional 
commands, e-mail: user-h...@spark.apache.org


-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: spark.dynamicAllocation.minExecutors

[Sean Owen]

IIRC that was fixed already in 1.3

https://github.com/apache/spark/commit/b2047b55c5fc85de6b63276d8ab9610d2496e08b

On Thu, Apr 16, 2015 at 7:41 PM, Michael Stone mst...@mathom.us wrote:
 The default for spark.dynamicAllocation.minExecutors is 0, but that value
 causes a runtime error and a message that the minimum is 1. Perhaps the
 default should be changed to 1?

 Mike Stone

 -
 To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
 For additional commands, e-mail: user-h...@spark.apache.org


-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

[jira] [Created] (SPARK-6719) Update spark.apache.org/mllib page to 1.3

[Xiangrui Meng (JIRA)]

Xiangrui Meng created SPARK-6719:


 Summary: Update spark.apache.org/mllib page to 1.3
 Key: SPARK-6719
 URL: https://issues.apache.org/jira/browse/SPARK-6719
 Project: Spark
  Issue Type: Task
  Components: Documentation, MLlib
Reporter: Xiangrui Meng
Assignee: Xiangrui Meng


The current web page is outdated.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Re: execute native system commands in Spark

[Adrian Tanase]

Have you seen .pipe()?




On 11/2/15, 5:36 PM, "patcharee" <patcharee.thong...@uni.no> wrote:

>Hi,
>
>Is it possible to execute native system commands (in parallel) Spark, 
>like scala.sys.process ?
>
>Best,
>Patcharee
>
>-
>To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>For additional commands, e-mail: user-h...@spark.apache.org
>

-----
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

[no subject]

[Sateesh Karuturi]

user-sc.1449231970.fbaoamghkloiongfhbbg-sateesh.karuturi9=
gmail@spark.apache.org

Re: Welcoming Yanbo Liang as a committer

[Kousuke Saruta]

Congratulations Yanbo!


- Kousuke

On 2016/06/04 11:48, Matei Zaharia wrote:

Hi all,

The PMC recently voted to add Yanbo Liang as a committer. Yanbo has been a 
super active contributor in many areas of MLlib. Please join me in welcoming 
Yanbo!

Matei
-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org




-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Re: Welcoming Yanbo Liang as a committer

[Suresh Thalamati]

Congratulations, Yanbo

> On Jun 3, 2016, at 7:48 PM, Matei Zaharia <matei.zaha...@gmail.com> wrote:
> 
> Hi all,
> 
> The PMC recently voted to add Yanbo Liang as a committer. Yanbo has been a 
> super active contributor in many areas of MLlib. Please join me in welcoming 
> Yanbo!
> 
> Matei
> -
> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
> For additional commands, e-mail: dev-h...@spark.apache.org
> 


-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Re: Long running jobs in CDH

[Jorge Machado]

Hi Jan, 

Oozie oder you can check the parameter —supervise option  
http://spark.apache.org/docs/latest/submitting-applications.html 
<http://spark.apache.org/docs/latest/submitting-applications.html> 

> On 11/01/2016, at 14:23, Jan Holmberg <jan.holmb...@perigeum.fi> wrote:
> 
> Hi,
> any preferences how to run constantly running jobs (streaming) in CDH? Oozie? 
> Cmdline? Something else?
> 
> cheers,
> -jan
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
> 

Re: Spark Certification

[Timothy Spann]

I was wondering that as well.

Also is it fully updated for 1.6?

Tim
http://airisdata.com/
http://sparkdeveloper.com/


From: naga sharathrayapati 
<sharathrayap...@gmail.com<mailto:sharathrayap...@gmail.com>>
Date: Wednesday, February 10, 2016 at 11:36 PM
To: "user@spark.apache.org<mailto:user@spark.apache.org>" 
<user@spark.apache.org<mailto:user@spark.apache.org>>
Subject: Spark Certification

Hello All,

I am planning on taking Spark Certification and I was wondering If one has to 
be well equipped with  MLib & GraphX as well or not ?

Please advise

Thanks

[no subject]

[thibaut]

unsuscribe

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Unsubscribe

[bijuna]

Unsubscribe


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: Spark Website

[Benjamin Kim]

It takes me to the directories instead of the webpage.

> On Jul 13, 2016, at 11:45 AM, manish ranjan <cse1.man...@gmail.com> wrote:
> 
> working for me. What do you mean 'as supposed to'?
> 
> ~Manish
> 
> 
> 
> On Wed, Jul 13, 2016 at 11:45 AM, Benjamin Kim <bbuil...@gmail.com 
> <mailto:bbuil...@gmail.com>> wrote:
> Has anyone noticed that the spark.apache.org <http://spark.apache.org/> is 
> not working as supposed to?
> 
> 
> -----
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org 
> <mailto:user-unsubscr...@spark.apache.org>
> 
> 

Unsubscribe

[sjk]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[bijuna]

Sent from my iPhone

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[bijuna]

> 
> 

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Karthikeyan Vasuki Balasubramaniam]

unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[ryou . hasegawa]

Unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Aditya]

Unsubscribe




-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[bobwang]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Ajit Jaokar]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Roger Holenweger]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Parijat Mazumdar]

Unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Please unsubscribe

[babita Sancheti]

Sent from my iPhone

> 
> 

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Test

[nayan sharma]

Test

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[韩盼]

unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Please remove me!

[x x]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Anshuman Kumar]

unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Mohamed Gabr]

Unsubscribe

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

spark-website git commit: Change company to Oath from Yahoo

[srowen]

Repository: spark-website
Updated Branches:
  refs/heads/asf-site 13d8bd58a -> 8c5354f29


Change company to Oath from Yahoo


Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/8c5354f2
Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/8c5354f2
Diff: http://git-wip-us.apache.org/repos/asf/spark-website/diff/8c5354f2

Branch: refs/heads/asf-site
Commit: 8c5354f29badb9803a6903bf3aa74855eeaa69df
Parents: 13d8bd5
Author: Thomas Graves <tgra...@oath.com>
Authored: Wed Jan 3 15:37:22 2018 -0600
Committer: Sean Owen <so...@cloudera.com>
Committed: Thu Jan 4 09:50:38 2018 -0600

--
 committers.md|  4 ++--
 site/committers.html |  4 ++--
 site/sitemap.xml | 14 +++---
 3 files changed, 11 insertions(+), 11 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/spark-website/blob/8c5354f2/committers.md
--
diff --git a/committers.md b/committers.md
index 90d09ac..6c6b8ab 100644
--- a/committers.md
+++ b/committers.md
@@ -20,10 +20,10 @@ navigation:
 |Ankur Dave|UC Berkeley|
 |Aaron Davidson|Databricks|
 |Thomas Dudziak|Facebook|
-|Robert Evans|Yahoo!|
+|Robert Evans|Oath|
 |Wenchen Fan|Databricks|
 |Joseph Gonzalez|UC Berkeley|
-|Thomas Graves|Yahoo!|
+|Thomas Graves|Oath|
 |Stephen Haberman|Bizo|
 |Mark Hamstra|ClearStory Data|
 |Herman van Hovell|QuestTec B.V.|

http://git-wip-us.apache.org/repos/asf/spark-website/blob/8c5354f2/site/committers.html
--
diff --git a/site/committers.html b/site/committers.html
index 84bb1fd..1a00435 100644
--- a/site/committers.html
+++ b/site/committers.html
@@ -246,7 +246,7 @@
 
 
   Robert Evans
-  Yahoo!
+  Oath
 
 
   Wenchen Fan
@@ -258,7 +258,7 @@
 
 
   Thomas Graves
-  Yahoo!
+  Oath
 
 
   Stephen Haberman

http://git-wip-us.apache.org/repos/asf/spark-website/blob/8c5354f2/site/sitemap.xml
--
diff --git a/site/sitemap.xml b/site/sitemap.xml
index a5e16e9..00ce7ef 100644
--- a/site/sitemap.xml
+++ b/site/sitemap.xml
@@ -672,31 +672,31 @@
   weekly
 
 
-  https://spark.apache.org/mllib/
+  https://spark.apache.org/graphx/
   weekly
 
 
-  https://spark.apache.org/
+  https://spark.apache.org/mllib/
   weekly
 
 
-  https://spark.apache.org/sql/
+  https://spark.apache.org/streaming/
   weekly
 
 
-  https://spark.apache.org/streaming/
+  https://spark.apache.org/news/
   weekly
 
 
-  https://spark.apache.org/news/
+  https://spark.apache.org/screencasts/
   weekly
 
 
-  https://spark.apache.org/graphx/
+  https://spark.apache.org/sql/
   weekly
 
 
-  https://spark.apache.org/screencasts/
+  https://spark.apache.org/
   weekly
 
 


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

unsubscribe

[韩盼]

unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

[GitHub] spark issue #20387: [SPARK-23203][SPARK-23204][SQL]: DataSourceV2: Use immut...

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/spark/pull/20387
  
don't we already have table in DataFrameReader? 
http://spark.apache.org/docs/latest/api/python/pyspark.sql.html?highlight=dataframereader#pyspark.sql.DataFrameReader.table

http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrameReader@table(tableName:String):org.apache.spark.sql.DataFrame


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Unsubscribe

[wangsan]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Ryan Myer]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[施朝浩]

unsubscribe


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[purna pradeep]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[韩盼]

unsubscribe

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

unsubscribe

[韩盼]

unsubscribe


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[purna pradeep]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Liu, Jialin]

Unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Deepak Sahoo]

Unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Duan,Bing]

unsubscribe.

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

unsubscribe

[MEETHU MATHEW]

Thanks & Regards, Meethu M

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

unsubscribe

[Michal Sankot]

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Unsubscribe

[Dhruv Kumar]

Unsubscribe

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

[GitHub] [spark] HyukjinKwon commented on pull request #33228: Update README.md

[GitBox]

HyukjinKwon commented on pull request #33228:
URL: https://github.com/apache/spark/pull/33228#issuecomment-874577924


   @drakelam, please read also https://spark.apache.org/contributing.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] [spark] HyukjinKwon commented on pull request #33228: Update README.md

[GitBox]

HyukjinKwon commented on pull request #33228:
URL: https://github.com/apache/spark/pull/33228#issuecomment-874577924


   @drakelam, please read also https://spark.apache.org/contributing.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Unsubscribe

[Atlas - Samir Souidi]

Unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Lisa Fiedler]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Yuri Oleynikov (‫יורי אולייניקוב‬‎)]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[Yuri Oleynikov (‫יורי אולייניקוב‬‎)]

Unsubscribe 

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

[GitHub] [spark] HyukjinKwon commented on pull request #34353: Set spark.sql.files.openCostInBytes to bytesConf

[GitBox]

HyukjinKwon commented on pull request #34353:
URL: https://github.com/apache/spark/pull/34353#issuecomment-948389308


   Let's also file a JIRA, see also https://spark.apache.org/contributing.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

unsubscribe

[Lucas Schroeder Rossi]

unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Lucas Schroeder Rossi]

unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Lucas Schroeder Rossi]

unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Lucas Schroeder Rossi]

unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Danilo Sousa]

unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

subscribe request

[王宏杰]

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

[GitHub] [spark] srowen commented on pull request #37778: Unsafe loop

[GitBox]

srowen commented on PR #37778:
URL: https://github.com/apache/spark/pull/37778#issuecomment-1236138062

   https://spark.apache.org/contributing.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

unsubscribe

[Sivakumar Ganesan]

unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[Martin Soch]

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[ypl]

unsubscribe


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

[blaz stojanovic]

Unsubscribe

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

[bruce COTTMAN]

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org