[spark-website] branch asf-site updated: Fix broken link on 3rd party projects page and add more projects

2019-05-21 Thread matei
This is an automated email from the ASF dual-hosted git repository. matei pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 8a612a8 Fix broken link on 3rd party

spark-website git commit: Small updates to Powered By page

2018-06-16 Thread matei
cbf Parents: eb97812 Author: Matei Zaharia Authored: Sat Jun 16 10:02:09 2018 -0700 Committer: Matei Zaharia Committed: Sat Jun 16 10:02:09 2018 -0700 -- powered-by.md| 31 +++ site/doap.

spark-website git commit: Update Hive compatibility wording

2017-08-07 Thread matei
wip-us.apache.org/repos/asf/spark-website/tree/eb51b33f Diff: http://git-wip-us.apache.org/repos/asf/spark-website/diff/eb51b33f Branch: refs/heads/asf-site Commit: eb51b33f07b633acc70534ca022f0952d5b00d66 Parents: 8899096 Author: Matei Zaharia <matei.zaha...@gmail.com> Authored: Sun Aug 6 12:4

[1/3] spark-website git commit: Trademarks page and some FAQ cleanup

2016-08-03 Thread matei
spark-website/blob/9700f2f4/site/research.html ------ diff --git a/site/research.html b/site/research.html index e873042..556d610 100644 --- a/site/research.html +++ b/site/research.html @@ -249,7 +249,7 @@ Spark offers an abstraction c

[3/3] spark-website git commit: Trademarks page and some FAQ cleanup

2016-08-03 Thread matei
/asf/spark-website/diff/9700f2f4 Branch: refs/heads/asf-site Commit: 9700f2f4afe566412bdb73b443b3aad99b375af1 Parents: 6123834 Author: Matei Zaharia <ma...@databricks.com> Authored: Wed Aug 3 19:12:55 2016 -0700 Committer: Matei Zaharia <ma...@databricks.com> Committed: Wed Aug 3 19:12:5

[2/3] spark-website git commit: Trademarks page and some FAQ cleanup

2016-08-03 Thread matei
http://git-wip-us.apache.org/repos/asf/spark-website/blob/9700f2f4/site/news/proposals-open-for-spark-summit-east.html -- diff --git a/site/news/proposals-open-for-spark-summit-east.html

svn commit: r1747764 - in /spark: css/ site/ site/css/ site/images/

2016-06-10 Thread matei
Author: matei Date: Fri Jun 10 18:15:52 2016 New Revision: 1747764 URL: http://svn.apache.org/viewvc?rev=1747764=rev Log: CSS tweaks Modified: spark/css/custom.css spark/site/css/custom.css spark/site/documentation.html spark/site/images/spark-logo-reverse.eps spark/site

svn commit: r1747763 - in /spark/images: spark-logo-reverse.eps spark-logo-trademark.png spark-logo.eps spark-logo.png spark-runs-everywhere.png

2016-06-10 Thread matei
Author: matei Date: Fri Jun 10 18:15:35 2016 New Revision: 1747763 URL: http://svn.apache.org/viewvc?rev=1747763=rev Log: Version of logo with Apache Modified: spark/images/spark-logo-reverse.eps spark/images/spark-logo-trademark.png spark/images/spark-logo.eps spark/images/spark

svn commit: r1745631 [2/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2016-05-26 Thread matei
Modified: spark/site/news/spark-summit-2014-videos-posted.html URL: http://svn.apache.org/viewvc/spark/site/news/spark-summit-2014-videos-posted.html?rev=1745631=1745630=1745631=diff == ---

svn commit: r1744473 [1/2] - in /spark: ./ _layouts/ graphx/ images/ mllib/ site/ site/graphx/ site/images/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/ strea

2016-05-18 Thread matei
Author: matei Date: Thu May 19 00:14:26 2016 New Revision: 1744473 URL: http://svn.apache.org/viewvc?rev=1744473=rev Log: Improvements to branding, some general updates, and EPS logos Added: spark/images/spark-logo-reverse.eps (with props) spark/images/spark-logo.eps (with props

svn commit: r1744473 [2/2] - in /spark: ./ _layouts/ graphx/ images/ mllib/ site/ site/graphx/ site/images/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/ strea

2016-05-18 Thread matei
Modified: spark/site/releases/spark-release-1-0-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-1-0-0.html?rev=1744473=1744472=1744473=diff == --- spark/site/releases/spark-release-1-0-0.html

svn commit: r1731310 [2/2] - in /spark: ./ site/ site/news/ site/releases/

2016-02-19 Thread matei
Modified: spark/site/releases/spark-release-1-2-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-1-2-0.html?rev=1731310=1731309=1731310=diff == --- spark/site/releases/spark-release-1-2-0.html

svn commit: r1725819 - in /spark: ./ site/ site/news/ site/releases/

2016-01-20 Thread matei
Author: matei Date: Wed Jan 20 21:40:26 2016 New Revision: 1725819 URL: http://svn.apache.org/viewvc?rev=1725819=rev Log: Add TM symbol to download page Modified: spark/downloads.md spark/site/documentation.html spark/site/downloads.html spark/site/news/index.html spark/site

spark git commit: [SPARK-9852] Let reduce tasks fetch multiple map output partitions

2015-09-24 Thread matei
ing on multiple map output partitions. Author: Matei Zaharia <ma...@databricks.com> Closes #8844 from mateiz/spark-9852. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/21fd12cb Tree: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-9851] Support submitting map stages individually in DAGScheduler

2015-09-14 Thread matei
ing decisions. The main entry point is SparkContext.submitMapStage, which lets you run a map stage and see stats about the map output sizes. Other stats could also be collected through accumulators. See AdaptiveSchedulingSuite for a short example. Author: Matei Zaharia <ma...@databricks.com> Clo

spark git commit: [SPARK-10008] Ensure shuffle locality doesn't take precedence over narrow deps

2015-08-16 Thread matei
, it can cause them to place tasks based on the shuffle dependency instead of the narrow one. This case is common in iterative join-based algorithms like PageRank and ALS, where one RDD is hash-partitioned and one isn't. Author: Matei Zaharia ma...@databricks.com Closes #8220 from mateiz/shuffle-loc

spark git commit: [SPARK-10008] Ensure shuffle locality doesn't take precedence over narrow deps

2015-08-16 Thread matei
, it can cause them to place tasks based on the shuffle dependency instead of the narrow one. This case is common in iterative join-based algorithms like PageRank and ALS, where one RDD is hash-partitioned and one isn't. Author: Matei Zaharia ma...@databricks.com Closes #8220 from mateiz/shuffle-loc-fix

svn commit: r1692748 - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

2015-07-26 Thread matei
Author: matei Date: Sun Jul 26 19:10:57 2015 New Revision: 1692748 URL: http://svn.apache.org/r1692748 Log: Further improvements to site Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site

svn commit: r1692749 - in /spark: site/sql/index.html sql/index.md

2015-07-26 Thread matei
Author: matei Date: Sun Jul 26 19:11:45 2015 New Revision: 1692749 URL: http://svn.apache.org/r1692749 Log: Fix Python Modified: spark/site/sql/index.html spark/sql/index.md Modified: spark/site/sql/index.html URL: http://svn.apache.org/viewvc/spark/site/sql/index.html?rev=1692749r1

svn commit: r1692668 [1/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

2015-07-25 Thread matei
Author: matei Date: Sat Jul 25 23:10:48 2015 New Revision: 1692668 URL: http://svn.apache.org/r1692668 Log: Updates to SQL page Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site/examples.html

svn commit: r1692669 - in /spark: index.md site/index.html

2015-07-25 Thread matei
Author: matei Date: Sat Jul 25 23:15:18 2015 New Revision: 1692669 URL: http://svn.apache.org/r1692669 Log: Homepage tweak Modified: spark/index.md spark/site/index.html Modified: spark/index.md URL: http://svn.apache.org/viewvc/spark/index.md?rev=1692669r1=1692668r2=1692669view=diff

svn commit: r1692668 [2/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

2015-07-25 Thread matei
Modified: spark/site/releases/spark-release-0-8-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-8-0.html?rev=1692668r1=1692667r2=1692668view=diff == ---

spark git commit: [SPARK-9244] Increase some memory defaults

2015-07-22 Thread matei
increase it to 1g. Author: Matei Zaharia ma...@databricks.com Closes #7586 from mateiz/configs and squashes the following commits: ce0038a [Matei Zaharia] [SPARK-9244] Increase some memory defaults Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org

svn commit: r1691756 - in /spark: documentation.md research.md site/documentation.html site/research.html

2015-07-18 Thread matei
Author: matei Date: Sat Jul 18 17:16:22 2015 New Revision: 1691756 URL: http://svn.apache.org/r1691756 Log: Updates to documentation and research pages Modified: spark/documentation.md spark/research.md spark/site/documentation.html spark/site/research.html Modified: spark

svn commit: r1691757 - in /spark: documentation.md site/documentation.html

2015-07-18 Thread matei
Author: matei Date: Sat Jul 18 17:17:39 2015 New Revision: 1691757 URL: http://svn.apache.org/r1691757 Log: Fix author of Packt book Modified: spark/documentation.md spark/site/documentation.html Modified: spark/documentation.md URL: http://svn.apache.org/viewvc/spark/documentation.md

svn commit: r1682772 - in /spark: faq.md site/faq.html site/streaming/index.html streaming/index.md

2015-05-31 Thread matei
Author: matei Date: Sun May 31 19:04:53 2015 New Revision: 1682772 URL: http://svn.apache.org/r1682772 Log: Some updates to FAQ on streaming Modified: spark/faq.md spark/site/faq.html spark/site/streaming/index.html spark/streaming/index.md Modified: spark/faq.md URL: http

svn commit: r1682773 - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-05-31 Thread matei
Author: matei Date: Sun May 31 19:06:00 2015 New Revision: 1682773 URL: http://svn.apache.org/r1682773 Log: Consistent wording of packages link Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site

spark git commit: [SPARK-7298] Harmonize style of new visualizations

2015-05-08 Thread matei
- DAG visualization text and colors are more consistent throughout - Fix some JavaScript style issues - Various small fixes throughout (e.g. inconsistent capitalization, some confusing names, HTML escaping, etc) Author: Matei Zaharia ma...@databricks.com Closes #5942 from mateiz/ui and squashes

svn commit: r1677482 [1/2] - in /spark: ./ _layouts/ css/ site/ site/css/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-05-03 Thread matei
Author: matei Date: Sun May 3 20:48:43 2015 New Revision: 1677482 URL: http://svn.apache.org/r1677482 Log: Some updates to FAQ and homepage Modified: spark/_layouts/global.html spark/css/custom.css spark/faq.md spark/index.md spark/site/community.html spark/site/css

svn commit: r1677482 [2/2] - in /spark: ./ _layouts/ css/ site/ site/css/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-05-03 Thread matei
Modified: spark/site/news/video-from-first-spark-development-meetup.html URL: http://svn.apache.org/viewvc/spark/site/news/video-from-first-spark-development-meetup.html?rev=1677482r1=1677481r2=1677482view=diff == ---

svn commit: r1658279 - in /spark: robots.txt sitemap.xml

2015-02-08 Thread matei
Author: matei Date: Sun Feb 8 23:59:49 2015 New Revision: 1658279 URL: http://svn.apache.org/r1658279 Log: Add robots.txt and sitemap.xml to top-level folder too so they get generated Added: spark/robots.txt spark/sitemap.xml Added: spark/robots.txt URL: http://svn.apache.org/viewvc

svn commit: r1658278 - in /spark: ./ _layouts/ graphx/ mllib/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/ streaming/

2015-02-08 Thread matei
Author: matei Date: Sun Feb 8 23:58:24 2015 New Revision: 1658278 URL: http://svn.apache.org/r1658278 Log: Add meta description tags Modified: spark/_layouts/global.html spark/graphx/index.md spark/index.md spark/mllib/index.md spark/site/community.html spark/site

spark git commit: [SPARK-5608] Improve SEO of Spark documentation pages

2015-02-05 Thread matei
no reason to have Spark SQL Programming Guide - Spark 1.2.0 documentation, we can just say Spark SQL - Spark 1.2.0 documentation. Author: Matei Zaharia ma...@databricks.com Closes #4381 from mateiz/docs-seo and squashes the following commits: 4940563 [Matei Zaharia] [SPARK-5608] Improve SEO

spark git commit: [SPARK-5608] Improve SEO of Spark documentation pages

2015-02-05 Thread matei
no reason to have Spark SQL Programming Guide - Spark 1.2.0 documentation, we can just say Spark SQL - Spark 1.2.0 documentation. Author: Matei Zaharia ma...@databricks.com Closes #4381 from mateiz/docs-seo and squashes the following commits: 4940563 [Matei Zaharia] [SPARK-5608] Improve SEO

svn commit: r1657457 - in /spark/site: robots.txt sitemap.xml

2015-02-04 Thread matei
Author: matei Date: Thu Feb 5 02:01:47 2015 New Revision: 1657457 URL: http://svn.apache.org/r1657457 Log: Add a sitemap to try to let Google more easily find docs/latest Added: spark/site/robots.txt spark/site/sitemap.xml Added: spark/site/robots.txt URL: http://svn.apache.org/viewvc

svn commit: r1653723 [2/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-01-21 Thread matei
Modified: spark/site/releases/spark-release-0-5-2.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-5-2.html?rev=1653723r1=1653722r2=1653723view=diff == ---

svn commit: r1653723 [1/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-01-21 Thread matei
Author: matei Date: Thu Jan 22 00:27:22 2015 New Revision: 1653723 URL: http://svn.apache.org/r1653723 Log: Add Summit East news item Added: spark/news/_posts/2015-01-21-spark-summit-east-agenda-posted.md spark/site/news/spark-summit-east-agenda-posted.html Modified: spark/site

spark git commit: [SPARK-3619] Upgrade to Mesos 0.21 to work around MESOS-1688

2015-01-09 Thread matei
jongy...@gmail.com Authored: Fri Jan 9 10:47:08 2015 -0800 Committer: Matei Zaharia ma...@databricks.com Committed: Fri Jan 9 10:47:08 2015 -0800 -- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion

svn commit: r1642751 - in /spark: community.md site/community.html

2014-12-01 Thread matei
Author: matei Date: Mon Dec 1 20:56:05 2014 New Revision: 1642751 URL: http://svn.apache.org/r1642751 Log: tweaks to conferences Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md?rev=1642751r1

svn commit: r1642753 - in /spark: community.md site/community.html

2014-12-01 Thread matei
Author: matei Date: Mon Dec 1 21:01:25 2014 New Revision: 1642753 URL: http://svn.apache.org/r1642753 Log: tweaks Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md?rev=1642753r1=1642752r2

spark git commit: [SPARK-4613][Core] Java API for JdbcRDD

2014-11-27 Thread matei
Lian] Java API for JdbcRDD (cherry picked from commit 120a350240f58196eafcb038ca3a353636d89239) Signed-off-by: Matei Zaharia ma...@databricks.com Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/09280043 Tree: http://git-wip

spark git commit: [SPARK-732][SPARK-3628][CORE][RESUBMIT] eliminate duplicate update on accmulator

2014-11-26 Thread matei
Author: CodingCat zhunans...@gmail.com Authored: Wed Nov 26 16:52:04 2014 -0800 Committer: Matei Zaharia ma...@databricks.com Committed: Wed Nov 26 16:52:04 2014 -0800 -- .../scala/org/apache/spark/Accumulators.scala | 4

svn commit: r1642003 [2/3] - in /spark: ./ _layouts/ news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2014-11-26 Thread matei
Modified: spark/site/news/spark-1-0-1-released.html URL: http://svn.apache.org/viewvc/spark/site/news/spark-1-0-1-released.html?rev=1642003r1=1642002r2=1642003view=diff == --- spark/site/news/spark-1-0-1-released.html

svn commit: r1642004 - in /spark: news/_posts/2014-11-26-registration-open-for-spark-summit-east.md site/news/index.html site/news/registration-open-for-spark-summit-east.html

2014-11-26 Thread matei
Author: matei Date: Thu Nov 27 02:09:19 2014 New Revision: 1642004 URL: http://svn.apache.org/r1642004 Log: Fixed text Modified: spark/news/_posts/2014-11-26-registration-open-for-spark-summit-east.md spark/site/news/index.html spark/site/news/registration-open-for-spark-summit

spark git commit: [SPARK-4330][Doc] Link to proper URL for YARN overview

2014-11-10 Thread matei
Committer: Matei Zaharia ma...@databricks.com Committed: Mon Nov 10 22:18:00 2014 -0800 -- docs/running-on-yarn.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion

spark git commit: [SPARK-4330][Doc] Link to proper URL for YARN overview

2014-11-10 Thread matei
...@oss.nttdata.co.jp Closes #3196 from sarutak/SPARK-4330 and squashes the following commits: 30baa21 [Kousuke Saruta] Fixed running-on-yarn.md to point proper URL for YARN (cherry picked from commit 3c07b8f08240bafcdff5d174989fb433f4bc80b6) Signed-off-by: Matei Zaharia ma...@databricks.com Project: http://git

spark git commit: [SPARK-4330][Doc] Link to proper URL for YARN overview

2014-11-10 Thread matei
...@oss.nttdata.co.jp Closes #3196 from sarutak/SPARK-4330 and squashes the following commits: 30baa21 [Kousuke Saruta] Fixed running-on-yarn.md to point proper URL for YARN (cherry picked from commit 3c07b8f08240bafcdff5d174989fb433f4bc80b6) Signed-off-by: Matei Zaharia ma...@databricks.com Project: http://git

git commit: [SPARK-4186] add binaryFiles and binaryRecords in Python

2014-11-06 Thread matei
Branch: refs/heads/master Commit: b41a39e24038876359aeb7ce24de2234e5f3 Parents: 5f27ae1 Author: Davies Liu dav...@databricks.com Authored: Thu Nov 6 00:22:19 2014 -0800 Committer: Matei Zaharia ma...@databricks.com Committed: Thu Nov 6 00:22:19 2014 -0800

git commit: [SPARK-4186] add binaryFiles and binaryRecords in Python

2014-11-06 Thread matei
binaryFiles and binaryRecords in Python (cherry picked from commit b41a39e24038876359aeb7ce24de2234e5f3) Signed-off-by: Matei Zaharia ma...@databricks.com Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/01484455 Tree: http

git commit: SPARK-4222 [CORE] use readFully in FixedLengthBinaryRecordReader

2014-11-05 Thread matei
2014 -0800 Committer: Matei Zaharia ma...@databricks.com Committed: Wed Nov 5 15:38:48 2014 -0800 -- .../org/apache/spark/input/FixedLengthBinaryRecordReader.scala | 2 +- 1 file changed, 1 insertion(+), 1 deletion

git commit: SPARK-4222 [CORE] use readFully in FixedLengthBinaryRecordReader

2014-11-05 Thread matei
-sloth/branch-1.2-fixedLenRecRdr and squashes the following commits: a245c8a [industrial-sloth] use readFully in FixedLengthBinaryRecordReader (cherry picked from commit 6844e7a8219ac78790a422ffd5054924e7d2bea1) Signed-off-by: Matei Zaharia ma...@databricks.com Project: http://git-wip

git commit: SPARK-4040. Update documentation to exemplify use of local (n) value, fo...

2014-11-05 Thread matei
Committer: Matei Zaharia ma...@databricks.com Committed: Wed Nov 5 15:45:34 2014 -0800 -- docs/configuration.md | 10 -- docs/streaming-programming-guide.md | 14 +- 2 files changed, 17 insertions

git commit: SPARK-4040. Update documentation to exemplify use of local (n) value, fo...

2014-11-05 Thread matei
Closes #2964 from jayunit100/SPARK-4040 and squashes the following commits: 35b5a5e [j...@apache.org] SPARK-4040: Update documentation to exemplify use of local (n) value. (cherry picked from commit 868cd4c3ca11e6ecc4425b972d9a20c360b52425) Signed-off-by: Matei Zaharia ma...@databricks.com Project

git commit: [SPARK-3466] Limit size of results that a driver collects for each action

2014-11-02 Thread matei
: 23f966f Author: Davies Liu dav...@databricks.com Authored: Sun Nov 2 00:03:51 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Sun Nov 2 00:03:51 2014 -0700 -- .../org/apache/spark/executor/Executor.scala

git commit: [SPARK-2759][CORE] Generic Binary File Support in Spark

2014-11-01 Thread matei
/7136719b Branch: refs/heads/master Commit: 7136719b7d53ee1360abaa5e178ba9f8b00f3da8 Parents: ee29ef3 Author: Kevin Mader kevinma...@gmail.com Authored: Sat Nov 1 11:22:46 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Sat Nov 1 11:59:39 2014 -0700

svn commit: r1632873 [2/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2014-10-18 Thread matei
Modified: spark/site/releases/spark-release-0-9-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-9-0.html?rev=1632873r1=1632872r2=1632873view=diff == ---

svn commit: r1631015 - in /spark: community.md site/community.html

2014-10-10 Thread matei
Author: matei Date: Sat Oct 11 03:42:52 2014 New Revision: 1631015 URL: http://svn.apache.org/r1631015 Log: Added Beijing meetup Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md?rev=1631015r1

git commit: [SPARK-3762] clear reference of SparkEnv after stop

2014-10-07 Thread matei
@gmail.com Authored: Tue Oct 7 12:06:12 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Tue Oct 7 12:06:12 2014 -0700 -- .../main/scala/org/apache/spark/SparkEnv.scala | 19 --- .../org

git commit: [SPARK-3356] [DOCS] Document when RDD elements' ordering within partitions is nondeterministic

2014-09-30 Thread matei
/ab6dd80b Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ab6dd80b Branch: refs/heads/master Commit: ab6dd80ba0f7e1042ea270d10400109a467fe40e Parents: 157e7d0 Author: Sean Owen so...@cloudera.com Authored: Tue Sep 30 11:15:38 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed

git commit: [SPARK-3032][Shuffle] Fix key comparison integer overflow introduced sorting exception

2014-09-29 Thread matei
) Signed-off-by: Matei Zaharia ma...@databricks.com Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/df5a62f5 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/df5a62f5 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff

git commit: [SPARK-3389] Add Converter for ease of Parquet reading in PySpark

2014-09-27 Thread matei
Laserson laser...@cloudera.com Authored: Sat Sep 27 21:48:05 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Sat Sep 27 21:48:05 2014 -0700 -- examples/src/main/python/parquet_inputformat.py | 59

git commit: SPARK-2745 [STREAMING] Add Java friendly methods to Duration class

2014-09-23 Thread matei
-us.apache.org/repos/asf/spark/tree/e73b48ac Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e73b48ac Branch: refs/heads/master Commit: e73b48ace0a7e0f249221240140235d33eeac36b Parents: 3b8eefa Author: Sean Owen so...@cloudera.com Authored: Tue Sep 23 11:58:05 2014 -0700 Committer: Matei Zaharia ma

git commit: [SPARK-3394] [SQL] Fix crash in TakeOrdered when limit is 0

2014-09-07 Thread matei
-us.apache.org/repos/asf/spark/tree/6754570d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/6754570d Branch: refs/heads/master Commit: 6754570d83044c4fbaf0d2ac2378a0e081a93629 Parents: 3fb57a0 Author: Eric Liang e...@google.com Authored: Sun Sep 7 17:57:59 2014 -0700 Committer: Matei

git commit: SPARK-3211 .take() is OOM-prone with empty partitions

2014-09-05 Thread matei
/ba5bcadd Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ba5bcadd Branch: refs/heads/master Commit: ba5bcaddecd54811d45c5fc79a013b3857d4c633 Parents: 7ff8c45 Author: Andrew Ash and...@andrewash.com Authored: Fri Sep 5 18:52:05 2014 -0700 Committer: Matei Zaharia ma...@databricks.com

git commit: Manually close old PR

2014-09-04 Thread matei
/tree/0fdf2f5a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0fdf2f5a Branch: refs/heads/master Commit: 0fdf2f5a18d88a600ca1ab7b4bf02fb0537e9411 Parents: dc1ba9e Author: Matei Zaharia ma...@databricks.com Authored: Thu Sep 4 17:47:16 2014 -0700 Committer: Matei Zaharia ma...@databricks.com

git commit: Manually close old PR

2014-09-04 Thread matei
/tree/90b17a70 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/90b17a70 Branch: refs/heads/master Commit: 90b17a70c703c403d397e24cfbc20da22a32102d Parents: 0fdf2f5 Author: Matei Zaharia ma...@databricks.com Authored: Thu Sep 4 17:51:14 2014 -0700 Committer: Matei Zaharia ma...@databricks.com

git commit: SPARK-3052. Misleading and spurious FileSystem closed errors whenever a ...

2014-09-02 Thread matei
-us.apache.org/repos/asf/spark/tree/81b9d5b6 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/81b9d5b6 Branch: refs/heads/master Commit: 81b9d5b628229ed69aa9dae45ec4c94068dcd71e Parents: 066f31a Author: Sandy Ryza sa...@cloudera.com Authored: Tue Sep 2 11:34:55 2014 -0700 Committer: Matei

git commit: [SPARK-3342] Add SSDs to block device mapping

2014-09-01 Thread matei
-us.apache.org/repos/asf/spark/diff/44d3a6a7 Branch: refs/heads/master Commit: 44d3a6a75209370b1648e2dfedaa4c895923dae5 Parents: db16067 Author: Daniel Darabos darabos.dan...@gmail.com Authored: Mon Sep 1 22:14:28 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Mon Sep 1 22:16:42 2014 -0700

git commit: [SPARK-3342] Add SSDs to block device mapping

2014-09-01 Thread matei
-us.apache.org/repos/asf/spark/diff/e1363129 Branch: refs/heads/branch-1.1 Commit: e136312913517f0e2cbce3742076e955fc237c42 Parents: 865e6f6 Author: Daniel Darabos darabos.dan...@gmail.com Authored: Mon Sep 1 22:14:28 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Mon Sep 1 22:18:21

git commit: [SPARK-3010] fix redundant conditional

2014-08-31 Thread matei
2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Sun Aug 31 14:02:11 2014 -0700 -- .../main/scala/org/apache/spark/SecurityManager.scala | 4 ++-- .../apache/spark/rdd/PartitionPruningRDDSuite.scala| 13

git commit: [SPARK-2889] Create Hadoop config objects consistently.

2014-08-30 Thread matei
: b6cf1348170951396a6a5d8a65fb670382304f5b Parents: d90434c Author: Marcelo Vanzin van...@cloudera.com Authored: Sat Aug 30 14:48:07 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Sat Aug 30 14:48:07 2014 -0700 -- .../scala/org/apache/spark

git commit: SPARK-3318: Documentation update in addFile on how to use SparkFiles.get

2014-08-30 Thread matei
/spark/diff/ba78383b Branch: refs/heads/master Commit: ba78383bace52b13ee931c6f2df445f721d5080a Parents: b6cf134 Author: Holden Karau hol...@pigscanfly.ca Authored: Sat Aug 30 16:58:17 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Sat Aug 30 16:58:17 2014 -0700

git commit: [SPARK-3239] [PySpark] randomize the dirs for each process

2014-08-27 Thread matei
: http://git-wip-us.apache.org/repos/asf/spark/diff/092121e4 Branch: refs/heads/branch-1.1 Commit: 092121e477bcd2e474440dbdfdfa69cbd15c4803 Parents: 8f8e2a4 Author: Davies Liu davies@gmail.com Authored: Wed Aug 27 10:40:35 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Wed Aug

git commit: [SPARK-3256] Added support for :cp jar that was broken in Scala 2.10.x for REPL

2014-08-27 Thread matei
...@us.ibm.com Authored: Wed Aug 27 13:01:11 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Wed Aug 27 13:01:11 2014 -0700 -- .../org/apache/spark/repl/SparkILoop.scala | 19 +++--- .../org/apache/spark

git commit: [SPARK-3271] delete unused methods in Utils

2014-08-27 Thread matei
/master Commit: b86277c13232c3e65ce6c6cf7f6ede6a00546485 Parents: 64d8ecb Author: scwf wangf...@huawei.com Authored: Wed Aug 27 19:44:26 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Wed Aug 27 19:44:30 2014 -0700

git commit: SPARK-3265 Allow using custom ipython executable with pyspark

2014-08-27 Thread matei
Authored: Wed Aug 27 19:47:33 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Wed Aug 27 19:47:33 2014 -0700 -- bin/pyspark | 2 +- 1 file changed, 1 insertion(+), 1 deletion

git commit: [SPARK-3225]Typo in script

2014-08-26 Thread matei
/heads/master Commit: 2ffd3290fe30c23df8da1efe153b84c23eb2e1cd Parents: f1e71d4 Author: WangTao barneystin...@aliyun.com Authored: Tue Aug 26 17:30:59 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Tue Aug 26 17:30:59 2014 -0700

git commit: [SPARK-3240] Adding known issue for MESOS-1688

2014-08-26 Thread matei
...@gmail.com Authored: Tue Aug 26 18:30:39 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Tue Aug 26 18:30:45 2014 -0700 -- docs/running-on-mesos.md | 2 ++ 1 file changed, 2 insertions

git commit: Manually close some old pull requests

2014-08-26 Thread matei
/ee91eb8c Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ee91eb8c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ee91eb8c Branch: refs/heads/master Commit: ee91eb8c53da84f8875fb5cec5820a6e189057b9 Parents: d834547 Author: Matei Zaharia ma...@databricks.com Authored: Tue Aug 26 19:29:54

git commit: Manually close old pull requests

2014-08-26 Thread matei
-us.apache.org/repos/asf/spark/tree/e70aff6c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e70aff6c Branch: refs/heads/master Commit: e70aff6c2d7f216060def0bd02be6a3d9017cd13 Parents: ee91eb8 Author: Matei Zaharia ma...@databricks.com Authored: Tue Aug 26 19:35:19 2014 -0700 Committer: Matei

svn commit: r1620493 [2/2] - in /spark: screencasts/_posts/ site/ site/news/ site/releases/ site/screencasts/

2014-08-25 Thread matei
Modified: spark/site/releases/spark-release-0-8-1.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-8-1.html?rev=1620493r1=1620492r2=1620493view=diff == ---

svn commit: r1620493 [1/2] - in /spark: screencasts/_posts/ site/ site/news/ site/releases/ site/screencasts/

2014-08-25 Thread matei
Author: matei Date: Tue Aug 26 01:53:10 2014 New Revision: 1620493 URL: http://svn.apache.org/r1620493 Log: Updated screecast links to work over HTTPS too Modified: spark/screencasts/_posts/2013-04-10-1-first-steps-with-spark.md spark/screencasts/_posts/2013-04-11-2-spark-documentation

git commit: [SPARK-2736] PySpark converter and example script for reading Avro files

2014-08-14 Thread matei
-by: Matei Zaharia ma...@databricks.com Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/72e730e9 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/72e730e9 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/72e730e9 Branch

git commit: replace println to log4j

2014-08-13 Thread matei
: fireflyc firef...@126.com Authored: Fri Jul 25 10:47:52 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Wed Aug 13 11:49:12 2014 -0700 -- .../apache/spark/streaming/receiver/ActorReceiver.scala | 12 +++- 1

git commit: [SPARK-2983] [PySpark] improve performance of sortByKey()

2014-08-13 Thread matei
:12 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Wed Aug 13 14:57:12 2014 -0700 -- python/pyspark/rdd.py | 47 +++--- 1 file changed, 24 insertions(+), 23 deletions

git commit: [SPARK-2983] [PySpark] improve performance of sortByKey()

2014-08-13 Thread matei
@gmail.com Closes #1898 from davies/sort and squashes the following commits: 0a9608b [Davies Liu] Merge branch 'master' into sort 1cf9565 [Davies Liu] improve performance of sortByKey() (cherry picked from commit 434bea1c002b597cff9db899da101490e1f1e9ed) Signed-off-by: Matei Zaharia ma

git commit: SPARK-2294: fix locality inversion bug in TaskManager

2014-08-06 Thread matei
Authored: Tue Aug 5 23:02:58 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Tue Aug 5 23:02:58 2014 -0700 -- .../apache/spark/scheduler/TaskLocality.scala | 2 +- .../spark/scheduler/TaskSchedulerImpl.scala

git commit: SPARK-2294: fix locality inversion bug in TaskManager

2014-08-06 Thread matei
in TaskSchedulerImpl c8c1de4 [CodingCat] simplify the patch be652ed [CodingCat] avoid unnecessary delay when we only have nopref tasks dee9e22 [CodingCat] fix locality inversion bug in TaskManager by moving nopref branch (cherry picked from commit 63bdb1f41b4895e3a9444f7938094438a94d3007) Signed-off-by: Matei

git commit: SPARK-2685. Update ExternalAppendOnlyMap to avoid buffer.remove()

2014-08-05 Thread matei
. Author: Matei Zaharia ma...@databricks.com Closes #1773 from mateiz/SPARK-2685 and squashes the following commits: 1ea028a [Matei Zaharia] Update comments in StreamBuffer and EAOM, and reuse ArrayBuffers eb1abfd [Matei Zaharia] Update ExternalAppendOnlyMap to avoid buffer.remove() (cherry picked

git commit: SPARK-2685. Update ExternalAppendOnlyMap to avoid buffer.remove()

2014-08-05 Thread matei
: Matei Zaharia ma...@databricks.com Closes #1773 from mateiz/SPARK-2685 and squashes the following commits: 1ea028a [Matei Zaharia] Update comments in StreamBuffer and EAOM, and reuse ArrayBuffers eb1abfd [Matei Zaharia] Update ExternalAppendOnlyMap to avoid buffer.remove() Project: http://git

git commit: SPARK-2711. Create a ShuffleMemoryManager to track memory for all spilling collections

2014-08-05 Thread matei
: Matei Zaharia ma...@databricks.com Closes #1707 from mateiz/spark-2711 and squashes the following commits: debf75b [Matei Zaharia] Review comments 24f28f3 [Matei Zaharia] Small rename c8f3a8b [Matei Zaharia] Update ShuffleMemoryManager to be able to partially grant requests 315e3a5 [Matei

git commit: SPARK-2711. Create a ShuffleMemoryManager to track memory for all spilling collections

2014-08-05 Thread matei
: Matei Zaharia ma...@databricks.com Closes #1707 from mateiz/spark-2711 and squashes the following commits: debf75b [Matei Zaharia] Review comments 24f28f3 [Matei Zaharia] Small rename c8f3a8b [Matei Zaharia] Update ShuffleMemoryManager to be able to partially grant requests 315e3a5 [Matei Zaharia

git commit: SPARK-2792. Fix reading too much or too little data from each stream in ExternalMap / Sorter

2014-08-04 Thread matei
it as part of the next batch. There are also improvements to cleanup to make sure files are closed. In addition to bringing in the changes to ExternalAppendOnlyMap, I also copied them to the corresponding code in ExternalSorter and updated its test suite to test for the same issues. Author: Matei

git commit: SPARK-2792. Fix reading too much or too little data from each stream in ExternalMap / Sorter

2014-08-04 Thread matei
: Matei Zaharia ma...@databricks.com Closes #1722 from mateiz/spark-2792 and squashes the following commits: 5d4bfb5 [Matei Zaharia] Make objectStreamReset counter count the last object written too 18fe865 [Matei Zaharia] Update docs on objectStreamReset 576ee83 [Matei Zaharia] Allow objectStreamReset

git commit: SPARK-983. Support external sorting in sortByKey()

2014-08-01 Thread matei
Repository: spark Updated Branches: refs/heads/master 8ff4417f7 - 72e336997 SPARK-983. Support external sorting in sortByKey() This patch simply uses the ExternalSorter class from sort-based shuffle. Closes #931 and Closes #1090 Author: Matei Zaharia ma...@databricks.com Closes #1677 from

git commit: SPARK-2134: Report metrics before application finishes

2014-08-01 Thread matei
/f1957e11 Branch: refs/heads/master Commit: f1957e11652a537efd40771f843591a4c9341014 Parents: 72e3369 Author: Rahul Singhal rahul.sing...@guavus.com Authored: Fri Aug 1 00:33:15 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Fri Aug 1 00:33:15 2014 -0700

git commit: SPARK-1612: Fix potential resource leaks

2014-08-01 Thread matei
-us.apache.org/repos/asf/spark/tree/f5d9bea2 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f5d9bea2 Branch: refs/heads/master Commit: f5d9bea20e0db22c09c1191ca44a6471de765739 Parents: baf9ce1 Author: zsxwing zsxw...@gmail.com Authored: Fri Aug 1 13:25:04 2014 -0700 Committer: Matei Zaharia ma

git commit: SPARK-2791: Fix committing, reverting and state tracking in shuffle file consolidation

2014-08-01 Thread matei
2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Fri Aug 1 13:57:19 2014 -0700 -- .../spark/shuffle/hash/HashShuffleWriter.scala | 14 ++-- .../spark/shuffle/sort/SortShuffleWriter.scala | 3 +- .../spark

git commit: [SPARK-2116] Load spark-defaults.conf from SPARK_CONF_DIR if set

2014-08-01 Thread matei
://git-wip-us.apache.org/repos/asf/spark/tree/0da07da5 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0da07da5 Branch: refs/heads/master Commit: 0da07da53e5466ec44c8050020cbc4b9957cb949 Parents: 3822f33 Author: Albert Chu ch...@llnl.gov Authored: Fri Aug 1 19:00:38 2014 -0700 Committer: Matei

git commit: [SPARK-2762] SparkILoop leaks memory in multi-repl configurations

2014-07-31 Thread matei
Authored: Thu Jul 31 10:25:40 2014 -0700 Committer: Matei Zaharia ma...@databricks.com Committed: Thu Jul 31 10:25:40 2014 -0700 -- .../org/apache/spark/repl/SparkILoop.scala | 39 ++-- 1 file changed, 20

  1   2   3   >