spark git commit: [SPARK-9350][SQL] Introduce an InternalRow generic getter that requires a DataType

2015-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master 41a7cdf85 -> 4a01bfc2a [SPARK-9350][SQL] Introduce an InternalRow generic getter that requires a DataType Currently UnsafeRow cannot support a generic getter. However, if the data type is known, we can support a generic getter. Author: R

spark git commit: [SPARK-8881] [SPARK-9260] Fix algorithm for scheduling executors on workers

2015-07-25 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 712e13bba -> a37796be7 [SPARK-8881] [SPARK-9260] Fix algorithm for scheduling executors on workers Current scheduling algorithm allocates one core at a time and in doing so ends up ignoring spark.executor.cores. As a result, when spar

spark git commit: [SPARK-8881] [SPARK-9260] Fix algorithm for scheduling executors on workers

2015-07-25 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master b1f4b4abf -> 41a7cdf85 [SPARK-8881] [SPARK-9260] Fix algorithm for scheduling executors on workers Current scheduling algorithm allocates one core at a time and in doing so ends up ignoring spark.executor.cores. As a result, when spark.co

spark git commit: [SPARK-9348][SQL] Remove apply method on InternalRow.

2015-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2c94d0f24 -> b1f4b4abf [SPARK-9348][SQL] Remove apply method on InternalRow. Author: Reynold Xin Closes #7665 from rxin/remove-row-apply and squashes the following commits: 0b43001 [Reynold Xin] support getString in UnsafeRow. 176d633 [R

svn commit: r1692669 - in /spark: index.md site/index.html

2015-07-25 Thread matei
Author: matei Date: Sat Jul 25 23:15:18 2015 New Revision: 1692669 URL: http://svn.apache.org/r1692669 Log: Homepage tweak Modified: spark/index.md spark/site/index.html Modified: spark/index.md URL: http://svn.apache.org/viewvc/spark/index.md?rev=1692669&r1=1692668&r2=1692669&view=diff

svn commit: r1692668 [2/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

2015-07-25 Thread matei
Modified: spark/site/releases/spark-release-0-8-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-8-0.html?rev=1692668&r1=1692667&r2=1692668&view=diff == --- spark/site/releases/spark-release-0-8

svn commit: r1692668 [1/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

2015-07-25 Thread matei
Author: matei Date: Sat Jul 25 23:10:48 2015 New Revision: 1692668 URL: http://svn.apache.org/r1692668 Log: Updates to SQL page Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site/examples.html s

svn commit: r1692667 - in /spark: community.md index.md site/community.html site/index.html

2015-07-25 Thread matei
Author: matei Date: Sat Jul 25 22:51:21 2015 New Revision: 1692667 URL: http://svn.apache.org/r1692667 Log: Updated with new meetups Modified: spark/community.md spark/index.md spark/site/community.html spark/site/index.html Modified: spark/community.md URL: http://svn.apache.or

spark git commit: [SPARK-9192][SQL] add initialization phase for nondeterministic expression

2015-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master e2ec018e3 -> 2c94d0f24 [SPARK-9192][SQL] add initialization phase for nondeterministic expression Currently nondeterministic expression is broken without a explicit initialization phase. Let me take `MonotonicallyIncreasingID` as an examp

spark git commit: [SPARK-9285] [SQL] Fixes Row/InternalRow conversion for HadoopFsRelation

2015-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master c980e20cf -> e2ec018e3 [SPARK-9285] [SQL] Fixes Row/InternalRow conversion for HadoopFsRelation This is a follow-up of #7626. It fixes `Row`/`InternalRow` conversion for data sources extending `HadoopFsRelation` with `needConversion` being

spark git commit: [SPARK-9304] [BUILD] Improve backwards compatibility of SPARK-8401

2015-07-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master 215713e19 -> c980e20cf [SPARK-9304] [BUILD] Improve backwards compatibility of SPARK-8401 Add back change-version-to-X.sh scripts, as wrappers for new script, for backwards compatibility Author: Sean Owen Closes #7639 from srowen/SPARK-

spark git commit: [SPARK-9334][SQL] Remove UnsafeRowConverter in favor of UnsafeProjection.

2015-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master f0ebab3f6 -> 215713e19 [SPARK-9334][SQL] Remove UnsafeRowConverter in favor of UnsafeProjection. The two are redundant. Once this patch is merged, I plan to remove the inbound conversions from unsafe aggregates. Author: Reynold Xin Clo

spark git commit: [SPARK-9336][SQL] Remove extra JoinedRows

2015-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master 723db13e0 -> f0ebab3f6 [SPARK-9336][SQL] Remove extra JoinedRows They were added to improve performance (so JIT can inline the JoinedRow calls). However, we can also just improve it by projecting output out to UnsafeRow in Tungsten varian

spark git commit: [Spark-8668][SQL] Adding expr to functions

2015-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master 19bcd6ab1 -> 723db13e0 [Spark-8668][SQL] Adding expr to functions Author: JD Author: Joseph Batchik Closes #7606 from JDrit/expr and squashes the following commits: ad7f607 [Joseph Batchik] fixing python linter error 9d6daea [Joseph Bat