git commit: [SPARK-3747] TaskResultGetter could incorrectly abort a stage if it cannot get result for a specific task

2014-10-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master c5414b681 - eb43043f4 [SPARK-3747] TaskResultGetter could incorrectly abort a stage if it cannot get result for a specific task Author: Reynold Xin r...@apache.org Closes #2599 from rxin/SPARK-3747 and squashes the following commits:

git commit: [SPARK-3748] Log thread name in unit test logs

2014-10-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 7bf6cc970 - 3888ee2f3 [SPARK-3748] Log thread name in unit test logs Thread names are useful for correlating failures. Author: Reynold Xin r...@apache.org Closes #2600 from rxin/log4j and squashes the following commits: 83ffe88 [Reynold

git commit: [SPARK-3757] mvn clean doesn't delete some files

2014-10-01 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 3888ee2f3 - 0bfd3afb0 [SPARK-3757] mvn clean doesn't delete some files Added directory to be deleted into maven-clean-plugin in pom.xml. Author: Masayoshi TSUZUKI tsudu...@oss.nttdata.co.jp Closes #2613 from tsudukim/feature/SPARK-3757

git commit: [SPARK-3749] [PySpark] fix bugs in broadcast large closure of RDD

2014-10-01 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 0bfd3afb0 - abf588f47 [SPARK-3749] [PySpark] fix bugs in broadcast large closure of RDD 1. broadcast is triggle unexpected 2. fd is leaked in JVM (also leak in parallelize()) 3. broadcast is not unpersisted in JVM after RDD is not be used

git commit: SPARK-2626 [DOCS] Stop SparkContext in all examples

2014-10-01 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master abf588f47 - dcb2f73f1 SPARK-2626 [DOCS] Stop SparkContext in all examples Call SparkContext.stop() in all examples (and touch up minor nearby code style issues while at it) Author: Sean Owen so...@cloudera.com Closes #2575 from

git commit: [SPARK-3755][Core] Do not bind port 1 - 1024 to server in spark

2014-10-01 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.1 a7d2df42b - c8c3b49f2 [SPARK-3755][Core] Do not bind port 1 - 1024 to server in spark Non-root user use port 1- 1024 to start jetty server will get the exception java.net.SocketException: Permission denied, so not use these ports

git commit: [SPARK-3756] [Core]check exception is caused by an address-port collision properly

2014-10-01 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 6390aae4e - 2fedb5ddd [SPARK-3756] [Core]check exception is caused by an address-port collision properly Jetty server use MultiException to handle exceptions when start server refer

git commit: [SPARK-3756] [Core]check exception is caused by an address-port collision properly

2014-10-01 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 13f33cfff - b4f690d36 [SPARK-3756] [Core]check exception is caused by an address-port collision properly Jetty server use MultiException to handle exceptions when start server refer

git commit: Python SQL Example Code

2014-10-01 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master b81ee0b46 - 17333c7a3 Python SQL Example Code SQL example code for Python, as shown on [SQL Programming Guide](https://spark.apache.org/docs/1.0.2/sql-programming-guide.html) Author: jyotiska jyotiska...@gmail.com Closes #2521 from

git commit: [SPARK-3708][SQL] Backticks aren't handled correctly is aliases

2014-10-01 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master d61f2c15b - 3508ce8a5 [SPARK-3708][SQL] Backticks aren't handled correctly is aliases The below query gives error sql(SELECT k FROM (SELECT \`key\` AS \`k\` FROM src) a) It gives error because the aliases are not cleaned so it could not be

git commit: Revert [SPARK-3755][Core] Do not bind port 1 - 1024 to server in spark

2014-10-01 Thread pwendell
Repository: spark Updated Branches: refs/heads/master a31f4ff22 - 4e79970d3 Revert [SPARK-3755][Core] Do not bind port 1 - 1024 to server in spark This reverts commit 6390aae4eacbabfb1c53fb828b824f6a6518beff. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

git commit: [SPARK-3729][SQL] Do all hive session state initialization in lazy val

2014-10-01 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 4e79970d3 - 45e058ca4 [SPARK-3729][SQL] Do all hive session state initialization in lazy val This change avoids a NPE during context initialization when settings are present. Author: Michael Armbrust mich...@databricks.com Closes #2583

git commit: [SPARK-3704][SQL] Fix ColumnValue type for Short values in thrift server

2014-10-01 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 45e058ca4 - 1b9f0d67f [SPARK-3704][SQL] Fix ColumnValue type for Short values in thrift server case ```ShortType```, we should add short value to hive row. Int value may lead to some problems. Author: scwf wangf...@huawei.com Closes

git commit: SPARK-3638 | Forced a compatible version of http client in kinesis-asl profile

2014-10-01 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 24ee61625 - c52c231c7 SPARK-3638 | Forced a compatible version of http client in kinesis-asl profile This patch forces use of commons http client 4.2 in Kinesis-asl profile so that the AWS SDK does not run into dependency conflicts

git commit: [SPARK-3446] Expose underlying job ids in FutureAction.

2014-10-01 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 93861a5e8 - 29c351320 [SPARK-3446] Expose underlying job ids in FutureAction. FutureAction is the only type exposed through the async APIs, so for job IDs to be useful they need to be exposed there. The complication is that some async jobs