[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4066: - Component/s: Build Make whether maven builds fails on scalastyle violation configurable

[jira] [Updated] (SPARK-4343) Mima considers protected API methods for exclusion from binary checks.

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4343: - Component/s: Build Priority: Minor (was: Major) Are you saying that it should or should not flag

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310118#comment-14310118 ] Sean Owen commented on SPARK-5654: -- (SGTM, that's good authoritative reasoning. I was

[jira] [Updated] (SPARK-1823) ExternalAppendOnlyMap can still OOM if one key is very large

2015-02-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1823: - Component/s: (was: PySpark) Spark Core ExternalAppendOnlyMap can still OOM if one

[jira] [Commented] (SPARK-1823) ExternalAppendOnlyMap can still OOM if one key is very large

2015-02-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310133#comment-14310133 ] Andrew Or commented on SPARK-1823: -- Hey [~srowen] this issue belongs more to the Core

[jira] [Resolved] (SPARK-5403) Ignore UserKnownHostsFile in SSH calls

2015-02-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5403. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4196

[jira] [Resolved] (SPARK-5633) pyspark saveAsTextFile support for compression codec

2015-02-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5633. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4403

[jira] [Updated] (SPARK-4205) Timestamp and Date objects with comparison operators

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4205: - Fix Version/s: (was: 1.1.0) Timestamp and Date objects with comparison operators

[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2914: - Fix Version/s: (was: 1.2.0) spark.*.extraJavaOptions are evaluated too many times

[jira] [Updated] (SPARK-4012) Uncaught OOM in ContextCleaner

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4012: - Fix Version/s: (was: 1.1.0) Uncaught OOM in ContextCleaner --

[jira] [Updated] (SPARK-1351) Documentation Improvements for Spark 1.0

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1351: - Fix Version/s: (was: 1.0.0) Documentation Improvements for Spark 1.0

[jira] [Updated] (SPARK-1155) Clean up and document use of SparkEnv

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1155: - Fix Version/s: (was: 1.0.0) Clean up and document use of SparkEnv

[jira] [Updated] (SPARK-3586) Support nested directories in Spark Streaming

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3586: - Fix Version/s: (was: 1.1.0) Support nested directories in Spark Streaming

[jira] [Updated] (SPARK-2153) CassandraTest fails for newer Cassandra due to case insensitive key space

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2153: - Fix Version/s: (was: 1.0.0) CassandraTest fails for newer Cassandra due to case insensitive key

[jira] [Updated] (SPARK-3917) Compress data before network transfer

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3917: - Fix Version/s: (was: 1.1.0) Compress data before network transfer

[jira] [Updated] (SPARK-1715) Ensure actor is self-contained in DAGScheduler

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1715: - Fix Version/s: (was: 1.0.1) Ensure actor is self-contained in DAGScheduler

[jira] [Updated] (SPARK-1928) DAGScheduler suspended by local task OOM

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1928: - Fix Version/s: (was: 1.0.0) DAGScheduler suspended by local task OOM

[jira] [Commented] (SPARK-5597) Model import/export for DecisionTree and ensembles

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310068#comment-14310068 ] Apache Spark commented on SPARK-5597: - User 'jkbradley' has created a pull request for

[jira] [Resolved] (SPARK-4996) Memory leak?

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4996. -- Resolution: Not a Problem Target Version/s: (was: 1.3.0, 1.2.1) Memory leak?

[jira] [Updated] (SPARK-5659) Flaky Test: org.apache.spark.streaming.ReceiverSuite.block

2015-02-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5659: --- Labels: flaky-test (was: ) Flaky Test: org.apache.spark.streaming.ReceiverSuite.block

[jira] [Commented] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

2015-02-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310266#comment-14310266 ] Josh Rosen commented on SPARK-5626: --- It's probably easiest to just replace our use of

[jira] [Updated] (SPARK-5660) Local Matrix apply should be public

2015-02-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5660: - Summary: Local Matrix apply should be public (was: DenseMatrix, SparseMatrix apply

[jira] [Updated] (SPARK-5660) Local Matrix apply should be public

2015-02-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5660: - Description: Matrix, DenseMatrix, SparseMatrix apply(i,j) should be public. Otherwise,

[jira] [Assigned] (SPARK-1061) allow Hadoop RDDs to be read w/ a partitioner

2015-02-06 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-1061: --- Assignee: Imran Rashid allow Hadoop RDDs to be read w/ a partitioner

[jira] [Commented] (SPARK-1061) allow Hadoop RDDs to be read w/ a partitioner

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310589#comment-14310589 ] Apache Spark commented on SPARK-1061: - User 'squito' has created a pull request for

[jira] [Commented] (SPARK-5660) Local Matrix apply should be public

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310237#comment-14310237 ] Apache Spark commented on SPARK-5660: - User 'jkbradley' has created a pull request for

[jira] [Commented] (SPARK-3454) Expose JSON representation of data shown in WebUI

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309969#comment-14309969 ] Apache Spark commented on SPARK-3454: - User 'squito' has created a pull request for

[jira] [Updated] (SPARK-1200) Make it possible to use unmanaged AM in yarn-client mode

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1200: - Component/s: YARN Make it possible to use unmanaged AM in yarn-client mode

[jira] [Updated] (SPARK-2765) While running Spark through YARN Control Containers logging.

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2765: - Component/s: YARN While running Spark through YARN Control Containers logging.

[jira] [Updated] (SPARK-1823) ExternalAppendOnlyMap can still OOM if one key is very large

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1823: - Component/s: PySpark ExternalAppendOnlyMap can still OOM if one key is very large

[jira] [Updated] (SPARK-3316) Spark driver will not exit after python program finished

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3316: - Component/s: PySpark Spark driver will not exit after python program finished

[jira] [Updated] (SPARK-1159) Add Shortest-path computations to graphx.lib

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1159: - Component/s: GraphX Add Shortest-path computations to graphx.lib

[jira] [Updated] (SPARK-1270) An optimized gradient descent implementation

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1270: - Component/s: MLlib An optimized gradient descent implementation

[jira] [Updated] (SPARK-4591) Add algorithm/model wrappers in spark.ml to adapt the new API

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4591: - Component/s: ML Add algorithm/model wrappers in spark.ml to adapt the new API

[jira] [Commented] (SPARK-5533) Replace explicit dependency on org.codehaus.jackson

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310086#comment-14310086 ] Sean Owen commented on SPARK-5533: -- As far as I can tell, Spark only directly uses the

[jira] [Updated] (SPARK-3451) spark-submit should support specifying glob wildcards in the --jars CLI option

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3451: - Component/s: Spark Submit Priority: Minor (was: Major) spark-submit should support specifying

[jira] [Comment Edited] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

2015-02-06 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310130#comment-14310130 ] Sandy Ryza edited comment on SPARK-4550 at 2/6/15 11:08 PM: I

[jira] [Updated] (SPARK-2722) Mechanism for escaping spark configs is not consistent

2015-02-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2722: - Priority: Major (was: Minor) Mechanism for escaping spark configs is not consistent

[jira] [Commented] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

2015-02-06 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310130#comment-14310130 ] Sandy Ryza commented on SPARK-4550: --- I got a working prototype and benchmarked the

[jira] [Commented] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2015-02-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310131#comment-14310131 ] Andrew Or commented on SPARK-2914: -- I think these two describe the same issues, but the

[jira] [Closed] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2015-02-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2914. Resolution: Duplicate spark.*.extraJavaOptions are evaluated too many times

[jira] [Resolved] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

2015-02-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5388. Resolution: Fixed Fix Version/s: 1.3.0 Provide a stable application submission

[jira] [Commented] (SPARK-5661) function hasShutdownDeleteTachyonDir should use shutdownDeleteTachyonPaths to determine whether contains file

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310378#comment-14310378 ] Apache Spark commented on SPARK-5661: - User 'viper-kun' has created a pull request for

[jira] [Updated] (SPARK-5662) Flaky test: org.apache.spark.streaming.kafka.KafkaDirectStreamSuite.multi topic stream

2015-02-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5662: --- Priority: Critical (was: Major) Flaky test:

[jira] [Created] (SPARK-5662) Flaky test: org.apache.spark.streaming.kafka.KafkaDirectStreamSuite.multi topic stream

2015-02-06 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-5662: -- Summary: Flaky test: org.apache.spark.streaming.kafka.KafkaDirectStreamSuite.multi topic stream Key: SPARK-5662 URL: https://issues.apache.org/jira/browse/SPARK-5662

[jira] [Created] (SPARK-5661) function hasShutdownDeleteTachyonDir should use shutdownDeleteTachyonPaths to determine whether contains file

2015-02-06 Thread xukun (JIRA)
xukun created SPARK-5661: Summary: function hasShutdownDeleteTachyonDir should use shutdownDeleteTachyonPaths to determine whether contains file Key: SPARK-5661 URL: https://issues.apache.org/jira/browse/SPARK-5661

[jira] [Created] (SPARK-5663) Delete appStagingDir on local file system

2015-02-06 Thread Weizhong (JIRA)
Weizhong created SPARK-5663: --- Summary: Delete appStagingDir on local file system Key: SPARK-5663 URL: https://issues.apache.org/jira/browse/SPARK-5663 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

2015-02-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5613: - Target Version/s: 1.2.2, 1.4.0 (was: 1.2.0, 1.2.1, 1.2.2, 1.4.0) YarnClientSchedulerBackend fails to

[jira] [Resolved] (SPARK-2450) Provide link to YARN executor logs on UI

2015-02-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2450. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3486

[jira] [Updated] (SPARK-2654) Leveled logging in PySpark

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2654: Component/s: PySpark Leveled logging in PySpark --

[jira] [Updated] (SPARK-1346) Backport SPARK-1210 into 0.9 branch

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1346: Labels: backport-needed (was: ) Backport SPARK-1210 into 0.9 branch

[jira] [Updated] (SPARK-2064) web ui should not remove executors if they are dead

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2064: Component/s: Web UI web ui should not remove executors if they are dead

[jira] [Updated] (SPARK-1927) Implicits declared in companion objects not found in Spark shell

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1927: Component/s: Spark Shell Implicits declared in companion objects not found in Spark shell

[jira] [Commented] (SPARK-1927) Implicits declared in companion objects not found in Spark shell

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309755#comment-14309755 ] Nicholas Chammas commented on SPARK-1927: - cc [~tobias.schlatter] Implicits

[jira] [Resolved] (SPARK-5640) org.apache.spark.sql.catalyst.ScalaReflection is not thread safe

2015-02-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5640. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4431

[jira] [Commented] (SPARK-5657) Add PySpark Avro Output Format example

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309856#comment-14309856 ] Apache Spark commented on SPARK-5657: - User 'staslos' has created a pull request for

[jira] [Resolved] (SPARK-3875) Add TEMP DIRECTORY configuration

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3875. -- Resolution: Won't Fix Per discussion in the PR, there are other ways to do this, and/or, issues in

[jira] [Created] (SPARK-5652) Use broadcasted weights and fix compilation error

2015-02-06 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-5652: -- Summary: Use broadcasted weights and fix compilation error Key: SPARK-5652 URL: https://issues.apache.org/jira/browse/SPARK-5652 Project: Spark Issue

[jira] [Commented] (SPARK-5648) support alter ... unset tblproperties(key)

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308845#comment-14308845 ] Apache Spark commented on SPARK-5648: - User 'DoingDone9' has created a pull request

[jira] [Commented] (SPARK-5651) Support 'create db.table' in HiveContext

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308915#comment-14308915 ] Apache Spark commented on SPARK-5651: - User 'watermen' has created a pull request for

[jira] [Commented] (SPARK-5396) Syntax error in spark scripts on windows.

2015-02-06 Thread Masayoshi TSUZUKI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308967#comment-14308967 ] Masayoshi TSUZUKI commented on SPARK-5396: -- This seems to be caused by a simple

[jira] [Commented] (SPARK-5652) Use broadcasted weights and fix compilation error

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309041#comment-14309041 ] Apache Spark commented on SPARK-5652: - User 'viirya' has created a pull request for

[jira] [Updated] (SPARK-5582) History server does not list anything if log root contains an empty directory

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5582: - Component/s: Spark Core Priority: Minor (was: Major) Affects Version/s: 1.3.0

[jira] [Resolved] (SPARK-5470) use defaultClassLoader of Serializer to load classes of classesToRegister in KryoSerializer

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5470. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4258

[jira] [Created] (SPARK-5649) Throw exception when can not apply datatype cast

2015-02-06 Thread wangfei (JIRA)
wangfei created SPARK-5649: -- Summary: Throw exception when can not apply datatype cast Key: SPARK-5649 URL: https://issues.apache.org/jira/browse/SPARK-5649 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-02-06 Thread Masayoshi TSUZUKI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309003#comment-14309003 ] Masayoshi TSUZUKI commented on SPARK-5389: -- I cannot reproduce this error on my

[jira] [Commented] (SPARK-4897) Python 3 support

2015-02-06 Thread Ian Ozsvald (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308901#comment-14308901 ] Ian Ozsvald commented on SPARK-4897: Hi Josh. After my post I went to do some digging,

[jira] [Commented] (SPARK-5396) Syntax error in spark scripts on windows.

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308940#comment-14308940 ] Apache Spark commented on SPARK-5396: - User 'tsudukim' has created a pull request for

[jira] [Resolved] (SPARK-5582) History server does not list anything if log root contains an empty directory

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5582. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4352

[jira] [Updated] (SPARK-5157) Configure more JVM options properly when we use ConcMarkSweepGC for AM.

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5157: - Target Version/s: (was: 1.3.0) Assignee: Kousuke Saruta Configure more JVM options

[jira] [Resolved] (SPARK-5157) Configure more JVM options properly when we use ConcMarkSweepGC for AM.

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5157. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 3956

[jira] [Updated] (SPARK-5470) use defaultClassLoader of Serializer to load classes of classesToRegister in KryoSerializer

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5470: - Assignee: Lianhui Wang use defaultClassLoader of Serializer to load classes of classesToRegister in

[jira] [Created] (SPARK-5653) in ApplicationMaster rename isDriver to isClusterMode

2015-02-06 Thread Lianhui Wang (JIRA)
Lianhui Wang created SPARK-5653: --- Summary: in ApplicationMaster rename isDriver to isClusterMode Key: SPARK-5653 URL: https://issues.apache.org/jira/browse/SPARK-5653 Project: Spark Issue

[jira] [Updated] (SPARK-5653) in ApplicationMaster rename isDriver to isClusterMode

2015-02-06 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-5653: Component/s: YARN in ApplicationMaster rename isDriver to isClusterMode

[jira] [Commented] (SPARK-5653) in ApplicationMaster rename isDriver to isClusterMode

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309191#comment-14309191 ] Apache Spark commented on SPARK-5653: - User 'lianhuiwang' has created a pull request

[jira] [Resolved] (SPARK-5481) JdbcRDD requires JDBC 4 APIs, limiting compatible JDBC Drivers

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5481. -- Resolution: Duplicate OK, I buy it, especially since the a redundant close() is a no-op. I'll follow

[jira] [Resolved] (SPARK-5380) There will be an ArrayIndexOutOfBoundsException if the format of the source file is wrong

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5380. -- Resolution: Fixed Fix Version/s: (was: 1.2.0) 1.3.0 Target

[jira] [Commented] (SPARK-5649) Throw exception when can not apply datatype cast

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308893#comment-14308893 ] Apache Spark commented on SPARK-5649: - User 'scwf' has created a pull request for this

[jira] [Resolved] (SPARK-5416) Initialize Executor.threadPool before ExecutorSource

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5416. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4212

[jira] [Updated] (SPARK-5416) Initialize Executor.threadPool before ExecutorSource

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5416: - Assignee: Ryan Williams Issue Type: Bug (was: Improvement) Initialize Executor.threadPool before

[jira] [Comment Edited] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

2015-02-06 Thread Alex Rothberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309316#comment-14309316 ] Alex Rothberg edited comment on SPARK-5637 at 2/6/15 3:26 PM: --

[jira] [Commented] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309322#comment-14309322 ] Sean Owen commented on SPARK-5637: -- Same could be done for Bigtop and Whirr. Since this

[jira] [Commented] (SPARK-4279) Implementing TinkerPop on top of GraphX

2015-02-06 Thread Brennon York (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309445#comment-14309445 ] Brennon York commented on SPARK-4279: - [~srowen] I had created this before we started

[jira] [Resolved] (SPARK-4279) Implementing TinkerPop on top of GraphX

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4279. -- Resolution: Won't Fix Sounds good! at the least, it can begin outside and see what happens later.

[jira] [Commented] (SPARK-4279) Implementing TinkerPop on top of GraphX

2015-02-06 Thread Michael Malak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309459#comment-14309459 ] Michael Malak commented on SPARK-4279: -- Is there another place where I might be able

[jira] [Commented] (SPARK-4279) Implementing TinkerPop on top of GraphX

2015-02-06 Thread Brennon York (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309466#comment-14309466 ] Brennon York commented on SPARK-4279: - For reference here is the link to the

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

2015-02-06 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309462#comment-14309462 ] DeepakVohra commented on SPARK-5531: If the Select A Mirror option is selected the

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309480#comment-14309480 ] Sean Owen commented on SPARK-5531: -- The direct download link is

[jira] [Commented] (SPARK-5640) org.apache.spark.sql.catalyst.ScalaReflection is not thread safe

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309483#comment-14309483 ] Apache Spark commented on SPARK-5640: - User 'gzm0' has created a pull request for this

[jira] [Updated] (SPARK-5652) Use broadcasted weights in LogisticRegressionModel and fix compilation error

2015-02-06 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-5652: --- Summary: Use broadcasted weights in LogisticRegressionModel and fix compilation error (was:

[jira] [Resolved] (SPARK-3182) Twitter Streaming Geoloaction Filter

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3182. -- Resolution: Duplicate Target Version/s: (was: 1.3.0) Twitter Streaming Geoloaction Filter

[jira] [Resolved] (SPARK-4382) Add locations parameter to Twitter Stream

2015-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4382. -- Resolution: Duplicate Add locations parameter to Twitter Stream

[jira] [Commented] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

2015-02-06 Thread Alex Rothberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309316#comment-14309316 ] Alex Rothberg commented on SPARK-5637: -- The major benefits to developers would be to

[jira] [Comment Edited] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

2015-02-06 Thread Alex Rothberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309316#comment-14309316 ] Alex Rothberg edited comment on SPARK-5637 at 2/6/15 3:25 PM: --

[jira] [Commented] (SPARK-5363) Spark 1.2 freeze without error notification

2015-02-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309497#comment-14309497 ] Davies Liu commented on SPARK-5363: --- I tried it with hundreds of iterations (big

[jira] [Assigned] (SPARK-5601) Make streaming algorithms Java-friendly

2015-02-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-5601: Assignee: Xiangrui Meng Make streaming algorithms Java-friendly

[jira] [Commented] (SPARK-5601) Make streaming algorithms Java-friendly

2015-02-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309560#comment-14309560 ] Apache Spark commented on SPARK-5601: - User 'mengxr' has created a pull request for

[jira] [Updated] (SPARK-5652) Use broadcasted weights in LogisticRegressionModel and fix compilation error

2015-02-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5652: - Assignee: Liang-Chi Hsieh Use broadcasted weights in LogisticRegressionModel and fix compilation

[jira] [Created] (SPARK-5654) Integrate SparkR into Apache Spark

2015-02-06 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-5654: Summary: Integrate SparkR into Apache Spark Key: SPARK-5654 URL: https://issues.apache.org/jira/browse/SPARK-5654 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-5013) User guide for Gaussian Mixture Model

2015-02-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5013. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4401

<    1   2   3   >