[jira] [Commented] (SPARK-4921) Performance issue caused by TaskSetManager returning PROCESS_LOCAL for NO_PREF tasks

[ https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259562#comment-14259562 ] Apache Spark commented on SPARK-4921: - User 'sryza' has created a pull request for thi

[jira] [Updated] (SPARK-4585) Spark dynamic executor allocation shouldn't use maxExecutors as initial number

[ https://issues.apache.org/jira/browse/SPARK-4585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-4585: -- Summary: Spark dynamic executor allocation shouldn't use maxExecutors as initial number (was: Spark dyn

[jira] [Updated] (SPARK-4585) Spark dynamic executor allocation maxExecutors as initial number

[ https://issues.apache.org/jira/browse/SPARK-4585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-4585: -- Summary: Spark dynamic executor allocation maxExecutors as initial number (was: Spark dynamic scaling e

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259549#comment-14259549 ] Devan commented on SPARK-4631: -- Hi I like to work on adding mqtt unit test if no one already

[jira] [Commented] (SPARK-4977) spark-ec2 start resets all the spark/conf configurations

[ https://issues.apache.org/jira/browse/SPARK-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259538#comment-14259538 ] Noah Young commented on SPARK-4977: --- I like option 2. Just having conf/spark-defaults.co

[jira] [Resolved] (SPARK-4501) Create build/mvn to automatically download maven/zinc/scalac

[ https://issues.apache.org/jira/browse/SPARK-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4501. Resolution: Fixed Fix Version/s: 1.3.0 > Create build/mvn to automatically download m

[jira] [Updated] (SPARK-4501) Create build/mvn to automatically download maven/zinc/scalac

[ https://issues.apache.org/jira/browse/SPARK-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4501: --- Assignee: Brennon York (was: Prashant Sharma) > Create build/mvn to automatically download ma

[jira] [Commented] (SPARK-4389) Set akka.remote.netty.tcp.bind-hostname="0.0.0.0" so driver can be located behind NAT

[ https://issues.apache.org/jira/browse/SPARK-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259488#comment-14259488 ] Josh Rosen commented on SPARK-4389: --- I think it's something like that; currently, I thin

[jira] [Commented] (SPARK-4977) spark-ec2 start resets all the spark/conf configurations

[ https://issues.apache.org/jira/browse/SPARK-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259480#comment-14259480 ] Shivaram Venkataraman commented on SPARK-4977: -- I've run into this before too

[jira] [Updated] (SPARK-4978) Core dump when running any example with prebuilt Hadoop 2.4 binaries

[ https://issues.apache.org/jira/browse/SPARK-4978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amy Brown updated SPARK-4978: - Description: If I run either of these examples with the prebuilt Hadoop 2.4 binaries: ./bin/run-example S

[jira] [Updated] (SPARK-4978) Core dump when running any example with prebuilt Hadoop 2.4 binaries

[ https://issues.apache.org/jira/browse/SPARK-4978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amy Brown updated SPARK-4978: - Environment: JRE version: OpenJDK Runtime Environment (7.0_65-b32) (build 1.7.0_65-b32) Java VM: OpenJDK Z

[jira] [Created] (SPARK-4978) Core dump when running any example with prebuilt Hadoop 2.4 binaries

Amy Brown created SPARK-4978: Summary: Core dump when running any example with prebuilt Hadoop 2.4 binaries Key: SPARK-4978 URL: https://issues.apache.org/jira/browse/SPARK-4978 Project: Spark I

[jira] [Commented] (SPARK-4977) spark-ec2 start resets all the spark/conf configurations

[ https://issues.apache.org/jira/browse/SPARK-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259472#comment-14259472 ] Nicholas Chammas commented on SPARK-4977: - cc [~shivaram] > spark-ec2 start reset

[jira] [Created] (SPARK-4977) spark-ec2 start resets all the spark/conf configurations

Noah Young created SPARK-4977: - Summary: spark-ec2 start resets all the spark/conf configurations Key: SPARK-4977 URL: https://issues.apache.org/jira/browse/SPARK-4977 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259463#comment-14259463 ] Sean Owen commented on SPARK-2914: -- Is this a superset of SPARK-2722 or vice versa? > sp

[jira] [Commented] (SPARK-2722) Mechanism for escaping spark configs is not consistent

[ https://issues.apache.org/jira/browse/SPARK-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259459#comment-14259459 ] Sean Owen commented on SPARK-2722: -- The first escaping makes sense and is unavoidable sin

[jira] [Commented] (SPARK-4976) trust region Newton optimizer in mllib

[ https://issues.apache.org/jira/browse/SPARK-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259399#comment-14259399 ] Ching-Pei Lee commented on SPARK-4976: -- PR: https://github.com/apache/spark/pull/3815

[jira] [Commented] (SPARK-4976) trust region Newton optimizer in mllib

[ https://issues.apache.org/jira/browse/SPARK-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259400#comment-14259400 ] Apache Spark commented on SPARK-4976: - User 'leepei' has created a pull request for th

[jira] [Updated] (SPARK-4976) trust region Newton optimizer in mllib

[ https://issues.apache.org/jira/browse/SPARK-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ching-Pei Lee updated SPARK-4976: - Component/s: MLlib > trust region Newton optimizer in mllib >

[jira] [Created] (SPARK-4976) trust region Newton optimizer in mllib

Ching-Pei Lee created SPARK-4976: Summary: trust region Newton optimizer in mllib Key: SPARK-4976 URL: https://issues.apache.org/jira/browse/SPARK-4976 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-4975) HiveInspectorSuite test failure

[ https://issues.apache.org/jira/browse/SPARK-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259370#comment-14259370 ] Apache Spark commented on SPARK-4975: - User 'scwf' has created a pull request for this

[jira] [Created] (SPARK-4975) HiveInspectorSuite test failure

wangfei created SPARK-4975: -- Summary: HiveInspectorSuite test failure Key: SPARK-4975 URL: https://issues.apache.org/jira/browse/SPARK-4975 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259341#comment-14259341 ] Andy Petrella commented on SPARK-4923: -- Thanks [~pwendell], when done, I'll start sup

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259323#comment-14259323 ] Sean Owen commented on SPARK-1529: -- This may be a dumb question on an old issue, but: you

[jira] [Commented] (SPARK-4963) SchemaRDD.sample may return wrong results

[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259313#comment-14259313 ] Cheng Lian commented on SPARK-4963: --- [~yanboliang] Unfortunately I don't have the privil

[jira] [Updated] (SPARK-4699) Make caseSensitive configurable in Analyzer.scala

[ https://issues.apache.org/jira/browse/SPARK-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4699: --- Fix Version/s: (was: 1.3.0) > Make caseSensitive configurable in Analyzer.scala >

[jira] [Commented] (SPARK-4574) Adding support for defining schema in foreign DDL commands.

[ https://issues.apache.org/jira/browse/SPARK-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259311#comment-14259311 ] Patrick Wendell commented on SPARK-4574: [~scwf] when creating issues please to no

[jira] [Updated] (SPARK-4574) Adding support for defining schema in foreign DDL commands.

[ https://issues.apache.org/jira/browse/SPARK-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4574: --- Fix Version/s: (was: 1.3.0) > Adding support for defining schema in foreign DDL commands.

[jira] [Updated] (SPARK-4559) Adding support for ucase and lcase

[ https://issues.apache.org/jira/browse/SPARK-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4559: --- Fix Version/s: (was: 1.3.0) > Adding support for ucase and lcase > ---

[jira] [Updated] (SPARK-4553) query for parquet table with string fields in spark sql hive get binary result

[ https://issues.apache.org/jira/browse/SPARK-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4553: --- Fix Version/s: (was: 1.3.0) > query for parquet table with string fields in spark sql hive

[jira] [Commented] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259310#comment-14259310 ] Patrick Wendell commented on SPARK-4422: [~mengxr] so should we just close this an

[jira] [Updated] (SPARK-4449) specify port range in spark

[ https://issues.apache.org/jira/browse/SPARK-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4449: --- Fix Version/s: (was: 1.3.0) > specify port range in spark > --- >

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4422: --- Fix Version/s: 1.2.0 > In some cases, Vectors.fromBreeze get wrong results. >

[jira] [Updated] (SPARK-4355) OnlineSummarizer doesn't merge mean correctly

[ https://issues.apache.org/jira/browse/SPARK-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4355: --- Labels: backport-needed (was: ) > OnlineSummarizer doesn't merge mean correctly > ---

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4422: --- Fix Version/s: (was: 1.3.0) > In some cases, Vectors.fromBreeze get wrong results. > -

[jira] [Updated] (SPARK-4261) make right version info for beeline

[ https://issues.apache.org/jira/browse/SPARK-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4261: --- Fix Version/s: (was: 1.3.0) > make right version info for beeline > --

[jira] [Updated] (SPARK-4355) OnlineSummarizer doesn't merge mean correctly

[ https://issues.apache.org/jira/browse/SPARK-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4355: --- Fix Version/s: (was: 1.3.0) 1.2.0 > OnlineSummarizer doesn't merge mean

[jira] [Updated] (SPARK-4362) Make prediction probability available in NaiveBayesModel

[ https://issues.apache.org/jira/browse/SPARK-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4362: --- Fix Version/s: (was: 1.3.0) > Make prediction probability available in NaiveBayesModel > -

[jira] [Updated] (SPARK-4258) NPE with new Parquet Filters

[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4258: --- Fix Version/s: 1.2.0 > NPE with new Parquet Filters > > >

[jira] [Updated] (SPARK-4237) Generate right Manifest File for maven building

[ https://issues.apache.org/jira/browse/SPARK-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4237: --- Target Version/s: (was: 1.2.0) > Generate right Manifest File for maven building > -

[jira] [Updated] (SPARK-4231) Add RankingMetrics to examples.MovieLensALS

[ https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4231: --- Fix Version/s: (was: 1.3.0) > Add RankingMetrics to examples.MovieLensALS > --

[jira] [Resolved] (SPARK-4258) NPE with new Parquet Filters

[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4258. Resolution: Fixed > NPE with new Parquet Filters > > >

[jira] [Updated] (SPARK-4231) Add RankingMetrics to examples.MovieLensALS

[ https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4231: --- Target Version/s: 1.3.0 (was: 1.2.0) > Add RankingMetrics to examples.MovieLensALS >

[jira] [Updated] (SPARK-4237) Generate right Manifest File for maven building

[ https://issues.apache.org/jira/browse/SPARK-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4237: --- Fix Version/s: (was: 1.3.0) > Generate right Manifest File for maven building > --

[jira] [Updated] (SPARK-4258) NPE with new Parquet Filters

[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4258: --- Fix Version/s: (was: 1.3.0) > NPE with new Parquet Filters >

[jira] [Updated] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

[ https://issues.apache.org/jira/browse/SPARK-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4180: --- Fix Version/s: (was: 1.3.0) 1.2.0 > SparkContext constructor should thr

[jira] [Updated] (SPARK-4184) Improve Spark Streaming documentation

[ https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4184: --- Fix Version/s: (was: 1.3.0) > Improve Spark Streaming documentation >

[jira] [Resolved] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4006. Resolution: Fixed Target Version/s: 1.2.0, 1.1.1, 1.0.3 (was: 1.1.1, 1.2.0, 1.0.3)

[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4006: --- Fix Version/s: (was: 1.3.0) 1.2.0 > Spark Driver crashes whenever an Ex