[jira] [Updated] (SPARK-7150) Facilitate random column generation for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7150: - Issue Type: New Feature (was: Improvement) > Facilitate random column generation for Data

[jira] [Created] (SPARK-7150) Facilitate random column generation for DataFrames

Joseph K. Bradley created SPARK-7150: Summary: Facilitate random column generation for DataFrames Key: SPARK-7150 URL: https://issues.apache.org/jira/browse/SPARK-7150 Project: Spark Issu

[jira] [Created] (SPARK-7149) Defalt system alias problem

haiyang created SPARK-7149: -- Summary: Defalt system alias problem Key: SPARK-7149 URL: https://issues.apache.org/jira/browse/SPARK-7149 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-5288) Stabilize Spark SQL data type API followup

[ https://issues.apache.org/jira/browse/SPARK-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512914#comment-14512914 ] Joseph K. Bradley commented on SPARK-5288: -- Just linked a JIRA I made (but will c

[jira] [Closed] (SPARK-6176) Expose abstract DataTypes for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-6176. Resolution: Duplicate > Expose abstract DataTypes for DataFrames > -

[jira] [Commented] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512913#comment-14512913 ] Apache Spark commented on SPARK-6954: - User 'sryza' has created a pull request for thi

[jira] [Updated] (SPARK-6176) Expose abstract DataTypes for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6176: - Priority: Minor (was: Major) > Expose abstract DataTypes for DataFrames > ---

[jira] [Updated] (SPARK-6176) Expose abstract DataTypes for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6176: - Affects Version/s: (was: 1.3.0) > Expose abstract DataTypes for DataFrames > -

[jira] [Updated] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-6954: -- Summary: ExecutorAllocationManager can end up requesting a negative number of executors (was: Dynamic a

[jira] [Updated] (SPARK-6176) Expose abstract DataTypes for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6176: - Target Version/s: (was: 1.4.0) > Expose abstract DataTypes for DataFrames >

[jira] [Updated] (SPARK-7032) SparkSQL incorrect results when using UNION/EXCEPT with GROUP BY clause

[ https://issues.apache.org/jira/browse/SPARK-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lior Chaga updated SPARK-7032: -- Description: When using UNION/EXCEPT clause with GROUP BY clause in spark sql, results do not mat

[jira] [Commented] (SPARK-6970) Document what the options: Map[String, String] does on DataFrame.save and DataFrame.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512909#comment-14512909 ] Joseph K. Bradley commented on SPARK-6970: -- This should be done, but I'll downgra

[jira] [Updated] (SPARK-6970) Document what the options: Map[String, String] does on DataFrame.save and DataFrame.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6970: - Priority: Trivial (was: Minor) > Document what the options: Map[String, String] does on D

[jira] [Updated] (SPARK-6970) Document what the options: Map[String, String] does on DataFrame.save and DataFrame.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6970: - Issue Type: Sub-task (was: Documentation) Parent: SPARK-6116 > Document what the

[jira] [Updated] (SPARK-6970) Document what the options: Map[String, String] does on DataFrame.save and DataFrame.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6970: - Priority: Minor (was: Major) > Document what the options: Map[String, String] does on Dat

[jira] [Updated] (SPARK-7032) SparkSQL incorrect results when using UNION/EXCEPT with GROUP BY clause

[ https://issues.apache.org/jira/browse/SPARK-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lior Chaga updated SPARK-7032: -- Description: When using UNION/EXCEPT clause with GROUP BY clause in spark sql, results do not match exp

[jira] [Commented] (SPARK-7116) Intermediate RDD cached but never unpersisted

[ https://issues.apache.org/jira/browse/SPARK-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512908#comment-14512908 ] Joseph K. Bradley commented on SPARK-7116: -- [~davies] Is there any good way to fi

[jira] [Updated] (SPARK-7116) Intermediate RDD cached but never unpersisted

[ https://issues.apache.org/jira/browse/SPARK-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7116: - Component/s: SQL > Intermediate RDD cached but never unpersisted > ---

[jira] [Commented] (SPARK-5023) In Web UI job history, the total job duration is incorrect (much smaller than the sum of its stages)

[ https://issues.apache.org/jira/browse/SPARK-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512869#comment-14512869 ] Eran Medan commented on SPARK-5023: --- I don't think this is a duplicate, the information

[jira] [Created] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

Joseph K. Bradley created SPARK-7148: Summary: Configure Parquet block size (row group size) for ML model import/export Key: SPARK-7148 URL: https://issues.apache.org/jira/browse/SPARK-7148 Projec

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512843#comment-14512843 ] Debasish Das commented on SPARK-5992: - Did someone compared algebird LSH with spark mi

[jira] [Created] (SPARK-7147) Enforce Params.validate by making it abstract

Joseph K. Bradley created SPARK-7147: Summary: Enforce Params.validate by making it abstract Key: SPARK-7147 URL: https://issues.apache.org/jira/browse/SPARK-7147 Project: Spark Issue Typ

[jira] [Created] (SPARK-7146) Should ML sharedParams be a public API?

Joseph K. Bradley created SPARK-7146: Summary: Should ML sharedParams be a public API? Key: SPARK-7146 URL: https://issues.apache.org/jira/browse/SPARK-7146 Project: Spark Issue Type: Bra

[jira] [Resolved] (SPARK-6779) Move shared params to param.shared and use code gen

[ https://issues.apache.org/jira/browse/SPARK-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6779. -- Resolution: Fixed Fix Version/s: 1.4.0 > Move shared params to param.shared and u

[jira] [Updated] (SPARK-6779) Move shared params to param.shared and use code gen

[ https://issues.apache.org/jira/browse/SPARK-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6779: - Assignee: Xiangrui Meng > Move shared params to param.shared and use code gen > --

[jira] [Resolved] (SPARK-7000) spark.ml Prediction abstractions should reside in ml.prediction subpackage

[ https://issues.apache.org/jira/browse/SPARK-7000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7000. -- Resolution: Not A Problem > spark.ml Prediction abstractions should reside in ml.predict

[jira] [Commented] (SPARK-7000) spark.ml Prediction abstractions should reside in ml.prediction subpackage

[ https://issues.apache.org/jira/browse/SPARK-7000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512828#comment-14512828 ] Joseph K. Bradley commented on SPARK-7000: -- Decision after conferring with [~meng

[jira] [Commented] (SPARK-7141) saveAsTextFile() on S3 first creates empty prefix

[ https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512794#comment-14512794 ] Eric O. LEBIGOT (EOL) commented on SPARK-7141: -- Ah, thanks: it's good to know

[jira] [Updated] (SPARK-7141) saveAsTextFile() on S3 first creates empty prefix

[ https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric O. LEBIGOT (EOL) updated SPARK-7141: - Description: Using {{saveAsTextFile("s3://bucket/prefix"}} actually adds an empty

[jira] [Commented] (SPARK-7143) Add BM25 Estimator

[ https://issues.apache.org/jira/browse/SPARK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512765#comment-14512765 ] Joseph K. Bradley commented on SPARK-7143: -- Do you have some references to recent

[jira] [Resolved] (SPARK-6989) Spark 1.3 REPL for Scala 2.11 (2.11.2) fails to start, emitting various arcane compiler errors

[ https://issues.apache.org/jira/browse/SPARK-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6989. -- Resolution: Cannot Reproduce > Spark 1.3 REPL for Scala 2.11 (2.11.2) fails to start, emitting various

[jira] [Resolved] (SPARK-7124) Add functions to check for file and directory existence

[ https://issues.apache.org/jira/browse/SPARK-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7124. -- Resolution: Not A Problem > Add functions to check for file and directory existence > --

[jira] [Resolved] (SPARK-7092) Update spark scala version to 2.11.6

[ https://issues.apache.org/jira/browse/SPARK-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7092. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5662 [https://github.com/ap

[jira] [Updated] (SPARK-5498) [SPARK-SQL]when the partition schema does not match table schema,it throws java.lang.ClassCastException and so on

[ https://issues.apache.org/jira/browse/SPARK-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5498: - Assignee: jeanlyn > [SPARK-SQL]when the partition schema does not match table schema,it throws > java.lan

[jira] [Updated] (SPARK-911) Support map pruning on sorted (K, V) RDD's

[ https://issues.apache.org/jira/browse/SPARK-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-911: Assignee: Aaron > Support map pruning on sorted (K, V) RDD's > -- > >

[jira] [Updated] (SPARK-5277) SparkSqlSerializer does not register user specified KryoRegistrators

[ https://issues.apache.org/jira/browse/SPARK-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5277: - Assignee: Max Seiden > SparkSqlSerializer does not register user specified KryoRegistrators > ---

[jira] [Updated] (SPARK-5404) Statistic of Logical Plan is too aggresive

[ https://issues.apache.org/jira/browse/SPARK-5404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5404: - Assignee: Cheng Hao > Statistic of Logical Plan is too aggresive > ---

[jira] [Updated] (SPARK-5203) union with different decimal type report error

[ https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5203: - Assignee: guowei > union with different decimal type report error > --

[jira] [Updated] (SPARK-5068) When the path not found in the hdfs,we can't get the result

[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5068: - Assignee: dongxu > When the path not found in the hdfs,we can't get the result > -

[jira] [Updated] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

[ https://issues.apache.org/jira/browse/SPARK-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5626: - Assignee: Josh Rosen > Spurious test failures due to NullPointerException in EasyMock test code >

[jira] [Updated] (SPARK-5712) Semicolon at end of a comment line

[ https://issues.apache.org/jira/browse/SPARK-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5712: - Assignee: Adrian Wang > Semicolon at end of a comment line > -- > >

[jira] [Updated] (SPARK-5651) Support 'create db.table' in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-5651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5651: - Assignee: Yadong Qi > Support 'create db.table' in HiveContext >

[jira] [Updated] (SPARK-5722) Infer_schema_type incorrect for Integers in pyspark

[ https://issues.apache.org/jira/browse/SPARK-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5722: - Assignee: Don Drake > Infer_schema_type incorrect for Integers in pyspark > --

[jira] [Updated] (SPARK-5756) Analyzer should not throw scala.NotImplementedError for illegitimate sql

[ https://issues.apache.org/jira/browse/SPARK-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5756: - Assignee: Fei Wang > Analyzer should not throw scala.NotImplementedError for illegitimate sql > --

[jira] [Updated] (SPARK-5758) Use LongType as the default type for integers in JSON schema inference.

[ https://issues.apache.org/jira/browse/SPARK-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5758: - Assignee: Yin Huai > Use LongType as the default type for integers in JSON schema inference. > ---

[jira] [Updated] (SPARK-5789) Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing errors.

[ https://issues.apache.org/jira/browse/SPARK-5789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5789: - Assignee: Yin Huai > Throw a better error message if JsonRDD.parseJson encounters unrecoverable > parsing

[jira] [Updated] (SPARK-5794) add jar should return 0

[ https://issues.apache.org/jira/browse/SPARK-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5794: - Assignee: Adrian Wang > add jar should return 0 > --- > > Key: SPARK-5

[jira] [Updated] (SPARK-5780) The loggings of Python unittests are noisy and scaring in

[ https://issues.apache.org/jira/browse/SPARK-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5780: - Assignee: Davies Liu > The loggings of Python unittests are noisy and scaring in > --

[jira] [Updated] (SPARK-5817) UDTF column names didn't set properly

[ https://issues.apache.org/jira/browse/SPARK-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5817: - Assignee: Cheng Hao > UDTF column names didn't set properly > -- > >

[jira] [Updated] (SPARK-5824) CTAS should set null format in hive-0.13.1

[ https://issues.apache.org/jira/browse/SPARK-5824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5824: - Assignee: Adrian Wang > CTAS should set null format in hive-0.13.1 > -

[jira] [Updated] (SPARK-5840) HiveContext cannot be serialized due to tuple extraction

[ https://issues.apache.org/jira/browse/SPARK-5840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5840: - Assignee: Reynold Xin > HiveContext cannot be serialized due to tuple extraction > ---

[jira] [Updated] (SPARK-5833) Adds REFRESH TABLE command to refresh external data sources tables

[ https://issues.apache.org/jira/browse/SPARK-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5833: - Assignee: Cheng Lian > Adds REFRESH TABLE command to refresh external data sources tables > --

[jira] [Updated] (SPARK-5862) Only transformUp the given plan once in HiveMetastoreCatalog

[ https://issues.apache.org/jira/browse/SPARK-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5862: - Assignee: Liang-Chi Hsieh > Only transformUp the given plan once in HiveMetastoreCatalog > ---

[jira] [Updated] (SPARK-5852) Fail to convert a newly created empty metastore parquet table to a data source parquet table.

[ https://issues.apache.org/jira/browse/SPARK-5852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5852: - Assignee: Yin Huai > Fail to convert a newly created empty metastore parquet table to a data > source par

[jira] [Updated] (SPARK-5875) logical.Project should not be resolved if it contains aggregates or generators

[ https://issues.apache.org/jira/browse/SPARK-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5875: - Assignee: Yin Huai > logical.Project should not be resolved if it contains aggregates or generators >

[jira] [Updated] (SPARK-5926) [SQL] DataFrame.explain() return false result for DDL command

[ https://issues.apache.org/jira/browse/SPARK-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5926: - Assignee: Yanbo Liang > [SQL] DataFrame.explain() return false result for DDL command > --

[jira] [Updated] (SPARK-5909) Add a clearCache command to Spark SQL's cache manager

[ https://issues.apache.org/jira/browse/SPARK-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5909: - Assignee: Yin Huai > Add a clearCache command to Spark SQL's cache manager > -

[jira] [Updated] (SPARK-7107) Add parameter for zookeeper.znode.parent to hbase_inputformat.py

[ https://issues.apache.org/jira/browse/SPARK-7107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7107: --- Component/s: Examples > Add parameter for zookeeper.znode.parent to hbase_inputformat.py > ---

[jira] [Updated] (SPARK-5908) Hive udtf with single alias should be resolved correctly

[ https://issues.apache.org/jira/browse/SPARK-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5908: - Assignee: Liang-Chi Hsieh > Hive udtf with single alias should be resolved correctly > ---

[jira] [Updated] (SPARK-5911) Make Column.cast(to: String) support fixed precision and scale decimal type

[ https://issues.apache.org/jira/browse/SPARK-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5911: - Assignee: Yin Huai > Make Column.cast(to: String) support fixed precision and scale decimal type > ---

[jira] [Updated] (SPARK-5935) Accept MapType in the schema provided to a JSON dataset.

[ https://issues.apache.org/jira/browse/SPARK-5935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5935: - Assignee: Yin Huai > Accept MapType in the schema provided to a JSON dataset. > --

[jira] [Updated] (SPARK-7107) Add parameter for zookeeper.znode.parent to hbase_inputformat.py

[ https://issues.apache.org/jira/browse/SPARK-7107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7107: - Component/s: PySpark > Add parameter for zookeeper.znode.parent to hbase_inputformat.py >

[jira] [Updated] (SPARK-7111) Add a tracker to track the direct (receiver-less) streams

[ https://issues.apache.org/jira/browse/SPARK-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7111: - Component/s: Streaming > Add a tracker to track the direct (receiver-less) streams > -

[jira] [Updated] (SPARK-7112) Add a tracker to track the direct streams

[ https://issues.apache.org/jira/browse/SPARK-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7112: - Component/s: Streaming > Add a tracker to track the direct streams > -

[jira] [Updated] (SPARK-7113) Add the direct stream related information to the streaming listener and web UI

[ https://issues.apache.org/jira/browse/SPARK-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7113: - Component/s: Streaming > Add the direct stream related information to the streaming listener and web UI >

[jira] [Commented] (SPARK-7145) commons-lang (2.x) classes used instead of commons-lang3 (3.x); commons-io used without dependency

[ https://issues.apache.org/jira/browse/SPARK-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512719#comment-14512719 ] Apache Spark commented on SPARK-7145: - User 'srowen' has created a pull request for th

[jira] [Assigned] (SPARK-7145) commons-lang (2.x) classes used instead of commons-lang3 (3.x); commons-io used without dependency

[ https://issues.apache.org/jira/browse/SPARK-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7145: --- Assignee: Sean Owen (was: Apache Spark) > commons-lang (2.x) classes used instead of commons

[jira] [Assigned] (SPARK-7145) commons-lang (2.x) classes used instead of commons-lang3 (3.x); commons-io used without dependency

[ https://issues.apache.org/jira/browse/SPARK-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7145: --- Assignee: Apache Spark (was: Sean Owen) > commons-lang (2.x) classes used instead of commons

[jira] [Created] (SPARK-7145) commons-lang (2.x) classes used instead of commons-lang3 (3.x); commons-io used without dependency

Sean Owen created SPARK-7145: Summary: commons-lang (2.x) classes used instead of commons-lang3 (3.x); commons-io used without dependency Key: SPARK-7145 URL: https://issues.apache.org/jira/browse/SPARK-7145

[jira] [Resolved] (SPARK-6113) Stabilize DecisionTree and ensembles APIs

[ https://issues.apache.org/jira/browse/SPARK-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6113. -- Resolution: Fixed Issue resolved by pull request 5626 [https://github.com/apache/spark/pull/5626

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512649#comment-14512649 ] Marcelo Vanzin commented on SPARK-7108: --- The way I read the documentation, {{spark.l

[jira] [Commented] (SPARK-6752) Allow StreamingContext to be recreated from checkpoint and existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512620#comment-14512620 ] Sean Owen commented on SPARK-6752: -- It's an issue with the version of Commons Lang (2.x).

[jira] [Reopened] (SPARK-6752) Allow StreamingContext to be recreated from checkpoint and existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-6752: I had to revert this because it caused test failures with the Hadoop 1.0 build. To reproduce th

[jira] [Updated] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7108: --- Summary: spark.local.dir is no longer honored in Standalone mode (was: Setting spark.local.di

[jira] [Updated] (SPARK-5456) Decimal Type comparison issue

[ https://issues.apache.org/jira/browse/SPARK-5456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5456: Priority: Blocker (was: Major) Target Version/s: 1.4.0 > Decimal Type comparison issue > --

[jira] [Resolved] (SPARK-7144) SPARK-6784

[ https://issues.apache.org/jira/browse/SPARK-7144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7144. - Resolution: Invalid oops... > SPARK-6784 > -- > > Key: SPARK-7144 >

[jira] [Created] (SPARK-7144) SPARK-6784

Yin Huai created SPARK-7144: --- Summary: SPARK-6784 Key: SPARK-7144 URL: https://issues.apache.org/jira/browse/SPARK-7144 Project: Spark Issue Type: Sub-task Components: SQL Rep

[jira] [Assigned] (SPARK-7143) Add BM25 Estimator

[ https://issues.apache.org/jira/browse/SPARK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7143: --- Assignee: (was: Apache Spark) > Add BM25 Estimator > -- > >

[jira] [Commented] (SPARK-7143) Add BM25 Estimator

[ https://issues.apache.org/jira/browse/SPARK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512578#comment-14512578 ] Apache Spark commented on SPARK-7143: - User 'viirya' has created a pull request for th

[jira] [Assigned] (SPARK-7143) Add BM25 Estimator

[ https://issues.apache.org/jira/browse/SPARK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7143: --- Assignee: Apache Spark > Add BM25 Estimator > -- > > Key: SPA

[jira] [Created] (SPARK-7143) Add BM25 Estimator

Liang-Chi Hsieh created SPARK-7143: -- Summary: Add BM25 Estimator Key: SPARK-7143 URL: https://issues.apache.org/jira/browse/SPARK-7143 Project: Spark Issue Type: New Feature Compon

[jira] [Commented] (SPARK-6980) Akka timeout exceptions indicate which conf controls them

[ https://issues.apache.org/jira/browse/SPARK-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512575#comment-14512575 ] Harsh Gupta commented on SPARK-6980: [~imranr] [~bryanc] Hi. I tried a simple exampl

[jira] [Commented] (SPARK-7141) saveAsTextFile() on S3 first creates empty prefix

[ https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512573#comment-14512573 ] Liang-Chi Hsieh commented on SPARK-7141: The double slash issue is caused by the J

[jira] [Assigned] (SPARK-7142) Minor enhancement to BooleanSimplification Optimizer rule

[ https://issues.apache.org/jira/browse/SPARK-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7142: --- Assignee: (was: Apache Spark) > Minor enhancement to BooleanSimplification Optimizer rule

[jira] [Commented] (SPARK-7142) Minor enhancement to BooleanSimplification Optimizer rule

[ https://issues.apache.org/jira/browse/SPARK-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512487#comment-14512487 ] Apache Spark commented on SPARK-7142: - User 'saucam' has created a pull request for th

[jira] [Assigned] (SPARK-7142) Minor enhancement to BooleanSimplification Optimizer rule

[ https://issues.apache.org/jira/browse/SPARK-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7142: --- Assignee: Apache Spark > Minor enhancement to BooleanSimplification Optimizer rule >

[jira] [Created] (SPARK-7142) Minor enhancement to BooleanSimplification Optimizer rule

Yash Datta created SPARK-7142: - Summary: Minor enhancement to BooleanSimplification Optimizer rule Key: SPARK-7142 URL: https://issues.apache.org/jira/browse/SPARK-7142 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2750) Add Https support for Web UI

[ https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-2750: Attachment: exception on yarn when https enabled.txt > Add Https support for Web UI > --

[jira] [Assigned] (SPARK-5891) Add Binarizer

[ https://issues.apache.org/jira/browse/SPARK-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5891: --- Assignee: Apache Spark > Add Binarizer > - > > Key: SPARK-5891 >

[jira] [Assigned] (SPARK-5891) Add Binarizer

[ https://issues.apache.org/jira/browse/SPARK-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5891: --- Assignee: (was: Apache Spark) > Add Binarizer > - > > Key: SP

[jira] [Commented] (SPARK-5891) Add Binarizer

[ https://issues.apache.org/jira/browse/SPARK-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512361#comment-14512361 ] Apache Spark commented on SPARK-5891: - User 'viirya' has created a pull request for th

[jira] [Commented] (SPARK-7118) Add coalesce Spark SQL function to PySpark API

[ https://issues.apache.org/jira/browse/SPARK-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512320#comment-14512320 ] Apache Spark commented on SPARK-7118: - User 'ogirardot' has created a pull request for

[jira] [Assigned] (SPARK-6333) saveAsObjectFile support for compression codec

[ https://issues.apache.org/jira/browse/SPARK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6333: --- Assignee: Apache Spark > saveAsObjectFile support for compression codec > ---

[jira] [Assigned] (SPARK-6333) saveAsObjectFile support for compression codec

[ https://issues.apache.org/jira/browse/SPARK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6333: --- Assignee: (was: Apache Spark) > saveAsObjectFile support for compression codec >