[jira] [Assigned] (SPARK-21783) Turn on ORC filter push-down by default

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21783: Assignee: (was: Apache Spark) > Turn on ORC filter push-down by default >

[jira] [Assigned] (SPARK-21771) SparkSQLEnv creates a useless meta hive client

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21771: Assignee: (was: Apache Spark) > SparkSQLEnv creates a useless meta hive client >

[jira] [Assigned] (SPARK-19256) Hive bucketing support

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19256: Assignee: (was: Apache Spark) > Hive bucketing support > -- > >

[jira] [Assigned] (SPARK-21762) FileFormatWriter/BasicWriteTaskStatsTracker metrics collection fails if a new file isn't yet visible

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21762: Assignee: Apache Spark > FileFormatWriter/BasicWriteTaskStatsTracker metrics collection

[jira] [Assigned] (SPARK-21784) Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21784: Assignee: Apache Spark > Add ALTER TABLE ADD CONSTRANT DDL to support defining primary

[jira] [Assigned] (SPARK-21685) Params isSet in scala Transformer triggered by _setDefault in pyspark

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21685: Assignee: (was: Apache Spark) > Params isSet in scala Transformer triggered by

[jira] [Assigned] (SPARK-21720) Filter predicate with many conditions throw stackoverflow error

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21720: Assignee: (was: Apache Spark) > Filter predicate with many conditions throw

[jira] [Assigned] (SPARK-21791) ORC should support column names with dot

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21791: Assignee: (was: Apache Spark) > ORC should support column names with dot >

[jira] [Assigned] (SPARK-21774) The rule PromoteStrings cast string to a wrong data type

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21774: Assignee: (was: Apache Spark) > The rule PromoteStrings cast string to a wrong data

[jira] [Assigned] (SPARK-21692) Modify PythonUDF to support nullability

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21692: Assignee: (was: Apache Spark) > Modify PythonUDF to support nullability >

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: (was: Apache Spark) > CodeGeneraor.splitExpressions counts code size more

[jira] [Assigned] (SPARK-21710) ConsoleSink causes OOM crashes with large inputs.

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21710: Assignee: (was: Apache Spark) > ConsoleSink causes OOM crashes with large inputs. >

[jira] [Assigned] (SPARK-21722) Enable timezone-aware timestamp type when creating Pandas DataFrame.

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21722: Assignee: (was: Apache Spark) > Enable timezone-aware timestamp type when creating

[jira] [Assigned] (SPARK-20589) Allow limiting task concurrency per stage

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20589: Assignee: (was: Apache Spark) > Allow limiting task concurrency per stage >

[jira] [Assigned] (SPARK-21744) Add retry logic when create new broadcast

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21744: Assignee: Apache Spark > Add retry logic when create new broadcast >

[jira] [Assigned] (SPARK-21737) Create communication channel between arbitrary clients and the Spark AM in YARN mode

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21737: Assignee: (was: Apache Spark) > Create communication channel between arbitrary

[jira] [Assigned] (SPARK-21737) Create communication channel between arbitrary clients and the Spark AM in YARN mode

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21737: Assignee: Apache Spark > Create communication channel between arbitrary clients and the

[jira] [Assigned] (SPARK-21715) History Server should not respond history page html content multiple times for only one http request

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21715: Assignee: (was: Apache Spark) > History Server should not respond history page html

[jira] [Assigned] (SPARK-14371) OnlineLDAOptimizer should not collect stats for each doc in mini-batch to driver

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14371: Assignee: (was: Apache Spark) > OnlineLDAOptimizer should not collect stats for each

[jira] [Assigned] (SPARK-21744) Add retry logic when create new broadcast

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21744: Assignee: (was: Apache Spark) > Add retry logic when create new broadcast >

[jira] [Assigned] (SPARK-21726) Check for structural integrity of the plan in QO in test mode

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21726: Assignee: (was: Apache Spark) > Check for structural integrity of the plan in QO in

[jira] [Assigned] (SPARK-21715) History Server should not respond history page html content multiple times for only one http request

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21715: Assignee: Apache Spark > History Server should not respond history page html content

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: Apache Spark > CodeGeneraor.splitExpressions counts code size more precisely >

[jira] [Assigned] (SPARK-21722) Enable timezone-aware timestamp type when creating Pandas DataFrame.

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21722: Assignee: Apache Spark > Enable timezone-aware timestamp type when creating Pandas

[jira] [Assigned] (SPARK-21692) Modify PythonUDF to support nullability

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21692: Assignee: Apache Spark > Modify PythonUDF to support nullability >

[jira] [Assigned] (SPARK-21726) Check for structural integrity of the plan in QO in test mode

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21726: Assignee: Apache Spark > Check for structural integrity of the plan in QO in test mode >

[jira] [Assigned] (SPARK-21717) Decouple the generated codes of consuming rows in operators under whole-stage codegen

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21717: Assignee: Apache Spark > Decouple the generated codes of consuming rows in operators

[jira] [Assigned] (SPARK-21688) performance improvement in mllib SVM with native BLAS

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21688: Assignee: Apache Spark > performance improvement in mllib SVM with native BLAS >

[jira] [Assigned] (SPARK-21762) FileFormatWriter/BasicWriteTaskStatsTracker metrics collection fails if a new file isn't yet visible

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21762: Assignee: (was: Apache Spark) > FileFormatWriter/BasicWriteTaskStatsTracker metrics

[jira] [Assigned] (SPARK-21710) ConsoleSink causes OOM crashes with large inputs.

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21710: Assignee: Apache Spark > ConsoleSink causes OOM crashes with large inputs. >

[jira] [Assigned] (SPARK-14371) OnlineLDAOptimizer should not collect stats for each doc in mini-batch to driver

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14371: Assignee: Apache Spark > OnlineLDAOptimizer should not collect stats for each doc in

[jira] [Assigned] (SPARK-21705) Add spark.internal.config parameter description

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21705: Assignee: (was: Apache Spark) > Add spark.internal.config parameter description >

[jira] [Assigned] (SPARK-21688) performance improvement in mllib SVM with native BLAS

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21688: Assignee: (was: Apache Spark) > performance improvement in mllib SVM with native BLAS

[jira] [Assigned] (SPARK-21705) Add spark.internal.config parameter description

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21705: Assignee: Apache Spark > Add spark.internal.config parameter description >

[jira] [Assigned] (SPARK-21717) Decouple the generated codes of consuming rows in operators under whole-stage codegen

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21717: Assignee: (was: Apache Spark) > Decouple the generated codes of consuming rows in

[jira] [Assigned] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10878: Assignee: Apache Spark > Race condition when resolving Maven coordinates via Ivy >

[jira] [Assigned] (SPARK-21655) Kill CLI for Yarn mode

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21655: Assignee: Apache Spark > Kill CLI for Yarn mode > -- > >

[jira] [Assigned] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21610: Assignee: (was: Apache Spark) > Corrupt records are not handled properly when

[jira] [Assigned] (SPARK-21646) BinaryComparison shouldn't auto cast string to int/long

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21646: Assignee: Apache Spark > BinaryComparison shouldn't auto cast string to int/long >

[jira] [Assigned] (SPARK-21655) Kill CLI for Yarn mode

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21655: Assignee: (was: Apache Spark) > Kill CLI for Yarn mode > -- > >

[jira] [Assigned] (SPARK-21654) Complement predicates expression description

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21654: Assignee: (was: Apache Spark) > Complement predicates expression description >

[jira] [Assigned] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21590: Assignee: (was: Apache Spark) > Structured Streaming window start time should support

[jira] [Assigned] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21590: Assignee: Apache Spark > Structured Streaming window start time should support negative

[jira] [Assigned] (SPARK-21625) sqrt(negative number) should be null

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21625: Assignee: (was: Apache Spark) > sqrt(negative number) should be null >

[jira] [Assigned] (SPARK-21612) Allow unicode strings in __getitem__ of StructType

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21612: Assignee: (was: Apache Spark) > Allow unicode strings in __getitem__ of StructType >

[jira] [Assigned] (SPARK-21654) Complement predicates expression description

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21654: Assignee: Apache Spark > Complement predicates expression description >

[jira] [Assigned] (SPARK-21583) Create a ColumnarBatch with ArrowColumnVectors for row based iteration

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21583: Assignee: (was: Apache Spark) > Create a ColumnarBatch with ArrowColumnVectors for

[jira] [Assigned] (SPARK-21110) Structs should be usable in inequality filters

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21110: Assignee: Apache Spark > Structs should be usable in inequality filters >

[jira] [Assigned] (SPARK-21619) Fail the execution of canonicalized plans explicitly

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21619: Assignee: Reynold Xin (was: Apache Spark) > Fail the execution of canonicalized plans

[jira] [Assigned] (SPARK-21513) SQL to_json should support all column types

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21513: Assignee: Apache Spark > SQL to_json should support all column types >

[jira] [Assigned] (SPARK-21245) Resolve code duplication for classification/regression summarizers

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21245: Assignee: (was: Apache Spark) > Resolve code duplication for

[jira] [Assigned] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8288: --- Assignee: (was: Apache Spark) > ScalaReflection should also try apply methods defined in

[jira] [Assigned] (SPARK-21606) HiveServer2/HiveThriftServer2 catches OOMs on request threads

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21606: Assignee: Apache Spark > HiveServer2/HiveThriftServer2 catches OOMs on request threads >

[jira] [Assigned] (SPARK-21612) Allow unicode strings in __getitem__ of StructType

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21612: Assignee: Apache Spark > Allow unicode strings in __getitem__ of StructType >

[jira] [Assigned] (SPARK-21624) Optimize communication cost of RF/GBT/DT

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21624: Assignee: Apache Spark > Optimize communication cost of RF/GBT/DT >

[jira] [Assigned] (SPARK-21513) SQL to_json should support all column types

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21513: Assignee: (was: Apache Spark) > SQL to_json should support all column types >

[jira] [Assigned] (SPARK-21644) LocalLimit.maxRows is defined incorrectly

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21644: Assignee: Apache Spark (was: Reynold Xin) > LocalLimit.maxRows is defined incorrectly >

[jira] [Assigned] (SPARK-20642) Use key-value store to keep History Server application listing

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20642: Assignee: (was: Apache Spark) > Use key-value store to keep History Server

[jira] [Assigned] (SPARK-20396) groupBy().apply() with pandas udf in pyspark

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20396: Assignee: (was: Apache Spark) > groupBy().apply() with pandas udf in pyspark >

[jira] [Assigned] (SPARK-21635) ACOS(2) and ASIN(2) should be null

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21635: Assignee: Apache Spark > ACOS(2) and ASIN(2) should be null >

[jira] [Assigned] (SPARK-20642) Use key-value store to keep History Server application listing

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20642: Assignee: Apache Spark > Use key-value store to keep History Server application listing >

[jira] [Assigned] (SPARK-21571) Spark history server leaves incomplete or unreadable history files around forever.

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21571: Assignee: (was: Apache Spark) > Spark history server leaves incomplete or unreadable

[jira] [Assigned] (SPARK-21673) Spark local directory is not set correctly

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21673: Assignee: (was: Apache Spark) > Spark local directory is not set correctly >

[jira] [Assigned] (SPARK-21245) Resolve code duplication for classification/regression summarizers

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21245: Assignee: Apache Spark > Resolve code duplication for classification/regression

[jira] [Assigned] (SPARK-21635) ACOS(2) and ASIN(2) should be null

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21635: Assignee: (was: Apache Spark) > ACOS(2) and ASIN(2) should be null >

[jira] [Assigned] (SPARK-21559) Remove Mesos fine-grained mode

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21559: Assignee: (was: Apache Spark) > Remove Mesos fine-grained mode >

[jira] [Assigned] (SPARK-21673) Spark local directory is not set correctly

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21673: Assignee: Apache Spark > Spark local directory is not set correctly >

[jira] [Assigned] (SPARK-20396) groupBy().apply() with pandas udf in pyspark

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20396: Assignee: Apache Spark > groupBy().apply() with pandas udf in pyspark >

[jira] [Assigned] (SPARK-20679) Let ML ALS recommend for a subset of users/items

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20679: Assignee: (was: Apache Spark) > Let ML ALS recommend for a subset of users/items >

[jira] [Assigned] (SPARK-21583) Create a ColumnarBatch with ArrowColumnVectors for row based iteration

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21583: Assignee: Apache Spark > Create a ColumnarBatch with ArrowColumnVectors for row based

[jira] [Assigned] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8288: --- Assignee: Apache Spark > ScalaReflection should also try apply methods defined in companion

[jira] [Assigned] (SPARK-21619) Fail the execution of canonicalized plans explicitly

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21619: Assignee: Apache Spark (was: Reynold Xin) > Fail the execution of canonicalized plans

[jira] [Assigned] (SPARK-21571) Spark history server leaves incomplete or unreadable history files around forever.

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21571: Assignee: Apache Spark > Spark history server leaves incomplete or unreadable history

[jira] [Assigned] (SPARK-21646) BinaryComparison shouldn't auto cast string to int/long

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21646: Assignee: (was: Apache Spark) > BinaryComparison shouldn't auto cast string to

[jira] [Assigned] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10878: Assignee: (was: Apache Spark) > Race condition when resolving Maven coordinates via

[jira] [Assigned] (SPARK-21606) HiveServer2/HiveThriftServer2 catches OOMs on request threads

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21606: Assignee: (was: Apache Spark) > HiveServer2/HiveThriftServer2 catches OOMs on request

[jira] [Assigned] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21610: Assignee: Apache Spark > Corrupt records are not handled properly when creating a

[jira] [Assigned] (SPARK-21644) LocalLimit.maxRows is defined incorrectly

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21644: Assignee: Reynold Xin (was: Apache Spark) > LocalLimit.maxRows is defined incorrectly >

[jira] [Assigned] (SPARK-21625) sqrt(negative number) should be null

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21625: Assignee: Apache Spark > sqrt(negative number) should be null >

[jira] [Assigned] (SPARK-21110) Structs should be usable in inequality filters

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21110: Assignee: (was: Apache Spark) > Structs should be usable in inequality filters >

[jira] [Assigned] (SPARK-21560) Add hold mode for the LiveListenerBus

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21560: Assignee: Apache Spark > Add hold mode for the LiveListenerBus >

[jira] [Assigned] (SPARK-21560) Add hold mode for the LiveListenerBus

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21560: Assignee: (was: Apache Spark) > Add hold mode for the LiveListenerBus >

[jira] [Assigned] (SPARK-21559) Remove Mesos fine-grained mode

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21559: Assignee: Apache Spark > Remove Mesos fine-grained mode > --

[jira] [Assigned] (SPARK-21552) Add decimal type support to ArrowWriter.

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21552: Assignee: (was: Apache Spark) > Add decimal type support to ArrowWriter. >

[jira] [Assigned] (SPARK-21526) Add support to ML LogisticRegression for setting initial model

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21526: Assignee: (was: Apache Spark) > Add support to ML LogisticRegression for setting

[jira] [Assigned] (SPARK-21526) Add support to ML LogisticRegression for setting initial model

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21526: Assignee: Apache Spark > Add support to ML LogisticRegression for setting initial model >

[jira] [Assigned] (SPARK-21552) Add decimal type support to ArrowWriter.

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21552: Assignee: Apache Spark > Add decimal type support to ArrowWriter. >

[jira] [Assigned] (SPARK-21548) Support insert into serial columns of table

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21548: Assignee: (was: Apache Spark) > Support insert into serial columns of table >

[jira] [Assigned] (SPARK-21481) Add indexOf method in ml.feature.HashingTF similar to mllib.feature.HashingTF

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21481: Assignee: Apache Spark > Add indexOf method in ml.feature.HashingTF similar to

[jira] [Assigned] (SPARK-21481) Add indexOf method in ml.feature.HashingTF similar to mllib.feature.HashingTF

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21481: Assignee: (was: Apache Spark) > Add indexOf method in ml.feature.HashingTF similar to

[jira] [Assigned] (SPARK-21548) Support insert into serial columns of table

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21548: Assignee: Apache Spark > Support insert into serial columns of table >

[jira] [Assigned] (SPARK-20679) Let ML ALS recommend for a subset of users/items

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20679: Assignee: Apache Spark > Let ML ALS recommend for a subset of users/items >

[jira] [Assigned] (SPARK-21789) Remove obsolete codes for parsing abstract schema strings

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21789: Assignee: (was: Apache Spark) > Remove obsolete codes for parsing abstract schema

[jira] [Assigned] (SPARK-21789) Remove obsolete codes for parsing abstract schema strings

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21789: Assignee: Apache Spark > Remove obsolete codes for parsing abstract schema strings >

[jira] [Created] (SPARK-21865) remove Partitioning.compatibleWith

2017-08-29 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-21865: --- Summary: remove Partitioning.compatibleWith Key: SPARK-21865 URL: https://issues.apache.org/jira/browse/SPARK-21865 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-21841) Spark SQL doesn't pick up column added in hive when table created with saveAsTable

2017-08-29 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145575#comment-16145575 ] Wenchen Fan commented on SPARK-21841: - yea we support the hive format since Spark 2.2. For older

[jira] [Resolved] (SPARK-21848) Create trait to identify user-defined functions

2017-08-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21848. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.3.0 > Create trait to

[jira] [Comment Edited] (SPARK-21864) Spark 2.0.1 - SaveMode.Overwrite does not work while saving data to memsql

2017-08-29 Thread Vidya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145449#comment-16145449 ] Vidya edited comment on SPARK-21864 at 8/29/17 3:12 PM: thanks Sean for your

[jira] [Commented] (SPARK-21864) Spark 2.0.1 - SaveMode.Overwrite does not work while saving data to memsql

2017-08-29 Thread Vidya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145449#comment-16145449 ] Vidya commented on SPARK-21864: --- thanks Sean for your response[~srowen] Please help clarify on your

[jira] [Commented] (SPARK-21859) SparkFiles.get failed on driver in yarn-cluster and yarn-client mode

2017-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145441#comment-16145441 ] Apache Spark commented on SPARK-21859: -- User 'lgrcyanny' has created a pull request for this issue:

<    1   2   3   >