[jira] [Assigned] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21728: Assignee: Apache Spark > Allow SparkSubmit to use logging >

[jira] [Assigned] (SPARK-21748) Migrate the implementation of HashingTF from MLlib to ML

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21748: Assignee: (was: Apache Spark) > Migrate the implementation of HashingTF from MLlib to

[jira] [Assigned] (SPARK-21783) Turn on ORC filter push-down by default

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21783: Assignee: (was: Apache Spark) > Turn on ORC filter push-down by default >

[jira] [Assigned] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21728: Assignee: (was: Apache Spark) > Allow SparkSubmit to use logging >

[jira] [Assigned] (SPARK-21744) Add retry logic when create new broadcast

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21744: Assignee: Apache Spark > Add retry logic when create new broadcast >

[jira] [Commented] (SPARK-21726) Check for structural integrity of the plan in QO in test mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144014#comment-16144014 ] Apache Spark commented on SPARK-21726: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21717) Decouple the generated codes of consuming rows in operators under whole-stage codegen

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21717: Assignee: (was: Apache Spark) > Decouple the generated codes of consuming rows in

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: (was: Apache Spark) > CodeGeneraor.splitExpressions counts code size more

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: Apache Spark > CodeGeneraor.splitExpressions counts code size more precisely >

[jira] [Commented] (SPARK-21696) State Store can't handle corrupted snapshots

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144009#comment-16144009 ] Apache Spark commented on SPARK-21696: -- User 'nonsleepr' has created a pull request for this issue:

[jira] [Commented] (SPARK-21710) ConsoleSink causes OOM crashes with large inputs.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144010#comment-16144010 ] Apache Spark commented on SPARK-21710: -- User 'maasg' has created a pull request for this issue:

[jira] [Commented] (SPARK-9104) expose network layer memory usage in shuffle part

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144012#comment-16144012 ] Apache Spark commented on SPARK-9104: - User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21673) Spark local directory is not set correctly

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21673: Assignee: (was: Apache Spark) > Spark local directory is not set correctly >

[jira] [Commented] (SPARK-21692) Modify PythonUDF to support nullability

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144006#comment-16144006 ] Apache Spark commented on SPARK-21692: -- User 'ptkool' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21590: Assignee: (was: Apache Spark) > Structured Streaming window start time should support

[jira] [Assigned] (SPARK-21710) ConsoleSink causes OOM crashes with large inputs.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21710: Assignee: (was: Apache Spark) > ConsoleSink causes OOM crashes with large inputs. >

[jira] [Assigned] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21610: Assignee: Apache Spark > Corrupt records are not handled properly when creating a

[jira] [Assigned] (SPARK-21692) Modify PythonUDF to support nullability

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21692: Assignee: (was: Apache Spark) > Modify PythonUDF to support nullability >

[jira] [Assigned] (SPARK-21710) ConsoleSink causes OOM crashes with large inputs.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21710: Assignee: Apache Spark > ConsoleSink causes OOM crashes with large inputs. >

[jira] [Assigned] (SPARK-21722) Enable timezone-aware timestamp type when creating Pandas DataFrame.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21722: Assignee: Apache Spark > Enable timezone-aware timestamp type when creating Pandas

[jira] [Commented] (SPARK-21722) Enable timezone-aware timestamp type when creating Pandas DataFrame.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144000#comment-16144000 ] Apache Spark commented on SPARK-21722: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21245) Resolve code duplication for classification/regression summarizers

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21245: Assignee: Apache Spark > Resolve code duplication for classification/regression

[jira] [Assigned] (SPARK-21705) Add spark.internal.config parameter description

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21705: Assignee: (was: Apache Spark) > Add spark.internal.config parameter description >

[jira] [Assigned] (SPARK-20642) Use key-value store to keep History Server application listing

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20642: Assignee: (was: Apache Spark) > Use key-value store to keep History Server

[jira] [Assigned] (SPARK-21654) Complement predicates expression description

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21654: Assignee: (was: Apache Spark) > Complement predicates expression description >

[jira] [Assigned] (SPARK-21715) History Server should not respond history page html content multiple times for only one http request

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21715: Assignee: Apache Spark > History Server should not respond history page html content

[jira] [Commented] (SPARK-21705) Add spark.internal.config parameter description

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143999#comment-16143999 ] Apache Spark commented on SPARK-21705: -- User 'heary-cao' has created a pull request for this issue:

[jira] [Commented] (SPARK-21673) Spark local directory is not set correctly

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144003#comment-16144003 ] Apache Spark commented on SPARK-21673: -- User 'jakecharland' has created a pull request for this

[jira] [Commented] (SPARK-21624) Optimize communication cost of RF/GBT/DT

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143996#comment-16143996 ] Apache Spark commented on SPARK-21624: -- User 'mpjlu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21624) Optimize communication cost of RF/GBT/DT

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21624: Assignee: Apache Spark > Optimize communication cost of RF/GBT/DT >

[jira] [Assigned] (SPARK-21619) Fail the execution of canonicalized plans explicitly

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21619: Assignee: Reynold Xin (was: Apache Spark) > Fail the execution of canonicalized plans

[jira] [Assigned] (SPARK-21654) Complement predicates expression description

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21654: Assignee: Apache Spark > Complement predicates expression description >

[jira] [Assigned] (SPARK-21644) LocalLimit.maxRows is defined incorrectly

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21644: Assignee: Apache Spark (was: Reynold Xin) > LocalLimit.maxRows is defined incorrectly >

[jira] [Assigned] (SPARK-21619) Fail the execution of canonicalized plans explicitly

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21619: Assignee: Apache Spark (was: Reynold Xin) > Fail the execution of canonicalized plans

[jira] [Assigned] (SPARK-21245) Resolve code duplication for classification/regression summarizers

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21245: Assignee: (was: Apache Spark) > Resolve code duplication for

[jira] [Commented] (SPARK-21619) Fail the execution of canonicalized plans explicitly

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143998#comment-16143998 ] Apache Spark commented on SPARK-21619: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21715) History Server should not respond history page html content multiple times for only one http request

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21715: Assignee: (was: Apache Spark) > History Server should not respond history page html

[jira] [Assigned] (SPARK-21624) Optimize communication cost of RF/GBT/DT

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21624: Assignee: (was: Apache Spark) > Optimize communication cost of RF/GBT/DT >

[jira] [Commented] (SPARK-21654) Complement predicates expression description

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143994#comment-16143994 ] Apache Spark commented on SPARK-21654: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-21644) LocalLimit.maxRows is defined incorrectly

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143993#comment-16143993 ] Apache Spark commented on SPARK-21644: -- User 'rxin' has created a pull request for this issue:

[jira] [Commented] (SPARK-21655) Kill CLI for Yarn mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143995#comment-16143995 ] Apache Spark commented on SPARK-21655: -- User 'yoonlee95' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21644) LocalLimit.maxRows is defined incorrectly

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21644: Assignee: Reynold Xin (was: Apache Spark) > LocalLimit.maxRows is defined incorrectly >

[jira] [Assigned] (SPARK-21690) one-pass imputer

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21690: Assignee: zhengruifeng (was: Apache Spark) > one-pass imputer > > >

[jira] [Assigned] (SPARK-21690) one-pass imputer

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21690: Assignee: Apache Spark (was: zhengruifeng) > one-pass imputer > > >

[jira] [Assigned] (SPARK-21655) Kill CLI for Yarn mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21655: Assignee: Apache Spark > Kill CLI for Yarn mode > -- > >

[jira] [Assigned] (SPARK-21655) Kill CLI for Yarn mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21655: Assignee: (was: Apache Spark) > Kill CLI for Yarn mode > -- > >

[jira] [Commented] (SPARK-20642) Use key-value store to keep History Server application listing

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144001#comment-16144001 ] Apache Spark commented on SPARK-20642: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21705) Add spark.internal.config parameter description

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21705: Assignee: Apache Spark > Add spark.internal.config parameter description >

[jira] [Assigned] (SPARK-20642) Use key-value store to keep History Server application listing

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20642: Assignee: Apache Spark > Use key-value store to keep History Server application listing >

[jira] [Commented] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144002#comment-16144002 ] Apache Spark commented on SPARK-21610: -- User 'jmchung' has created a pull request for this issue:

[jira] [Commented] (SPARK-21254) History UI: Taking over 1 minute for initial page display

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144004#comment-16144004 ] Apache Spark commented on SPARK-21254: -- User '2ooom' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21722) Enable timezone-aware timestamp type when creating Pandas DataFrame.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21722: Assignee: (was: Apache Spark) > Enable timezone-aware timestamp type when creating

[jira] [Assigned] (SPARK-21583) Create a ColumnarBatch with ArrowColumnVectors for row based iteration

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21583: Assignee: Apache Spark > Create a ColumnarBatch with ArrowColumnVectors for row based

[jira] [Assigned] (SPARK-21646) BinaryComparison shouldn't auto cast string to int/long

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21646: Assignee: (was: Apache Spark) > BinaryComparison shouldn't auto cast string to

[jira] [Assigned] (SPARK-21571) Spark history server leaves incomplete or unreadable history files around forever.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21571: Assignee: (was: Apache Spark) > Spark history server leaves incomplete or unreadable

[jira] [Assigned] (SPARK-21583) Create a ColumnarBatch with ArrowColumnVectors for row based iteration

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21583: Assignee: (was: Apache Spark) > Create a ColumnarBatch with ArrowColumnVectors for

[jira] [Assigned] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10878: Assignee: (was: Apache Spark) > Race condition when resolving Maven coordinates via

[jira] [Assigned] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8288: --- Assignee: Apache Spark > ScalaReflection should also try apply methods defined in companion

[jira] [Assigned] (SPARK-21548) Support insert into serial columns of table

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21548: Assignee: Apache Spark > Support insert into serial columns of table >

[jira] [Assigned] (SPARK-21635) ACOS(2) and ASIN(2) should be null

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21635: Assignee: (was: Apache Spark) > ACOS(2) and ASIN(2) should be null >

[jira] [Assigned] (SPARK-21625) sqrt(negative number) should be null

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21625: Assignee: Apache Spark > sqrt(negative number) should be null >

[jira] [Assigned] (SPARK-21560) Add hold mode for the LiveListenerBus

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21560: Assignee: (was: Apache Spark) > Add hold mode for the LiveListenerBus >

[jira] [Assigned] (SPARK-21625) sqrt(negative number) should be null

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21625: Assignee: (was: Apache Spark) > sqrt(negative number) should be null >

[jira] [Assigned] (SPARK-21513) SQL to_json should support all column types

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21513: Assignee: (was: Apache Spark) > SQL to_json should support all column types >

[jira] [Assigned] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10878: Assignee: Apache Spark > Race condition when resolving Maven coordinates via Ivy >

[jira] [Assigned] (SPARK-20396) groupBy().apply() with pandas udf in pyspark

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20396: Assignee: Apache Spark > groupBy().apply() with pandas udf in pyspark >

[jira] [Assigned] (SPARK-21513) SQL to_json should support all column types

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21513: Assignee: Apache Spark > SQL to_json should support all column types >

[jira] [Assigned] (SPARK-21612) Allow unicode strings in __getitem__ of StructType

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21612: Assignee: (was: Apache Spark) > Allow unicode strings in __getitem__ of StructType >

[jira] [Assigned] (SPARK-21646) BinaryComparison shouldn't auto cast string to int/long

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21646: Assignee: Apache Spark > BinaryComparison shouldn't auto cast string to int/long >

[jira] [Assigned] (SPARK-21560) Add hold mode for the LiveListenerBus

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21560: Assignee: Apache Spark > Add hold mode for the LiveListenerBus >

[jira] [Assigned] (SPARK-21110) Structs should be usable in inequality filters

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21110: Assignee: (was: Apache Spark) > Structs should be usable in inequality filters >

[jira] [Assigned] (SPARK-21606) HiveServer2/HiveThriftServer2 catches OOMs on request threads

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21606: Assignee: Apache Spark > HiveServer2/HiveThriftServer2 catches OOMs on request threads >

[jira] [Assigned] (SPARK-21110) Structs should be usable in inequality filters

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21110: Assignee: Apache Spark > Structs should be usable in inequality filters >

[jira] [Assigned] (SPARK-20679) Let ML ALS recommend for a subset of users/items

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20679: Assignee: Apache Spark > Let ML ALS recommend for a subset of users/items >

[jira] [Assigned] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8288: --- Assignee: (was: Apache Spark) > ScalaReflection should also try apply methods defined in

[jira] [Assigned] (SPARK-21612) Allow unicode strings in __getitem__ of StructType

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21612: Assignee: Apache Spark > Allow unicode strings in __getitem__ of StructType >

[jira] [Assigned] (SPARK-20679) Let ML ALS recommend for a subset of users/items

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20679: Assignee: (was: Apache Spark) > Let ML ALS recommend for a subset of users/items >

[jira] [Assigned] (SPARK-21635) ACOS(2) and ASIN(2) should be null

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21635: Assignee: Apache Spark > ACOS(2) and ASIN(2) should be null >

[jira] [Assigned] (SPARK-21526) Add support to ML LogisticRegression for setting initial model

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21526: Assignee: (was: Apache Spark) > Add support to ML LogisticRegression for setting

[jira] [Assigned] (SPARK-21526) Add support to ML LogisticRegression for setting initial model

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21526: Assignee: Apache Spark > Add support to ML LogisticRegression for setting initial model >

[jira] [Assigned] (SPARK-21481) Add indexOf method in ml.feature.HashingTF similar to mllib.feature.HashingTF

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21481: Assignee: Apache Spark > Add indexOf method in ml.feature.HashingTF similar to

[jira] [Assigned] (SPARK-21481) Add indexOf method in ml.feature.HashingTF similar to mllib.feature.HashingTF

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21481: Assignee: (was: Apache Spark) > Add indexOf method in ml.feature.HashingTF similar to

[jira] [Assigned] (SPARK-21571) Spark history server leaves incomplete or unreadable history files around forever.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21571: Assignee: Apache Spark > Spark history server leaves incomplete or unreadable history

[jira] [Assigned] (SPARK-21559) Remove Mesos fine-grained mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21559: Assignee: Apache Spark > Remove Mesos fine-grained mode > --

[jira] [Assigned] (SPARK-21606) HiveServer2/HiveThriftServer2 catches OOMs on request threads

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21606: Assignee: (was: Apache Spark) > HiveServer2/HiveThriftServer2 catches OOMs on request

[jira] [Assigned] (SPARK-21552) Add decimal type support to ArrowWriter.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21552: Assignee: (was: Apache Spark) > Add decimal type support to ArrowWriter. >

[jira] [Assigned] (SPARK-21559) Remove Mesos fine-grained mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21559: Assignee: (was: Apache Spark) > Remove Mesos fine-grained mode >

[jira] [Assigned] (SPARK-20990) Multi-line support for JSON

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20990: Assignee: (was: Apache Spark) > Multi-line support for JSON >

[jira] [Assigned] (SPARK-20990) Multi-line support for JSON

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20990: Assignee: Apache Spark > Multi-line support for JSON > --- > >

[jira] [Assigned] (SPARK-20396) groupBy().apply() with pandas udf in pyspark

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20396: Assignee: (was: Apache Spark) > groupBy().apply() with pandas udf in pyspark >

[jira] [Assigned] (SPARK-21548) Support insert into serial columns of table

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21548: Assignee: (was: Apache Spark) > Support insert into serial columns of table >

[jira] [Assigned] (SPARK-21552) Add decimal type support to ArrowWriter.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21552: Assignee: Apache Spark > Add decimal type support to ArrowWriter. >

[jira] [Assigned] (SPARK-21789) Remove obsolete codes for parsing abstract schema strings

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21789: Assignee: Apache Spark > Remove obsolete codes for parsing abstract schema strings >

[jira] [Assigned] (SPARK-21789) Remove obsolete codes for parsing abstract schema strings

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21789: Assignee: (was: Apache Spark) > Remove obsolete codes for parsing abstract schema

[jira] [Commented] (SPARK-21852) Empty Parquet Files created as a result of spark jobs fail when read

2017-08-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143987#comment-16143987 ] Sean Owen commented on SPARK-21852: --- The message isn't a problem, if there is no data at all. You're

[jira] [Updated] (SPARK-21852) Empty Parquet Files created as a result of spark jobs fail when read

2017-08-28 Thread Shivam Dalmia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivam Dalmia updated SPARK-21852: -- Description: I have faced an issue intermittently with certain spark jobs writing parquet

[jira] [Commented] (SPARK-21852) Empty Parquet Files created as a result of spark jobs fail when read

2017-08-28 Thread Shivam Dalmia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143975#comment-16143975 ] Shivam Dalmia commented on SPARK-21852: --- Of course, this is because of the empty directory being

[jira] [Created] (SPARK-21852) Empty Parquet Files created as a result of spark jobs fail when read

2017-08-28 Thread Shivam Dalmia (JIRA)
Shivam Dalmia created SPARK-21852: - Summary: Empty Parquet Files created as a result of spark jobs fail when read Key: SPARK-21852 URL: https://issues.apache.org/jira/browse/SPARK-21852 Project:

[jira] [Assigned] (SPARK-21801) SparkR unit test randomly fail on trees

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21801: Assignee: (was: Apache Spark) > SparkR unit test randomly fail on trees >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: Apache Spark > Support SQL config for ORC compression >

<    1   2   3   4   5   6   >