[jira] [Assigned] (SPARK-21916) Set isolationOn=true when create client to remote hive metastore

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21916: Assignee: (was: Apache Spark) > Set isolationOn=true when create client to remote

[jira] [Commented] (SPARK-21916) Set isolationOn=true when create client to remote hive metastore

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153126#comment-16153126 ] Apache Spark commented on SPARK-21916: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21916) Set isolationOn=true when create client to remote hive metastore

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21916: Assignee: Apache Spark > Set isolationOn=true when create client to remote hive metastore

[jira] [Created] (SPARK-21916) Set isolationOn=true when create client to remote hive metastore

2017-09-04 Thread jin xing (JIRA)
jin xing created SPARK-21916: Summary: Set isolationOn=true when create client to remote hive metastore Key: SPARK-21916 URL: https://issues.apache.org/jira/browse/SPARK-21916 Project: Spark

[jira] [Commented] (SPARK-21915) Model 1 and Model 2 ParamMaps Missing

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153084#comment-16153084 ] Apache Spark commented on SPARK-21915: -- User 'marktab' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21915) Model 1 and Model 2 ParamMaps Missing

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21915: Assignee: Apache Spark > Model 1 and Model 2 ParamMaps Missing >

[jira] [Updated] (SPARK-21915) Model 1 and Model 2 ParamMaps Missing

2017-09-04 Thread Mark Tabladillo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Tabladillo updated SPARK-21915: Description: Error in PySpark example code

[jira] [Assigned] (SPARK-21915) Model 1 and Model 2 ParamMaps Missing

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21915: Assignee: (was: Apache Spark) > Model 1 and Model 2 ParamMaps Missing >

[jira] [Created] (SPARK-21915) Model 1 and Model 2 ParamMaps Missing

2017-09-04 Thread Mark Tabladillo (JIRA)
Mark Tabladillo created SPARK-21915: --- Summary: Model 1 and Model 2 ParamMaps Missing Key: SPARK-21915 URL: https://issues.apache.org/jira/browse/SPARK-21915 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19126) Join Documentation Improvements

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153078#comment-16153078 ] Apache Spark commented on SPARK-19126: -- User 'marktab' has created a pull request for this issue:

[jira] [Commented] (SPARK-21914) Running examples as tests in SQL builtin function documentation

2017-09-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153011#comment-16153011 ] Hyukjin Kwon commented on SPARK-21914: -- [~rxin], would you mind if I ask whether you like this idea

[jira] [Created] (SPARK-21914) Running examples as tests in SQL builtin function documentation

2017-09-04 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-21914: Summary: Running examples as tests in SQL builtin function documentation Key: SPARK-21914 URL: https://issues.apache.org/jira/browse/SPARK-21914 Project: Spark

[jira] [Commented] (SPARK-21913) `withDatabase` should drop database with CASCADE

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152977#comment-16152977 ] Apache Spark commented on SPARK-21913: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-21913) `withDatabase` should drop database with CASCADE

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21913: Assignee: (was: Apache Spark) > `withDatabase` should drop database with CASCADE >

[jira] [Assigned] (SPARK-21913) `withDatabase` should drop database with CASCADE

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21913: Assignee: Apache Spark > `withDatabase` should drop database with CASCADE >

[jira] [Created] (SPARK-21913) `withDatabase` should drop database with CASCADE

2017-09-04 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-21913: - Summary: `withDatabase` should drop database with CASCADE Key: SPARK-21913 URL: https://issues.apache.org/jira/browse/SPARK-21913 Project: Spark Issue

[jira] [Comment Edited] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-09-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152973#comment-16152973 ] Felix Cheung edited comment on SPARK-21727 at 9/4/17 11:08 PM: --- precisely.

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-09-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152973#comment-16152973 ] Felix Cheung commented on SPARK-21727: -- precisely. as far as I can tell, everything should "just

[jira] [Commented] (SPARK-21905) ClassCastException when call sqlContext.sql on temp table

2017-09-04 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152955#comment-16152955 ] Marco Gaido commented on SPARK-21905: - This is likely to be caused by a bug in the Magellan package.

[jira] [Resolved] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-04 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-21418. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.3.0

[jira] [Assigned] (SPARK-21912) Creating ORC datasource table should check invalid column names

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21912: Assignee: Apache Spark > Creating ORC datasource table should check invalid column names

[jira] [Assigned] (SPARK-21912) Creating ORC datasource table should check invalid column names

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21912: Assignee: (was: Apache Spark) > Creating ORC datasource table should check invalid

[jira] [Commented] (SPARK-21912) Creating ORC datasource table should check invalid column names

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152931#comment-16152931 ] Apache Spark commented on SPARK-21912: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-21912) Creating ORC datasource table should check invalid column names

2017-09-04 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-21912: - Summary: Creating ORC datasource table should check invalid column names Key: SPARK-21912 URL: https://issues.apache.org/jira/browse/SPARK-21912 Project: Spark

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

2017-09-04 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152915#comment-16152915 ] Matei Zaharia commented on SPARK-21866: --- Just to chime in on this, I've also seen feedback that the

[jira] [Commented] (SPARK-21882) OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152914#comment-16152914 ] Apache Spark commented on SPARK-21882: -- User 'awarrior' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21418: Assignee: Apache Spark > NoSuchElementException: None.get in DataSourceScanExec with >

[jira] [Commented] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152821#comment-16152821 ] Apache Spark commented on SPARK-21418: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21418: Assignee: (was: Apache Spark) > NoSuchElementException: None.get in

[jira] [Updated] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21418: -- Summary: NoSuchElementException: None.get in DataSourceScanExec with

[jira] [Updated] (SPARK-21418) NoSuchElementException: None.get on DataFrame.rdd

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21418: -- Priority: Minor (was: Major) I think we could easily make this code a little more defensive so that

[jira] [Assigned] (SPARK-21911) Parallel Model Evaluation for ML Tuning: Python

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21911: Assignee: Apache Spark > Parallel Model Evaluation for ML Tuning: Python >

[jira] [Updated] (SPARK-21911) Parallel Model Evaluation for ML Tuning: PySpark

2017-09-04 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-21911: --- Summary: Parallel Model Evaluation for ML Tuning: PySpark (was: Parallel Model Evaluation for ML

[jira] [Comment Edited] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2017-09-04 Thread Alexandre Dupriez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152745#comment-16152745 ] Alexandre Dupriez edited comment on SPARK-17041 at 9/4/17 3:54 PM: --- I

[jira] [Comment Edited] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2017-09-04 Thread Alexandre Dupriez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152745#comment-16152745 ] Alexandre Dupriez edited comment on SPARK-17041 at 9/4/17 3:53 PM: --- I

[jira] [Commented] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2017-09-04 Thread Alexandre Dupriez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152745#comment-16152745 ] Alexandre Dupriez commented on SPARK-17041: --- I would advocate for a message which highlights

[jira] [Commented] (SPARK-21418) NoSuchElementException: None.get on DataFrame.rdd

2017-09-04 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152742#comment-16152742 ] Daniel Darabos commented on SPARK-21418: Sorry for the delay. I can confirm that removing

[jira] [Comment Edited] (SPARK-21418) NoSuchElementException: None.get on DataFrame.rdd

2017-09-04 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088952#comment-16088952 ] Daniel Darabos edited comment on SPARK-21418 at 9/4/17 3:49 PM: I'm on

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-09-04 Thread Neil McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152766#comment-16152766 ] Neil McQuarrie commented on SPARK-21727: Happy to take on the change this side... (unless

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-09-04 Thread Neil McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152764#comment-16152764 ] Neil McQuarrie commented on SPARK-21727: Well, if class is "numeric" (or "integer", "character",

[jira] [Assigned] (SPARK-21911) Parallel Model Evaluation for ML Tuning: Python

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21911: Assignee: (was: Apache Spark) > Parallel Model Evaluation for ML Tuning: Python >

[jira] [Commented] (SPARK-21911) Parallel Model Evaluation for ML Tuning: Python

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152762#comment-16152762 ] Apache Spark commented on SPARK-21911: -- User 'WeichenXu123' has created a pull request for this

[jira] [Updated] (SPARK-19357) Parallel Model Evaluation for ML Tuning: Scala

2017-09-04 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-19357: --- Summary: Parallel Model Evaluation for ML Tuning: Scala (was: Parallel Model Evaluation for ML

[jira] [Created] (SPARK-21911) Parallel Model Evaluation for ML Tuning: Python

2017-09-04 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-21911: -- Summary: Parallel Model Evaluation for ML Tuning: Python Key: SPARK-21911 URL: https://issues.apache.org/jira/browse/SPARK-21911 Project: Spark Issue Type: New

[jira] [Comment Edited] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2017-09-04 Thread Alexandre Dupriez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152745#comment-16152745 ] Alexandre Dupriez edited comment on SPARK-17041 at 9/4/17 3:53 PM: --- I

[jira] [Commented] (SPARK-21908) Checkpoint broadcast variable in spark streaming job

2017-09-04 Thread Venkat Gurukrishna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152702#comment-16152702 ] Venkat Gurukrishna commented on SPARK-21908: [~srowen] I tried sending mail from id to

[jira] [Commented] (SPARK-21910) Connection pooling in Spark Job using HBASE Context

2017-09-04 Thread Venkat Gurukrishna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152699#comment-16152699 ] Venkat Gurukrishna commented on SPARK-21910: [~srowen] I tried sending mail from id to

[jira] [Commented] (SPARK-21909) Checkpoint HBASE Context in Spark Streaming Job

2017-09-04 Thread Venkat Gurukrishna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152700#comment-16152700 ] Venkat Gurukrishna commented on SPARK-21909: [~srowen] I tried sending mail from id to

[jira] [Resolved] (SPARK-21910) Connection pooling in Spark Job using HBASE Context

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21910. --- Resolution: Invalid Please stop opening JIRAs with questions. Use the mailing list > Connection

[jira] [Resolved] (SPARK-21909) Checkpoint HBASE Context in Spark Streaming Job

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21909. --- Resolution: Invalid Please stop opening JIRAs with questions. Use the mailing list > Checkpoint

[jira] [Created] (SPARK-21910) Connection pooling in Spark Job using HBASE Context

2017-09-04 Thread Venkat Gurukrishna (JIRA)
Venkat Gurukrishna created SPARK-21910: -- Summary: Connection pooling in Spark Job using HBASE Context Key: SPARK-21910 URL: https://issues.apache.org/jira/browse/SPARK-21910 Project: Spark

[jira] [Resolved] (SPARK-21908) Checkpoint broadcast variable in spark streaming job

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21908. --- Resolution: Invalid It's not clear what your error is or what the result was of using a singleton,

[jira] [Created] (SPARK-21909) Checkpoint HBASE Context in Spark Streaming Job

2017-09-04 Thread Venkat Gurukrishna (JIRA)
Venkat Gurukrishna created SPARK-21909: -- Summary: Checkpoint HBASE Context in Spark Streaming Job Key: SPARK-21909 URL: https://issues.apache.org/jira/browse/SPARK-21909 Project: Spark

[jira] [Created] (SPARK-21908) Checkpoint broadcast variable in spark streaming job

2017-09-04 Thread Venkat Gurukrishna (JIRA)
Venkat Gurukrishna created SPARK-21908: -- Summary: Checkpoint broadcast variable in spark streaming job Key: SPARK-21908 URL: https://issues.apache.org/jira/browse/SPARK-21908 Project: Spark

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-09-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152639#comment-16152639 ] Yanbo Liang commented on SPARK-21727: - [~felixcheung] What do you mean for this comment? {quote} But

[jira] [Updated] (SPARK-21905) ClassCastException when call sqlContext.sql on temp table

2017-09-04 Thread bluejoe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bluejoe updated SPARK-21905: Description: {code:java} val schema = StructType(List( StructField("name", DataTypes.StringType,

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-04 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152409#comment-16152409 ] jincheng commented on SPARK-18085: -- *{color:red}Here is a picture of how it looks{color}*

[jira] [Commented] (SPARK-21907) NullPointerException in UnsafeExternalSorter.spill()

2017-09-04 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152408#comment-16152408 ] Juliusz Sompolski commented on SPARK-21907: --- Note that UnsafeExternalSorter.spill appears twice

[jira] [Created] (SPARK-21907) NullPointerException in UnsafeExternalSorter.spill()

2017-09-04 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-21907: - Summary: NullPointerException in UnsafeExternalSorter.spill() Key: SPARK-21907 URL: https://issues.apache.org/jira/browse/SPARK-21907 Project: Spark

[jira] [Updated] (SPARK-21866) SPIP: Image support in Spark

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21866: -- Shepherd: Joseph K. Bradley > SPIP: Image support in Spark > > >

[jira] [Updated] (SPARK-15689) Data source API v2

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15689: -- Shepherd: Reynold Xin Affects Version/s: 2.3.0 > Data source API v2 > --

[jira] [Updated] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18085: -- Shepherd: Marcelo Vanzin > SPIP: Better History Server scalability for many / large applications >

[jira] [Updated] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-04 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jincheng updated SPARK-18085: - Attachment: screenshot-2.png > SPIP: Better History Server scalability for many / large applications >

[jira] [Assigned] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21906: Assignee: Apache Spark > No need to runAsSparkUser to switch UserGroupInformation in YARN

[jira] [Assigned] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21906: Assignee: (was: Apache Spark) > No need to runAsSparkUser to switch

[jira] [Updated] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-04 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jincheng updated SPARK-18085: - Attachment: screenshot-1.png > SPIP: Better History Server scalability for many / large applications >

[jira] [Commented] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152295#comment-16152295 ] Apache Spark commented on SPARK-21906: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-21900) Numerical Error in simple Skewness Computation

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152284#comment-16152284 ] Sean Owen commented on SPARK-21900: --- I don't feel strongly about it, but this is a reasonable issue to

[jira] [Resolved] (SPARK-21892) status code is 200 OK when kill application fail via spark master rest api

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21892. --- Resolution: Not A Problem > status code is 200 OK when kill application fail via spark master rest

[jira] [Updated] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-21906: - Description: 1、The Yarn application‘s ugi is determined by the ugi launching it 2、 runAsSparkUser is

[jira] [Updated] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-21906: - Description: 1、The Yarn application‘s ugi is determined by the ugi launching it 2、 runAsSparkUser is

[jira] [Updated] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-21906: - Description: 1、The Yarn application‘s ugi is determined by the ugi launching it 2、 runAsSparkUser is

[jira] [Created] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Kent Yao (JIRA)
Kent Yao created SPARK-21906: Summary: No need to runAsSparkUser to switch UserGroupInformation in YARN mode Key: SPARK-21906 URL: https://issues.apache.org/jira/browse/SPARK-21906 Project: Spark

[jira] [Comment Edited] (SPARK-21850) SparkSQL cannot perform LIKE someColumn if someColumn's value contains a backslash \

2017-09-04 Thread Adrien Lavoillotte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144943#comment-16144943 ] Adrien Lavoillotte edited comment on SPARK-21850 at 9/4/17 8:41 AM: I

[jira] [Created] (SPARK-21905) ClassCastException when call sqlContext.sql on temp table

2017-09-04 Thread bluejoe (JIRA)
bluejoe created SPARK-21905: --- Summary: ClassCastException when call sqlContext.sql on temp table Key: SPARK-21905 URL: https://issues.apache.org/jira/browse/SPARK-21905 Project: Spark Issue Type:

[jira] [Closed] (SPARK-21850) SparkSQL cannot perform LIKE someColumn if someColumn's value contains a backslash \

2017-09-04 Thread Adrien Lavoillotte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrien Lavoillotte closed SPARK-21850. -- Resolution: Not A Bug > SparkSQL cannot perform LIKE someColumn if someColumn's value

[jira] [Commented] (SPARK-21850) SparkSQL cannot perform LIKE someColumn if someColumn's value contains a backslash \

2017-09-04 Thread Adrien Lavoillotte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152241#comment-16152241 ] Adrien Lavoillotte commented on SPARK-21850: The behaviour seems indeed logical if it takes

[jira] [Comment Edited] (SPARK-21850) SparkSQL cannot perform LIKE someColumn if someColumn's value contains a backslash \

2017-09-04 Thread Adrien Lavoillotte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144943#comment-16144943 ] Adrien Lavoillotte edited comment on SPARK-21850 at 9/4/17 8:07 AM: I

[jira] [Commented] (SPARK-21845) Make codegen fallback of expressions configurable

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152178#comment-16152178 ] Apache Spark commented on SPARK-21845: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-21882) OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152166#comment-16152166 ] Apache Spark commented on SPARK-21882: -- User 'awarrior' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21904) Rename tempTables to tempViews in SessionCatalog

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21904: Assignee: Xiao Li (was: Apache Spark) > Rename tempTables to tempViews in SessionCatalog

[jira] [Commented] (SPARK-21904) Rename tempTables to tempViews in SessionCatalog

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152164#comment-16152164 ] Apache Spark commented on SPARK-21904: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21904) Rename tempTables to tempViews in SessionCatalog

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21904: Assignee: Apache Spark (was: Xiao Li) > Rename tempTables to tempViews in SessionCatalog

[jira] [Created] (SPARK-21904) Rename tempTables to tempViews in SessionCatalog

2017-09-04 Thread Xiao Li (JIRA)
Xiao Li created SPARK-21904: --- Summary: Rename tempTables to tempViews in SessionCatalog Key: SPARK-21904 URL: https://issues.apache.org/jira/browse/SPARK-21904 Project: Spark Issue Type: Bug