[jira] [Comment Edited] (SPARK-21850) SparkSQL cannot perform LIKE someColumn if someColumn's value contains a backslash \

2017-09-04 Thread Adrien Lavoillotte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144943#comment-16144943 ] Adrien Lavoillotte edited comment on SPARK-21850 at 9/4/17 8:07 AM: ---

[jira] [Commented] (SPARK-21850) SparkSQL cannot perform LIKE someColumn if someColumn's value contains a backslash \

2017-09-04 Thread Adrien Lavoillotte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152241#comment-16152241 ] Adrien Lavoillotte commented on SPARK-21850: The behaviour seems indeed logic

[jira] [Closed] (SPARK-21850) SparkSQL cannot perform LIKE someColumn if someColumn's value contains a backslash \

2017-09-04 Thread Adrien Lavoillotte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrien Lavoillotte closed SPARK-21850. -- Resolution: Not A Bug > SparkSQL cannot perform LIKE someColumn if someColumn's value c

[jira] [Created] (SPARK-21905) ClassCastException when call sqlContext.sql on temp table

2017-09-04 Thread bluejoe (JIRA)
bluejoe created SPARK-21905: --- Summary: ClassCastException when call sqlContext.sql on temp table Key: SPARK-21905 URL: https://issues.apache.org/jira/browse/SPARK-21905 Project: Spark Issue Type: B

[jira] [Comment Edited] (SPARK-21850) SparkSQL cannot perform LIKE someColumn if someColumn's value contains a backslash \

2017-09-04 Thread Adrien Lavoillotte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144943#comment-16144943 ] Adrien Lavoillotte edited comment on SPARK-21850 at 9/4/17 8:41 AM: ---

[jira] [Created] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Kent Yao (JIRA)
Kent Yao created SPARK-21906: Summary: No need to runAsSparkUser to switch UserGroupInformation in YARN mode Key: SPARK-21906 URL: https://issues.apache.org/jira/browse/SPARK-21906 Project: Spark

[jira] [Updated] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-21906: - Description: 1、The Yarn application‘s ugi is determined by the ugi launching it 2、 runAsSparkUser is used

[jira] [Updated] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-21906: - Description: 1、The Yarn application‘s ugi is determined by the ugi launching it 2、 runAsSparkUser is used

[jira] [Updated] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-21906: - Description: 1、The Yarn application‘s ugi is determined by the ugi launching it 2、 runAsSparkUser is used

[jira] [Commented] (SPARK-21900) Numerical Error in simple Skewness Computation

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152284#comment-16152284 ] Sean Owen commented on SPARK-21900: --- I don't feel strongly about it, but this is a reas

[jira] [Resolved] (SPARK-21892) status code is 200 OK when kill application fail via spark master rest api

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21892. --- Resolution: Not A Problem > status code is 200 OK when kill application fail via spark master rest a

[jira] [Commented] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152295#comment-16152295 ] Apache Spark commented on SPARK-21906: -- User 'yaooqinn' has created a pull request f

[jira] [Assigned] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21906: Assignee: (was: Apache Spark) > No need to runAsSparkUser to switch UserGroupInformati

[jira] [Updated] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-04 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jincheng updated SPARK-18085: - Attachment: screenshot-1.png > SPIP: Better History Server scalability for many / large applications > --

[jira] [Assigned] (SPARK-21906) No need to runAsSparkUser to switch UserGroupInformation in YARN mode

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21906: Assignee: Apache Spark > No need to runAsSparkUser to switch UserGroupInformation in YARN

[jira] [Updated] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-04 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jincheng updated SPARK-18085: - Attachment: screenshot-2.png > SPIP: Better History Server scalability for many / large applications > --

[jira] [Updated] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18085: -- Shepherd: Marcelo Vanzin > SPIP: Better History Server scalability for many / large applications >

[jira] [Updated] (SPARK-15689) Data source API v2

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15689: -- Shepherd: Reynold Xin Affects Version/s: 2.3.0 > Data source API v2 > -- >

[jira] [Updated] (SPARK-21866) SPIP: Image support in Spark

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21866: -- Shepherd: Joseph K. Bradley > SPIP: Image support in Spark > > >

[jira] [Created] (SPARK-21907) NullPointerException in UnsafeExternalSorter.spill()

2017-09-04 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-21907: - Summary: NullPointerException in UnsafeExternalSorter.spill() Key: SPARK-21907 URL: https://issues.apache.org/jira/browse/SPARK-21907 Project: Spark

[jira] [Commented] (SPARK-21907) NullPointerException in UnsafeExternalSorter.spill()

2017-09-04 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152408#comment-16152408 ] Juliusz Sompolski commented on SPARK-21907: --- Note that UnsafeExternalSorter.spi

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-04 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152409#comment-16152409 ] jincheng commented on SPARK-18085: -- *{color:red}Here is a picture of how it looks{color}

[jira] [Updated] (SPARK-21905) ClassCastException when call sqlContext.sql on temp table

2017-09-04 Thread bluejoe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bluejoe updated SPARK-21905: Description: {code:java} val schema = StructType(List( StructField("name", DataTypes.StringType, tr

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-09-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152639#comment-16152639 ] Yanbo Liang commented on SPARK-21727: - [~felixcheung] What do you mean for this comme

[jira] [Created] (SPARK-21908) Checkpoint broadcast variable in spark streaming job

2017-09-04 Thread Venkat Gurukrishna (JIRA)
Venkat Gurukrishna created SPARK-21908: -- Summary: Checkpoint broadcast variable in spark streaming job Key: SPARK-21908 URL: https://issues.apache.org/jira/browse/SPARK-21908 Project: Spark

[jira] [Created] (SPARK-21909) Checkpoint HBASE Context in Spark Streaming Job

2017-09-04 Thread Venkat Gurukrishna (JIRA)
Venkat Gurukrishna created SPARK-21909: -- Summary: Checkpoint HBASE Context in Spark Streaming Job Key: SPARK-21909 URL: https://issues.apache.org/jira/browse/SPARK-21909 Project: Spark I

[jira] [Resolved] (SPARK-21908) Checkpoint broadcast variable in spark streaming job

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21908. --- Resolution: Invalid It's not clear what your error is or what the result was of using a singleton, b

[jira] [Created] (SPARK-21910) Connection pooling in Spark Job using HBASE Context

2017-09-04 Thread Venkat Gurukrishna (JIRA)
Venkat Gurukrishna created SPARK-21910: -- Summary: Connection pooling in Spark Job using HBASE Context Key: SPARK-21910 URL: https://issues.apache.org/jira/browse/SPARK-21910 Project: Spark

[jira] [Resolved] (SPARK-21909) Checkpoint HBASE Context in Spark Streaming Job

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21909. --- Resolution: Invalid Please stop opening JIRAs with questions. Use the mailing list > Checkpoint HBAS

[jira] [Resolved] (SPARK-21910) Connection pooling in Spark Job using HBASE Context

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21910. --- Resolution: Invalid Please stop opening JIRAs with questions. Use the mailing list > Connection pool

[jira] [Commented] (SPARK-21909) Checkpoint HBASE Context in Spark Streaming Job

2017-09-04 Thread Venkat Gurukrishna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152700#comment-16152700 ] Venkat Gurukrishna commented on SPARK-21909: [~srowen] I tried sending mail f

[jira] [Commented] (SPARK-21910) Connection pooling in Spark Job using HBASE Context

2017-09-04 Thread Venkat Gurukrishna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152699#comment-16152699 ] Venkat Gurukrishna commented on SPARK-21910: [~srowen] I tried sending mail f

[jira] [Commented] (SPARK-21908) Checkpoint broadcast variable in spark streaming job

2017-09-04 Thread Venkat Gurukrishna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152702#comment-16152702 ] Venkat Gurukrishna commented on SPARK-21908: [~srowen] I tried sending mail f

[jira] [Comment Edited] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2017-09-04 Thread Alexandre Dupriez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152745#comment-16152745 ] Alexandre Dupriez edited comment on SPARK-17041 at 9/4/17 3:53 PM:

[jira] [Created] (SPARK-21911) Parallel Model Evaluation for ML Tuning: Python

2017-09-04 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-21911: -- Summary: Parallel Model Evaluation for ML Tuning: Python Key: SPARK-21911 URL: https://issues.apache.org/jira/browse/SPARK-21911 Project: Spark Issue Type: New F

[jira] [Updated] (SPARK-19357) Parallel Model Evaluation for ML Tuning: Scala

2017-09-04 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-19357: --- Summary: Parallel Model Evaluation for ML Tuning: Scala (was: Parallel Model Evaluation for ML Tunin

[jira] [Commented] (SPARK-21911) Parallel Model Evaluation for ML Tuning: Python

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152762#comment-16152762 ] Apache Spark commented on SPARK-21911: -- User 'WeichenXu123' has created a pull reque

[jira] [Assigned] (SPARK-21911) Parallel Model Evaluation for ML Tuning: Python

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21911: Assignee: (was: Apache Spark) > Parallel Model Evaluation for ML Tuning: Python >

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-09-04 Thread Neil McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152764#comment-16152764 ] Neil McQuarrie commented on SPARK-21727: Well, if class is "numeric" (or "integer

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-09-04 Thread Neil McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152766#comment-16152766 ] Neil McQuarrie commented on SPARK-21727: Happy to take on the change this side...

[jira] [Comment Edited] (SPARK-21418) NoSuchElementException: None.get on DataFrame.rdd

2017-09-04 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088952#comment-16088952 ] Daniel Darabos edited comment on SPARK-21418 at 9/4/17 3:49 PM: ---

[jira] [Commented] (SPARK-21418) NoSuchElementException: None.get on DataFrame.rdd

2017-09-04 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152742#comment-16152742 ] Daniel Darabos commented on SPARK-21418: Sorry for the delay. I can confirm that

[jira] [Commented] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2017-09-04 Thread Alexandre Dupriez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152745#comment-16152745 ] Alexandre Dupriez commented on SPARK-17041: --- I would advocate for a message whi

[jira] [Comment Edited] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2017-09-04 Thread Alexandre Dupriez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152745#comment-16152745 ] Alexandre Dupriez edited comment on SPARK-17041 at 9/4/17 3:53 PM:

[jira] [Comment Edited] (SPARK-17041) Columns in schema are no longer case sensitive when reading csv file

2017-09-04 Thread Alexandre Dupriez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152745#comment-16152745 ] Alexandre Dupriez edited comment on SPARK-17041 at 9/4/17 3:54 PM:

[jira] [Updated] (SPARK-21911) Parallel Model Evaluation for ML Tuning: PySpark

2017-09-04 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-21911: --- Summary: Parallel Model Evaluation for ML Tuning: PySpark (was: Parallel Model Evaluation for ML Tun

[jira] [Assigned] (SPARK-21911) Parallel Model Evaluation for ML Tuning: Python

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21911: Assignee: Apache Spark > Parallel Model Evaluation for ML Tuning: Python > ---

[jira] [Updated] (SPARK-21418) NoSuchElementException: None.get on DataFrame.rdd

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21418: -- Priority: Minor (was: Major) I think we could easily make this code a little more defensive so that th

[jira] [Updated] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21418: -- Summary: NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebug

[jira] [Assigned] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21418: Assignee: (was: Apache Spark) > NoSuchElementException: None.get in DataSourceScanExec

[jira] [Commented] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152821#comment-16152821 ] Apache Spark commented on SPARK-21418: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21418: Assignee: Apache Spark > NoSuchElementException: None.get in DataSourceScanExec with > su

[jira] [Commented] (SPARK-21882) OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152914#comment-16152914 ] Apache Spark commented on SPARK-21882: -- User 'awarrior' has created a pull request f

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

2017-09-04 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152915#comment-16152915 ] Matei Zaharia commented on SPARK-21866: --- Just to chime in on this, I've also seen f

[jira] [Created] (SPARK-21912) Creating ORC datasource table should check invalid column names

2017-09-04 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-21912: - Summary: Creating ORC datasource table should check invalid column names Key: SPARK-21912 URL: https://issues.apache.org/jira/browse/SPARK-21912 Project: Spark

[jira] [Assigned] (SPARK-21912) Creating ORC datasource table should check invalid column names

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21912: Assignee: (was: Apache Spark) > Creating ORC datasource table should check invalid col

[jira] [Commented] (SPARK-21912) Creating ORC datasource table should check invalid column names

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152931#comment-16152931 ] Apache Spark commented on SPARK-21912: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-21912) Creating ORC datasource table should check invalid column names

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21912: Assignee: Apache Spark > Creating ORC datasource table should check invalid column names >

[jira] [Resolved] (SPARK-21418) NoSuchElementException: None.get in DataSourceScanExec with sun.io.serialization.extendedDebugInfo=true

2017-09-04 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-21418. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-21905) ClassCastException when call sqlContext.sql on temp table

2017-09-04 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152955#comment-16152955 ] Marco Gaido commented on SPARK-21905: - This is likely to be caused by a bug in the Ma

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-09-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152973#comment-16152973 ] Felix Cheung commented on SPARK-21727: -- precisely. as far as I can tell, everything

[jira] [Comment Edited] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2017-09-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152973#comment-16152973 ] Felix Cheung edited comment on SPARK-21727 at 9/4/17 11:08 PM:

[jira] [Created] (SPARK-21913) `withDatabase` should drop database with CASCADE

2017-09-04 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-21913: - Summary: `withDatabase` should drop database with CASCADE Key: SPARK-21913 URL: https://issues.apache.org/jira/browse/SPARK-21913 Project: Spark Issue Type

[jira] [Assigned] (SPARK-21913) `withDatabase` should drop database with CASCADE

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21913: Assignee: Apache Spark > `withDatabase` should drop database with CASCADE > --

[jira] [Commented] (SPARK-21913) `withDatabase` should drop database with CASCADE

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152977#comment-16152977 ] Apache Spark commented on SPARK-21913: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-21913) `withDatabase` should drop database with CASCADE

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21913: Assignee: (was: Apache Spark) > `withDatabase` should drop database with CASCADE > ---

[jira] [Created] (SPARK-21914) Running examples as tests in SQL builtin function documentation

2017-09-04 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-21914: Summary: Running examples as tests in SQL builtin function documentation Key: SPARK-21914 URL: https://issues.apache.org/jira/browse/SPARK-21914 Project: Spark

[jira] [Commented] (SPARK-21914) Running examples as tests in SQL builtin function documentation

2017-09-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153011#comment-16153011 ] Hyukjin Kwon commented on SPARK-21914: -- [~rxin], would you mind if I ask whether you

[jira] [Commented] (SPARK-19126) Join Documentation Improvements

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153078#comment-16153078 ] Apache Spark commented on SPARK-19126: -- User 'marktab' has created a pull request fo

[jira] [Created] (SPARK-21915) Model 1 and Model 2 ParamMaps Missing

2017-09-04 Thread Mark Tabladillo (JIRA)
Mark Tabladillo created SPARK-21915: --- Summary: Model 1 and Model 2 ParamMaps Missing Key: SPARK-21915 URL: https://issues.apache.org/jira/browse/SPARK-21915 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-21915) Model 1 and Model 2 ParamMaps Missing

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21915: Assignee: (was: Apache Spark) > Model 1 and Model 2 ParamMaps Missing > --

[jira] [Updated] (SPARK-21915) Model 1 and Model 2 ParamMaps Missing

2017-09-04 Thread Mark Tabladillo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Tabladillo updated SPARK-21915: Description: Error in PySpark example code [https://github.com/apache/spark/blob/master/exa

[jira] [Commented] (SPARK-21915) Model 1 and Model 2 ParamMaps Missing

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153084#comment-16153084 ] Apache Spark commented on SPARK-21915: -- User 'marktab' has created a pull request fo

[jira] [Assigned] (SPARK-21915) Model 1 and Model 2 ParamMaps Missing

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21915: Assignee: Apache Spark > Model 1 and Model 2 ParamMaps Missing > -

[jira] [Created] (SPARK-21916) Set isolationOn=true when create client to remote hive metastore

2017-09-04 Thread jin xing (JIRA)
jin xing created SPARK-21916: Summary: Set isolationOn=true when create client to remote hive metastore Key: SPARK-21916 URL: https://issues.apache.org/jira/browse/SPARK-21916 Project: Spark Iss

[jira] [Assigned] (SPARK-21916) Set isolationOn=true when create client to remote hive metastore

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21916: Assignee: Apache Spark > Set isolationOn=true when create client to remote hive metastore

[jira] [Assigned] (SPARK-21916) Set isolationOn=true when create client to remote hive metastore

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21916: Assignee: (was: Apache Spark) > Set isolationOn=true when create client to remote hive

[jira] [Commented] (SPARK-21916) Set isolationOn=true when create client to remote hive metastore

2017-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153126#comment-16153126 ] Apache Spark commented on SPARK-21916: -- User 'jinxing64' has created a pull request

[jira] [Created] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

2017-09-04 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-21917: --- Summary: Remote http(s) resources is not supported in YARN mode Key: SPARK-21917 URL: https://issues.apache.org/jira/browse/SPARK-21917 Project: Spark Issue Ty

[jira] [Commented] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

2017-09-04 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153141#comment-16153141 ] Saisai Shao commented on SPARK-21917: - I'm inclining to choose option 1, the only ove

[jira] [Created] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

2017-09-04 Thread Hu Liu, (JIRA)
Hu Liu, created SPARK-21918: --- Summary: HiveClient shouldn't share Hive object between different thread Key: SPARK-21918 URL: https://issues.apache.org/jira/browse/SPARK-21918 Project: Spark Issue

[jira] [Created] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

2017-09-04 Thread Ashish Chopra (JIRA)
Ashish Chopra created SPARK-21919: - Summary: inconsistent behavior of AFTsurvivalRegression algorithm Key: SPARK-21919 URL: https://issues.apache.org/jira/browse/SPARK-21919 Project: Spark Is

[jira] [Updated] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

2017-09-04 Thread Hu Liu, (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Liu, updated SPARK-21918: Description: I'm testing the spark thrift server and found that all the DDL statements are run by user hiv

[jira] [Created] (SPARK-21920) DataFrame Fail To Find The Column Name

2017-09-04 Thread abhijit nag (JIRA)
abhijit nag created SPARK-21920: --- Summary: DataFrame Fail To Find The Column Name Key: SPARK-21920 URL: https://issues.apache.org/jira/browse/SPARK-21920 Project: Spark Issue Type: Question