[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread jalendhar Baddam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074281#comment-16074281 ] jalendhar Baddam commented on SPARK-21299: -- [~hyukjin.kwon] it's not only specific to added

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread jalendhar Baddam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074279#comment-16074279 ] jalendhar Baddam commented on SPARK-21299: -- 1.First Load the data into from any data source like

[jira] [Created] (SPARK-21311) Not able to fetch the data from RDBMS when two spark jobs are accessing the same Database table

2017-07-04 Thread jalendhar Baddam (JIRA)
jalendhar Baddam created SPARK-21311: Summary: Not able to fetch the data from RDBMS when two spark jobs are accessing the same Database table Key: SPARK-21311 URL:

[jira] [Commented] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

2017-07-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074275#comment-16074275 ] Yanbo Liang commented on SPARK-21305: - {quote} For example, for the ALS recommendForAll method before

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074272#comment-16074272 ] Hyukjin Kwon commented on SPARK-21299: -- What I want is to follow and check if I can reproduce this

[jira] [Assigned] (SPARK-21310) Add offset to PySpark GLM

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21310: Assignee: Apache Spark > Add offset to PySpark GLM > -- > >

[jira] [Assigned] (SPARK-21310) Add offset to PySpark GLM

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21310: Assignee: (was: Apache Spark) > Add offset to PySpark GLM >

[jira] [Commented] (SPARK-21310) Add offset to PySpark GLM

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074270#comment-16074270 ] Apache Spark commented on SPARK-21310: -- User 'actuaryzhang' has created a pull request for this

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074269#comment-16074269 ] Hyukjin Kwon commented on SPARK-21299: -- Logs, the codes and the table contents do not match. >

[jira] [Created] (SPARK-21310) Add offset to PySpark GLM

2017-07-04 Thread Wayne Zhang (JIRA)
Wayne Zhang created SPARK-21310: --- Summary: Add offset to PySpark GLM Key: SPARK-21310 URL: https://issues.apache.org/jira/browse/SPARK-21310 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread jalendhar Baddam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074261#comment-16074261 ] jalendhar Baddam commented on SPARK-21299: --

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074243#comment-16074243 ] Hyukjin Kwon commented on SPARK-21299: -- Do you mind if I ask the contents in the table? > except is

[jira] [Comment Edited] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread jalendhar Baddam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074241#comment-16074241 ] jalendhar Baddam edited comment on SPARK-21299 at 7/5/17 4:51 AM: -- Still

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread jalendhar Baddam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074241#comment-16074241 ] jalendhar Baddam commented on SPARK-21299: -- Still we are getting the issue. Dataset

[jira] [Resolved] (SPARK-21300) ExternalMapToCatalyst should null-check map key prior to converting to internal value.

2017-07-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21300. - Resolution: Fixed Assignee: Takuya Ueshin Fix Version/s: 2.3.0

[jira] [Comment Edited] (SPARK-21289) Text and CSV formats do not support custom end-of-line delimiters

2017-07-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074185#comment-16074185 ] Hyukjin Kwon edited comment on SPARK-21289 at 7/5/17 3:00 AM: -- I guess it is

[jira] [Comment Edited] (SPARK-21289) Text and CSV formats do not support custom end-of-line delimiters

2017-07-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074185#comment-16074185 ] Hyukjin Kwon edited comment on SPARK-21289 at 7/5/17 2:59 AM: -- I guess it is

[jira] [Commented] (SPARK-21289) Text and CSV formats do not support custom end-of-line delimiters

2017-07-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074186#comment-16074186 ] Hyukjin Kwon commented on SPARK-21289: -- Just for sure, {code} curl -O

[jira] [Commented] (SPARK-21289) Text and CSV formats do not support custom end-of-line delimiters

2017-07-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074185#comment-16074185 ] Hyukjin Kwon commented on SPARK-21289: -- I guess it is not entirely impossible given my past

[jira] [Assigned] (SPARK-21308) Remove SQLConf parameters from the optimizer

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21308: Assignee: Apache Spark (was: Xiao Li) > Remove SQLConf parameters from the optimizer >

[jira] [Assigned] (SPARK-21308) Remove SQLConf parameters from the optimizer

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21308: Assignee: Xiao Li (was: Apache Spark) > Remove SQLConf parameters from the optimizer >

[jira] [Commented] (SPARK-21308) Remove SQLConf parameters from the optimizer

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074184#comment-16074184 ] Apache Spark commented on SPARK-21308: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Resolved] (SPARK-21295) Confusing error message for missing references

2017-07-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21295. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18520

[jira] [Updated] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

2017-07-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-20256: Fix Version/s: 2.1.2 > Fail to start SparkContext/SparkSession with Hive support enabled when user

[jira] [Updated] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill

2017-07-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21303: -- Target Version/s: (was: 2.1.1) > Web-UI shows some Jobs get stuck randomly and stays like

[jira] [Updated] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill

2017-07-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21303: -- Fix Version/s: (was: 2.1.1) > Web-UI shows some Jobs get stuck randomly and stays like

[jira] [Resolved] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21299. -- Resolution: Cannot Reproduce I am resolving this as I can't reproduce this given the

[jira] [Assigned] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21263: Assignee: (was: Apache Spark) > NumberFormatException is not thrown while converting

[jira] [Commented] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074121#comment-16074121 ] Apache Spark commented on SPARK-21263: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21263: Assignee: Apache Spark > NumberFormatException is not thrown while converting an invalid

[jira] [Commented] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

2017-07-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074118#comment-16074118 ] Hyukjin Kwon commented on SPARK-21263: -- Ah, sorry, the original JIRA describes why it does not throw

[jira] [Commented] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

2017-07-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074113#comment-16074113 ] Hyukjin Kwon commented on SPARK-21263: -- Let me propose a change soon but Hm.. [~falaki], however,

[jira] [Assigned] (SPARK-21307) Remove SQLConf parameters from the parser-related classes.

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21307: Assignee: Apache Spark (was: Xiao Li) > Remove SQLConf parameters from the

[jira] [Commented] (SPARK-21307) Remove SQLConf parameters from the parser-related classes.

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074112#comment-16074112 ] Apache Spark commented on SPARK-21307: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21307) Remove SQLConf parameters from the parser-related classes.

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21307: Assignee: Xiao Li (was: Apache Spark) > Remove SQLConf parameters from the

[jira] [Commented] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

2017-07-04 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074109#comment-16074109 ] Hossein Falaki commented on SPARK-21263: [~sowen] note that user specified the mode to be

[jira] [Created] (SPARK-21308) Remove SQLConf parameters from the optimizer

2017-07-04 Thread Xiao Li (JIRA)
Xiao Li created SPARK-21308: --- Summary: Remove SQLConf parameters from the optimizer Key: SPARK-21308 URL: https://issues.apache.org/jira/browse/SPARK-21308 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-21309) Remove SQLConf parameters from the analyzer

2017-07-04 Thread Xiao Li (JIRA)
Xiao Li created SPARK-21309: --- Summary: Remove SQLConf parameters from the analyzer Key: SPARK-21309 URL: https://issues.apache.org/jira/browse/SPARK-21309 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-21307) Remove SQLConf parameters from the parser-related classes.

2017-07-04 Thread Xiao Li (JIRA)
Xiao Li created SPARK-21307: --- Summary: Remove SQLConf parameters from the parser-related classes. Key: SPARK-21307 URL: https://issues.apache.org/jira/browse/SPARK-21307 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

2017-07-04 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073987#comment-16073987 ] yuhao yang edited comment on SPARK-11069 at 7/4/17 6:32 PM:

[jira] [Comment Edited] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

2017-07-04 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073987#comment-16073987 ] yuhao yang edited comment on SPARK-11069 at 7/4/17 6:31 PM:

[jira] [Commented] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

2017-07-04 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073987#comment-16073987 ] yuhao yang commented on SPARK-11069: [~levente.torok.ge] use val regexTokenizer = new

[jira] [Commented] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073952#comment-16073952 ] Apache Spark commented on SPARK-20256: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-20107) Add spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version option to configuration.md

2017-07-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073951#comment-16073951 ] Steve Loughran commented on SPARK-20107: If you are curious, I've just written out the v1 and v2

[jira] [Assigned] (SPARK-21268) Move center calculations to a distributed map in KMeans

2017-07-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21268: - Assignee: Guillaume Dardelet > Move center calculations to a distributed map in KMeans >

[jira] [Resolved] (SPARK-21268) Move center calculations to a distributed map in KMeans

2017-07-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21268. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18491

[jira] [Commented] (SPARK-20946) simplify the config setting logic in SparkSession.getOrCreate

2017-07-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073907#comment-16073907 ] Dongjoon Hyun commented on SPARK-20946: --- Hi, [~cloud_fan]. How do we handle this issue now? >

[jira] [Resolved] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

2017-07-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20256. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 2.2.1

[jira] [Resolved] (SPARK-19726) Faild to insert null timestamp value to mysql using spark jdbc

2017-07-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19726. - Resolution: Fixed Assignee: wangshuangshuang Fix Version/s: 2.3.0 > Faild to insert null

[jira] [Created] (SPARK-21306) OneVsRest Conceals Columns That May Be Relevant To Underlying Classifier

2017-07-04 Thread Cathal Garvey (JIRA)
Cathal Garvey created SPARK-21306: - Summary: OneVsRest Conceals Columns That May Be Relevant To Underlying Classifier Key: SPARK-21306 URL: https://issues.apache.org/jira/browse/SPARK-21306 Project:

[jira] [Commented] (SPARK-18191) Port RDD API to use commit protocol

2017-07-04 Thread Artur Sukhenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073860#comment-16073860 ] Artur Sukhenko commented on SPARK-18191: [~shridharama] Yes, updated 'Fix Version' from 2.1 to

[jira] [Updated] (SPARK-18191) Port RDD API to use commit protocol

2017-07-04 Thread Artur Sukhenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artur Sukhenko updated SPARK-18191: --- Fix Version/s: (was: 2.1.0) 2.2.0 > Port RDD API to use commit

[jira] [Comment Edited] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

2017-07-04 Thread Peng Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073801#comment-16073801 ] Peng Meng edited comment on SPARK-21305 at 7/4/17 3:39 PM: --- yes, I will do

[jira] [Commented] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

2017-07-04 Thread Peng Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073801#comment-16073801 ] Peng Meng commented on SPARK-21305: --- yes, I will do that. Because different blas, the method to

[jira] [Commented] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

2017-07-04 Thread Peng Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073798#comment-16073798 ] Peng Meng commented on SPARK-21305: --- ping [~mlnick] , [~yanboliang], [~mengxr], [~srowen] > The BKM

[jira] [Commented] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

2017-07-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073789#comment-16073789 ] Sean Owen commented on SPARK-21305: --- OK, can you propose a concrete change to the docs? is there a way

[jira] [Created] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

2017-07-04 Thread Peng Meng (JIRA)
Peng Meng created SPARK-21305: - Summary: The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance Key: SPARK-21305 URL: https://issues.apache.org/jira/browse/SPARK-21305

[jira] [Assigned] (SPARK-21304) remove unnecessary isNull variable for collection related encoder expressions

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21304: Assignee: Wenchen Fan (was: Apache Spark) > remove unnecessary isNull variable for

[jira] [Commented] (SPARK-21304) remove unnecessary isNull variable for collection related encoder expressions

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073754#comment-16073754 ] Apache Spark commented on SPARK-21304: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21304) remove unnecessary isNull variable for collection related encoder expressions

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21304: Assignee: Apache Spark (was: Wenchen Fan) > remove unnecessary isNull variable for

[jira] [Updated] (SPARK-21278) Upgrade to Py4J 0.10.6

2017-07-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21278: -- Summary: Upgrade to Py4J 0.10.6 (was: Upgrade to Py4J 0.10.5) > Upgrade to Py4J 0.10.6 >

[jira] [Commented] (SPARK-21278) Upgrade to Py4J 0.10.6

2017-07-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073749#comment-16073749 ] Dongjoon Hyun commented on SPARK-21278: --- 0.10.6 will be release at the end of this week. I'll try

[jira] [Created] (SPARK-21304) remove unnecessary isNull variable for collection related encoder expressions

2017-07-04 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-21304: --- Summary: remove unnecessary isNull variable for collection related encoder expressions Key: SPARK-21304 URL: https://issues.apache.org/jira/browse/SPARK-21304 Project:

[jira] [Updated] (SPARK-21254) History UI: Taking over 1 minute for initial page display

2017-07-04 Thread Dmitry Parfenchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Parfenchik updated SPARK-21254: -- Description: Currently on the first page load (if there is no limit set) the whole

[jira] [Commented] (SPARK-13041) Add a driver history ui link and a mesos sandbox link on the dispatcher's ui page for each driver

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073656#comment-16073656 ] Apache Spark commented on SPARK-13041: -- User 'skonto' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21101: Assignee: Apache Spark > Error running Hive temporary UDTF on latest Spark 2.2 >

[jira] [Assigned] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21101: Assignee: (was: Apache Spark) > Error running Hive temporary UDTF on latest Spark 2.2

[jira] [Commented] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073653#comment-16073653 ] Apache Spark commented on SPARK-21101: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19507) pyspark.sql.types._verify_type() exceptions too broad to debug collections or nested data

2017-07-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-19507: --- Assignee: Hyukjin Kwon > pyspark.sql.types._verify_type() exceptions too broad to debug

[jira] [Assigned] (SPARK-21296) Avoid per-record type dispatch in PySpark createDataFrame schema verification

2017-07-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21296: --- Assignee: Hyukjin Kwon > Avoid per-record type dispatch in PySpark createDataFrame schema

[jira] [Resolved] (SPARK-19507) pyspark.sql.types._verify_type() exceptions too broad to debug collections or nested data

2017-07-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19507. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18521

[jira] [Resolved] (SPARK-21296) Avoid per-record type dispatch in PySpark createDataFrame schema verification

2017-07-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21296. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18521

[jira] [Commented] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill

2017-07-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073540#comment-16073540 ] Sean Owen commented on SPARK-21303: --- I don't think this narrows it down nearly enough to be a Spark

[jira] [Commented] (SPARK-21302) history server WebUI show HTTP ERROR 500

2017-07-04 Thread Jason Pan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073539#comment-16073539 ] Jason Pan commented on SPARK-21302: --- There are no early erros. And in spark 161, there is no this

[jira] [Commented] (SPARK-21302) history server WebUI show HTTP ERROR 500

2017-07-04 Thread Jason Pan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073532#comment-16073532 ] Jason Pan commented on SPARK-21302: --- Reproduce steps: 1. run a SparkPI 2. navigate to history server

[jira] [Updated] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill

2017-07-04 Thread Arun Achuthan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Achuthan updated SPARK-21303: -- Summary: Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill

[jira] [Created] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to Kill

2017-07-04 Thread Arun Achuthan (JIRA)
Arun Achuthan created SPARK-21303: - Summary: Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to Kill Key: SPARK-21303 URL: https://issues.apache.org/jira/browse/SPARK-21303

[jira] [Updated] (SPARK-21302) history server WebUI show HTTP ERROR 500

2017-07-04 Thread Jason Pan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Pan updated SPARK-21302: -- Attachment: npe.PNG > history server WebUI show HTTP ERROR 500 >

[jira] [Commented] (SPARK-21302) history server WebUI show HTTP ERROR 500

2017-07-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073518#comment-16073518 ] Sean Owen commented on SPARK-21302: --- How do you reproduce it? are there early errors? that's an error

[jira] [Created] (SPARK-21302) history server WebUI show HTTP ERROR 500

2017-07-04 Thread Jason Pan (JIRA)
Jason Pan created SPARK-21302: - Summary: history server WebUI show HTTP ERROR 500 Key: SPARK-21302 URL: https://issues.apache.org/jira/browse/SPARK-21302 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

2017-07-04 Thread Levente Torok (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073508#comment-16073508 ] Levente Torok edited comment on SPARK-11069 at 7/4/17 11:36 AM: With this

[jira] [Commented] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

2017-07-04 Thread Levente Torok (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073508#comment-16073508 ] Levente Torok commented on SPARK-11069: --- With this modification, in v1.6.x, there is no way to

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073498#comment-16073498 ] Sean Owen commented on SPARK-21299: --- Just dumping a plan / stacktrace doesn't help. This doesn't

[jira] [Commented] (SPARK-19451) Long values in Window function

2017-07-04 Thread Julien Champ (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073385#comment-16073385 ] Julien Champ commented on SPARK-19451: -- Any news on this bug / feature request ? Or any workaround

[jira] [Issue Comment Deleted] (SPARK-19451) Long values in Window function

2017-07-04 Thread Julien Champ (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Champ updated SPARK-19451: - Comment: was deleted (was: Any news on this bug / feature request ?) > Long values in Window

[jira] [Created] (SPARK-21301) Should abort active taskSets or kill all running Tasks when that stage success.

2017-07-04 Thread SuYan (JIRA)
SuYan created SPARK-21301: - Summary: Should abort active taskSets or kill all running Tasks when that stage success. Key: SPARK-21301 URL: https://issues.apache.org/jira/browse/SPARK-21301 Project: Spark

[jira] [Assigned] (SPARK-21298) The class "StorageListener" method "onStageSubmitted" don't need to change name when don't exist corresponding key

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21298: Assignee: Apache Spark > The class "StorageListener" method "onStageSubmitted" don't need

[jira] [Commented] (SPARK-21298) The class "StorageListener" method "onStageSubmitted" don't need to change name when don't exist corresponding key

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073251#comment-16073251 ] Apache Spark commented on SPARK-21298: -- User 'Geek-He' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21298) The class "StorageListener" method "onStageSubmitted" don't need to change name when don't exist corresponding key

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21298: Assignee: (was: Apache Spark) > The class "StorageListener" method "onStageSubmitted"

[jira] [Commented] (SPARK-21297) Add State in 'Session Statistics' table and add count in 'JDBC/ODBC Server' page.

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073228#comment-16073228 ] Apache Spark commented on SPARK-21297: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Assigned] (SPARK-21297) Add State in 'Session Statistics' table and add count in 'JDBC/ODBC Server' page.

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21297: Assignee: (was: Apache Spark) > Add State in 'Session Statistics' table and add count

[jira] [Assigned] (SPARK-21297) Add State in 'Session Statistics' table and add count in 'JDBC/ODBC Server' page.

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21297: Assignee: Apache Spark > Add State in 'Session Statistics' table and add count in

[jira] [Closed] (SPARK-21288) Several files are missing in the results of the execution of the spark application.

2017-07-04 Thread Constantine Solovev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Constantine Solovev closed SPARK-21288. --- Resolution: Not A Problem > Several files are missing in the results of the

[jira] [Commented] (SPARK-21288) Several files are missing in the results of the execution of the spark application.

2017-07-04 Thread Constantine Solovev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073223#comment-16073223 ] Constantine Solovev commented on SPARK-21288: - I found the problem. When application 1 write

[jira] [Assigned] (SPARK-21300) ExternalMapToCatalyst should null-check map key prior to converting to internal value.

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21300: Assignee: Apache Spark > ExternalMapToCatalyst should null-check map key prior to

[jira] [Commented] (SPARK-21300) ExternalMapToCatalyst should null-check map key prior to converting to internal value.

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073219#comment-16073219 ] Apache Spark commented on SPARK-21300: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21300) ExternalMapToCatalyst should null-check map key prior to converting to internal value.

2017-07-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21300: Assignee: (was: Apache Spark) > ExternalMapToCatalyst should null-check map key prior

[jira] [Created] (SPARK-21300) ExternalMapToCatalyst should null-check map key prior to converting to internal value.

2017-07-04 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-21300: - Summary: ExternalMapToCatalyst should null-check map key prior to converting to internal value. Key: SPARK-21300 URL: https://issues.apache.org/jira/browse/SPARK-21300

[jira] [Updated] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread jalendhar Baddam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jalendhar Baddam updated SPARK-21299: - Description: INFO: org.apache.spark.sql.AnalysisException: resolved attribute(s)

[jira] [Created] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

2017-07-04 Thread jalendhar Baddam (JIRA)
jalendhar Baddam created SPARK-21299: Summary: except is throwing the fallowing exception after perform dropDuplicates on the Dataset object Key: SPARK-21299 URL:

  1   2   >