[jira] [Commented] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074320#comment-16074320 ] Peng Meng commented on SPARK-21305: --- Thanks [~srowen] and [~yanboliang] I will disable

[jira] [Created] (SPARK-21312) UnsafeRow writeToStream has incorrect offsetInByteArray calculation for non-zero offset

Sumedh Wale created SPARK-21312: --- Summary: UnsafeRow writeToStream has incorrect offsetInByteArray calculation for non-zero offset Key: SPARK-21312 URL: https://issues.apache.org/jira/browse/SPARK-21312

[jira] [Commented] (SPARK-21311) Not able to fetch the data from RDBMS when two spark jobs are accessing the same Database table

[ https://issues.apache.org/jira/browse/SPARK-21311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074315#comment-16074315 ] Hyukjin Kwon commented on SPARK-21311: -- Could you include codes and logs? It sounds

[jira] [Assigned] (SPARK-18623) Add `returnNullable` to `StaticInvoke` and modify it to handle properly.

[ https://issues.apache.org/jira/browse/SPARK-18623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-18623: --- Assignee: Takuya Ueshin > Add `returnNullable` to `StaticInvoke` and modify it to handle pro

[jira] [Resolved] (SPARK-18623) Add `returnNullable` to `StaticInvoke` and modify it to handle properly.

[ https://issues.apache.org/jira/browse/SPARK-18623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18623. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 16056 [https://githu

[jira] [Commented] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill

[ https://issues.apache.org/jira/browse/SPARK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074296#comment-16074296 ] Arun Achuthan commented on SPARK-21303: --- Thank You! But at this momemt we don't h

[jira] [Resolved] (SPARK-21304) remove unnecessary isNull variable for collection related encoder expressions

[ https://issues.apache.org/jira/browse/SPARK-21304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21304. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18529 [https://githu

[jira] [Commented] (SPARK-21289) Text and CSV formats do not support custom end-of-line delimiters

[ https://issues.apache.org/jira/browse/SPARK-21289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074294#comment-16074294 ] Wenchen Fan commented on SPARK-21289: - SGTM > Text and CSV formats do not support cu

[jira] [Comment Edited] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074287#comment-16074287 ] Hyukjin Kwon edited comment on SPARK-21299 at 7/5/17 6:12 AM: -

[jira] [Updated] (SPARK-21247) Type comparision should respect case-sensitive SQL conf

[ https://issues.apache.org/jira/browse/SPARK-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21247: -- Summary: Type comparision should respect case-sensitive SQL conf (was: Allow case-insensitive

[jira] [Commented] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074292#comment-16074292 ] Sean Owen commented on SPARK-21263: --- [~hyukjin.kwon] [~falaki] Yeah I saw "PERMISSIVE"

[jira] [Updated] (SPARK-21247) Type comparision should respect case-sensitive SQL conf

[ https://issues.apache.org/jira/browse/SPARK-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21247: -- Description: Spark supports case-sensitivity in columns. Especially, for Struct types, with ca

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074287#comment-16074287 ] Hyukjin Kwon commented on SPARK-21299: -- The codes here work fine: {code} spark.crea

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074281#comment-16074281 ] jalendhar Baddam commented on SPARK-21299: -- [~hyukjin.kwon] it's not only specif

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074279#comment-16074279 ] jalendhar Baddam commented on SPARK-21299: -- 1.First Load the data into from any

[jira] [Created] (SPARK-21311) Not able to fetch the data from RDBMS when two spark jobs are accessing the same Database table

jalendhar Baddam created SPARK-21311: Summary: Not able to fetch the data from RDBMS when two spark jobs are accessing the same Database table Key: SPARK-21311 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Commented] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074275#comment-16074275 ] Yanbo Liang commented on SPARK-21305: - {quote} For example, for the ALS recommendForA

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074272#comment-16074272 ] Hyukjin Kwon commented on SPARK-21299: -- What I want is to follow and check if I can

[jira] [Assigned] (SPARK-21310) Add offset to PySpark GLM

[ https://issues.apache.org/jira/browse/SPARK-21310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21310: Assignee: Apache Spark > Add offset to PySpark GLM > -- > >

[jira] [Assigned] (SPARK-21310) Add offset to PySpark GLM

[ https://issues.apache.org/jira/browse/SPARK-21310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21310: Assignee: (was: Apache Spark) > Add offset to PySpark GLM > -

[jira] [Commented] (SPARK-21310) Add offset to PySpark GLM

[ https://issues.apache.org/jira/browse/SPARK-21310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074270#comment-16074270 ] Apache Spark commented on SPARK-21310: -- User 'actuaryzhang' has created a pull reque

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074269#comment-16074269 ] Hyukjin Kwon commented on SPARK-21299: -- Logs, the codes and the table contents do no

[jira] [Created] (SPARK-21310) Add offset to PySpark GLM

Wayne Zhang created SPARK-21310: --- Summary: Add offset to PySpark GLM Key: SPARK-21310 URL: https://issues.apache.org/jira/browse/SPARK-21310 Project: Spark Issue Type: New Feature Co

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074261#comment-16074261 ] jalendhar Baddam commented on SPARK-21299: -- policyID,statecode,county,eq_site_li

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074243#comment-16074243 ] Hyukjin Kwon commented on SPARK-21299: -- Do you mind if I ask the contents in the tab

[jira] [Comment Edited] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074241#comment-16074241 ] jalendhar Baddam edited comment on SPARK-21299 at 7/5/17 4:51 AM: -

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074241#comment-16074241 ] jalendhar Baddam commented on SPARK-21299: -- Still we are getting the issue. Data

[jira] [Resolved] (SPARK-21300) ExternalMapToCatalyst should null-check map key prior to converting to internal value.

[ https://issues.apache.org/jira/browse/SPARK-21300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21300. - Resolution: Fixed Assignee: Takuya Ueshin Fix Version/s: 2.3.0

[jira] [Comment Edited] (SPARK-21289) Text and CSV formats do not support custom end-of-line delimiters

[ https://issues.apache.org/jira/browse/SPARK-21289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074185#comment-16074185 ] Hyukjin Kwon edited comment on SPARK-21289 at 7/5/17 3:00 AM: -

[jira] [Comment Edited] (SPARK-21289) Text and CSV formats do not support custom end-of-line delimiters

[ https://issues.apache.org/jira/browse/SPARK-21289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074185#comment-16074185 ] Hyukjin Kwon edited comment on SPARK-21289 at 7/5/17 2:59 AM: -

[jira] [Commented] (SPARK-21289) Text and CSV formats do not support custom end-of-line delimiters

[ https://issues.apache.org/jira/browse/SPARK-21289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074186#comment-16074186 ] Hyukjin Kwon commented on SPARK-21289: -- Just for sure, {code} curl -O https://raw.

[jira] [Commented] (SPARK-21289) Text and CSV formats do not support custom end-of-line delimiters

[ https://issues.apache.org/jira/browse/SPARK-21289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074185#comment-16074185 ] Hyukjin Kwon commented on SPARK-21289: -- I guess it is not entirely impossible given

[jira] [Assigned] (SPARK-21308) Remove SQLConf parameters from the optimizer

[ https://issues.apache.org/jira/browse/SPARK-21308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21308: Assignee: Apache Spark (was: Xiao Li) > Remove SQLConf parameters from the optimizer > --

[jira] [Assigned] (SPARK-21308) Remove SQLConf parameters from the optimizer

[ https://issues.apache.org/jira/browse/SPARK-21308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21308: Assignee: Xiao Li (was: Apache Spark) > Remove SQLConf parameters from the optimizer > --

[jira] [Commented] (SPARK-21308) Remove SQLConf parameters from the optimizer

[ https://issues.apache.org/jira/browse/SPARK-21308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074184#comment-16074184 ] Apache Spark commented on SPARK-21308: -- User 'gatorsmile' has created a pull request

[jira] [Resolved] (SPARK-21295) Confusing error message for missing references

[ https://issues.apache.org/jira/browse/SPARK-21295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21295. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18520 [https://githu

[jira] [Updated] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-20256: Fix Version/s: 2.1.2 > Fail to start SparkContext/SparkSession with Hive support enabled when user

[jira] [Updated] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill

[ https://issues.apache.org/jira/browse/SPARK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21303: -- Target Version/s: (was: 2.1.1) > Web-UI shows some Jobs get stuck randomly and stays like tha

[jira] [Updated] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill

[ https://issues.apache.org/jira/browse/SPARK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21303: -- Fix Version/s: (was: 2.1.1) > Web-UI shows some Jobs get stuck randomly and stays like that

[jira] [Resolved] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21299. -- Resolution: Cannot Reproduce I am resolving this as I can't reproduce this given the informatio

[jira] [Assigned] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21263: Assignee: (was: Apache Spark) > NumberFormatException is not thrown while converting a

[jira] [Commented] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074121#comment-16074121 ] Apache Spark commented on SPARK-21263: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21263: Assignee: Apache Spark > NumberFormatException is not thrown while converting an invalid s

[jira] [Commented] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074118#comment-16074118 ] Hyukjin Kwon commented on SPARK-21263: -- Ah, sorry, the original JIRA describes why i

[jira] [Commented] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074113#comment-16074113 ] Hyukjin Kwon commented on SPARK-21263: -- Let me propose a change soon but Hm.. [~fala

[jira] [Assigned] (SPARK-21307) Remove SQLConf parameters from the parser-related classes.

[ https://issues.apache.org/jira/browse/SPARK-21307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21307: Assignee: Apache Spark (was: Xiao Li) > Remove SQLConf parameters from the parser-related

[jira] [Commented] (SPARK-21307) Remove SQLConf parameters from the parser-related classes.

[ https://issues.apache.org/jira/browse/SPARK-21307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074112#comment-16074112 ] Apache Spark commented on SPARK-21307: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-21307) Remove SQLConf parameters from the parser-related classes.

[ https://issues.apache.org/jira/browse/SPARK-21307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21307: Assignee: Xiao Li (was: Apache Spark) > Remove SQLConf parameters from the parser-related

[jira] [Commented] (SPARK-21263) NumberFormatException is not thrown while converting an invalid string to float/double

[ https://issues.apache.org/jira/browse/SPARK-21263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16074109#comment-16074109 ] Hossein Falaki commented on SPARK-21263: [~sowen] note that user specified the mo

[jira] [Created] (SPARK-21308) Remove SQLConf parameters from the optimizer

Xiao Li created SPARK-21308: --- Summary: Remove SQLConf parameters from the optimizer Key: SPARK-21308 URL: https://issues.apache.org/jira/browse/SPARK-21308 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-21309) Remove SQLConf parameters from the analyzer

Xiao Li created SPARK-21309: --- Summary: Remove SQLConf parameters from the analyzer Key: SPARK-21309 URL: https://issues.apache.org/jira/browse/SPARK-21309 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-21307) Remove SQLConf parameters from the parser-related classes.

Xiao Li created SPARK-21307: --- Summary: Remove SQLConf parameters from the parser-related classes. Key: SPARK-21307 URL: https://issues.apache.org/jira/browse/SPARK-21307 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073987#comment-16073987 ] yuhao yang edited comment on SPARK-11069 at 7/4/17 6:32 PM:

[jira] [Comment Edited] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073987#comment-16073987 ] yuhao yang edited comment on SPARK-11069 at 7/4/17 6:31 PM:

[jira] [Commented] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073987#comment-16073987 ] yuhao yang commented on SPARK-11069: [~levente.torok.ge] use val regexTokenizer

[jira] [Commented] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073952#comment-16073952 ] Apache Spark commented on SPARK-20256: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Commented] (SPARK-20107) Add spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version option to configuration.md

[ https://issues.apache.org/jira/browse/SPARK-20107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073951#comment-16073951 ] Steve Loughran commented on SPARK-20107: If you are curious, I've just written ou

[jira] [Assigned] (SPARK-21268) Move center calculations to a distributed map in KMeans

[ https://issues.apache.org/jira/browse/SPARK-21268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21268: - Assignee: Guillaume Dardelet > Move center calculations to a distributed map in KMeans > ---

[jira] [Resolved] (SPARK-21268) Move center calculations to a distributed map in KMeans

[ https://issues.apache.org/jira/browse/SPARK-21268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21268. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18491 [https://github.co

[jira] [Commented] (SPARK-20946) simplify the config setting logic in SparkSession.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-20946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073907#comment-16073907 ] Dongjoon Hyun commented on SPARK-20946: --- Hi, [~cloud_fan]. How do we handle this is

[jira] [Resolved] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20256. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 2.2.1 >

[jira] [Resolved] (SPARK-19726) Faild to insert null timestamp value to mysql using spark jdbc

[ https://issues.apache.org/jira/browse/SPARK-19726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19726. - Resolution: Fixed Assignee: wangshuangshuang Fix Version/s: 2.3.0 > Faild to insert null

[jira] [Created] (SPARK-21306) OneVsRest Conceals Columns That May Be Relevant To Underlying Classifier

Cathal Garvey created SPARK-21306: - Summary: OneVsRest Conceals Columns That May Be Relevant To Underlying Classifier Key: SPARK-21306 URL: https://issues.apache.org/jira/browse/SPARK-21306 Project: S

[jira] [Commented] (SPARK-18191) Port RDD API to use commit protocol

[ https://issues.apache.org/jira/browse/SPARK-18191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073860#comment-16073860 ] Artur Sukhenko commented on SPARK-18191: [~shridharama] Yes, updated 'Fix Version

[jira] [Updated] (SPARK-18191) Port RDD API to use commit protocol

[ https://issues.apache.org/jira/browse/SPARK-18191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artur Sukhenko updated SPARK-18191: --- Fix Version/s: (was: 2.1.0) 2.2.0 > Port RDD API to use commit protoco

[jira] [Comment Edited] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073801#comment-16073801 ] Peng Meng edited comment on SPARK-21305 at 7/4/17 3:39 PM: --- yes

[jira] [Commented] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073801#comment-16073801 ] Peng Meng commented on SPARK-21305: --- yes, I will do that. Because different blas, the

[jira] [Commented] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073798#comment-16073798 ] Peng Meng commented on SPARK-21305: --- ping [~mlnick] , [~yanboliang], [~mengxr], [~srowe

[jira] [Commented] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

[ https://issues.apache.org/jira/browse/SPARK-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073789#comment-16073789 ] Sean Owen commented on SPARK-21305: --- OK, can you propose a concrete change to the docs?

[jira] [Created] (SPARK-21305) The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance

Peng Meng created SPARK-21305: - Summary: The BKM (best known methods) of using native BLAS to improvement ML/MLLIB performance Key: SPARK-21305 URL: https://issues.apache.org/jira/browse/SPARK-21305 Proje

[jira] [Assigned] (SPARK-21304) remove unnecessary isNull variable for collection related encoder expressions

[ https://issues.apache.org/jira/browse/SPARK-21304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21304: Assignee: Wenchen Fan (was: Apache Spark) > remove unnecessary isNull variable for collec

[jira] [Commented] (SPARK-21304) remove unnecessary isNull variable for collection related encoder expressions

[ https://issues.apache.org/jira/browse/SPARK-21304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073754#comment-16073754 ] Apache Spark commented on SPARK-21304: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-21304) remove unnecessary isNull variable for collection related encoder expressions

[ https://issues.apache.org/jira/browse/SPARK-21304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21304: Assignee: Apache Spark (was: Wenchen Fan) > remove unnecessary isNull variable for collec

[jira] [Updated] (SPARK-21278) Upgrade to Py4J 0.10.6

[ https://issues.apache.org/jira/browse/SPARK-21278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21278: -- Summary: Upgrade to Py4J 0.10.6 (was: Upgrade to Py4J 0.10.5) > Upgrade to Py4J 0.10.6 > -

[jira] [Commented] (SPARK-21278) Upgrade to Py4J 0.10.6

[ https://issues.apache.org/jira/browse/SPARK-21278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073749#comment-16073749 ] Dongjoon Hyun commented on SPARK-21278: --- 0.10.6 will be release at the end of this

[jira] [Created] (SPARK-21304) remove unnecessary isNull variable for collection related encoder expressions

Wenchen Fan created SPARK-21304: --- Summary: remove unnecessary isNull variable for collection related encoder expressions Key: SPARK-21304 URL: https://issues.apache.org/jira/browse/SPARK-21304 Project:

[jira] [Updated] (SPARK-21254) History UI: Taking over 1 minute for initial page display

[ https://issues.apache.org/jira/browse/SPARK-21254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Parfenchik updated SPARK-21254: -- Description: Currently on the first page load (if there is no limit set) the whole jobs

[jira] [Commented] (SPARK-13041) Add a driver history ui link and a mesos sandbox link on the dispatcher's ui page for each driver

[ https://issues.apache.org/jira/browse/SPARK-13041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073656#comment-16073656 ] Apache Spark commented on SPARK-13041: -- User 'skonto' has created a pull request for

[jira] [Assigned] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21101: Assignee: Apache Spark > Error running Hive temporary UDTF on latest Spark 2.2 > -

[jira] [Assigned] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21101: Assignee: (was: Apache Spark) > Error running Hive temporary UDTF on latest Spark 2.2

[jira] [Commented] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073653#comment-16073653 ] Apache Spark commented on SPARK-21101: -- User 'wangyum' has created a pull request fo

[jira] [Assigned] (SPARK-19507) pyspark.sql.types._verify_type() exceptions too broad to debug collections or nested data

[ https://issues.apache.org/jira/browse/SPARK-19507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-19507: --- Assignee: Hyukjin Kwon > pyspark.sql.types._verify_type() exceptions too broad to debug coll

[jira] [Assigned] (SPARK-21296) Avoid per-record type dispatch in PySpark createDataFrame schema verification

[ https://issues.apache.org/jira/browse/SPARK-21296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21296: --- Assignee: Hyukjin Kwon > Avoid per-record type dispatch in PySpark createDataFrame schema ve

[jira] [Resolved] (SPARK-19507) pyspark.sql.types._verify_type() exceptions too broad to debug collections or nested data

[ https://issues.apache.org/jira/browse/SPARK-19507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19507. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18521 [https://githu

[jira] [Resolved] (SPARK-21296) Avoid per-record type dispatch in PySpark createDataFrame schema verification

[ https://issues.apache.org/jira/browse/SPARK-21296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21296. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18521 [https://githu

[jira] [Commented] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill

[ https://issues.apache.org/jira/browse/SPARK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073540#comment-16073540 ] Sean Owen commented on SPARK-21303: --- I don't think this narrows it down nearly enough t

[jira] [Commented] (SPARK-21302) history server WebUI show HTTP ERROR 500

[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073539#comment-16073539 ] Jason Pan commented on SPARK-21302: --- There are no early erros. And in spark 161, there

[jira] [Commented] (SPARK-21302) history server WebUI show HTTP ERROR 500

[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073532#comment-16073532 ] Jason Pan commented on SPARK-21302: --- Reproduce steps: 1. run a SparkPI 2. navigate to h

[jira] [Updated] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill

[ https://issues.apache.org/jira/browse/SPARK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Achuthan updated SPARK-21303: -- Summary: Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to kill (

[jira] [Created] (SPARK-21303) Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to Kill

Arun Achuthan created SPARK-21303: - Summary: Web-UI shows some Jobs get stuck randomly and stays like that. Neither able to Kill Key: SPARK-21303 URL: https://issues.apache.org/jira/browse/SPARK-21303

[jira] [Updated] (SPARK-21302) history server WebUI show HTTP ERROR 500

[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Pan updated SPARK-21302: -- Attachment: npe.PNG > history server WebUI show HTTP ERROR 500 > --

[jira] [Commented] (SPARK-21302) history server WebUI show HTTP ERROR 500

[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073518#comment-16073518 ] Sean Owen commented on SPARK-21302: --- How do you reproduce it? are there early errors? t

[jira] [Created] (SPARK-21302) history server WebUI show HTTP ERROR 500

Jason Pan created SPARK-21302: - Summary: history server WebUI show HTTP ERROR 500 Key: SPARK-21302 URL: https://issues.apache.org/jira/browse/SPARK-21302 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073508#comment-16073508 ] Levente Torok edited comment on SPARK-11069 at 7/4/17 11:36 AM: ---

[jira] [Commented] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073508#comment-16073508 ] Levente Torok commented on SPARK-11069: --- With this modification, in v1.6.x, there i

[jira] [Commented] (SPARK-21299) except is throwing the fallowing exception after perform dropDuplicates on the Dataset object

[ https://issues.apache.org/jira/browse/SPARK-21299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073498#comment-16073498 ] Sean Owen commented on SPARK-21299: --- Just dumping a plan / stacktrace doesn't help. Thi

[jira] [Commented] (SPARK-19451) Long values in Window function

[ https://issues.apache.org/jira/browse/SPARK-19451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073385#comment-16073385 ] Julien Champ commented on SPARK-19451: -- Any news on this bug / feature request ? Or

[jira] [Issue Comment Deleted] (SPARK-19451) Long values in Window function

[ https://issues.apache.org/jira/browse/SPARK-19451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Champ updated SPARK-19451: - Comment: was deleted (was: Any news on this bug / feature request ?) > Long values in Window fun

[jira] [Created] (SPARK-21301) Should abort active taskSets or kill all running Tasks when that stage success.

SuYan created SPARK-21301: - Summary: Should abort active taskSets or kill all running Tasks when that stage success. Key: SPARK-21301 URL: https://issues.apache.org/jira/browse/SPARK-21301 Project: Spark

[jira] [Assigned] (SPARK-21298) The class "StorageListener" method "onStageSubmitted" don't need to change name when don't exist corresponding key

[ https://issues.apache.org/jira/browse/SPARK-21298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21298: Assignee: Apache Spark > The class "StorageListener" method "onStageSubmitted" don't need

  1   2   >