[jira] [Commented] (SPARK-21331) java.lang.NullPointerException for certain methods in classes of MLlib

[ https://issues.apache.org/jira/browse/SPARK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077701#comment-16077701 ] Sean Owen commented on SPARK-21331: --- I don't see evidence that the NPE is related to co

[jira] [Updated] (SPARK-20690) Subqueries in FROM should have alias names

[ https://issues.apache.org/jira/browse/SPARK-20690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-20690: Labels: (was: release-notes) > Subqueries in FROM should have alias names > -

[jira] [Updated] (SPARK-21335) support un-aliased subquery

[ https://issues.apache.org/jira/browse/SPARK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-21335: Labels: release-notes (was: ) > support un-aliased subquery > --- > >

[jira] [Updated] (SPARK-21335) support un-aliased subquery

[ https://issues.apache.org/jira/browse/SPARK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-21335: Description: un-aliased subquery is supported by Spark SQL for a long time. Its semantic was not w

[jira] [Commented] (SPARK-20706) Spark-shell not overriding method/variable definition

[ https://issues.apache.org/jira/browse/SPARK-20706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077691#comment-16077691 ] Raphael Roth commented on SPARK-20706: -- [~sowen] I think this is quite significant,

[jira] [Updated] (SPARK-20706) Spark-shell not overriding method/variable definition

[ https://issues.apache.org/jira/browse/SPARK-20706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raphael Roth updated SPARK-20706: - Description: In the following example, the definition of myMethod is not correctly updated:

[jira] [Assigned] (SPARK-21336) Revise rand comparison in BatchEvalPythonExecSuite

[ https://issues.apache.org/jira/browse/SPARK-21336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21336: Assignee: (was: Apache Spark) > Revise rand comparison in BatchEvalPythonExecSuite > -

[jira] [Assigned] (SPARK-21336) Revise rand comparison in BatchEvalPythonExecSuite

[ https://issues.apache.org/jira/browse/SPARK-21336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21336: Assignee: Apache Spark > Revise rand comparison in BatchEvalPythonExecSuite >

[jira] [Commented] (SPARK-21336) Revise rand comparison in BatchEvalPythonExecSuite

[ https://issues.apache.org/jira/browse/SPARK-21336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077646#comment-16077646 ] Apache Spark commented on SPARK-21336: -- User 'gengliangwang' has created a pull requ

[jira] [Created] (SPARK-21336) Revise rand comparison in BatchEvalPythonExecSuite

Gengliang Wang created SPARK-21336: -- Summary: Revise rand comparison in BatchEvalPythonExecSuite Key: SPARK-21336 URL: https://issues.apache.org/jira/browse/SPARK-21336 Project: Spark Issue

[jira] [Commented] (SPARK-21331) java.lang.NullPointerException for certain methods in classes of MLlib

[ https://issues.apache.org/jira/browse/SPARK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077623#comment-16077623 ] Anirban Das commented on SPARK-21331: - The code works fine on spark-shell as you saw.

[jira] [Commented] (SPARK-21331) java.lang.NullPointerException for certain methods in classes of MLlib

[ https://issues.apache.org/jira/browse/SPARK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077620#comment-16077620 ] Yan Facai (颜发才) commented on SPARK-21331: - [~anirband] How about using this code?

[jira] [Commented] (SPARK-18085) Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077606#comment-16077606 ] Reynold Xin commented on SPARK-18085: - [~vanzin] seems like this should have a SPIP?

[jira] [Comment Edited] (SPARK-21331) java.lang.NullPointerException for certain methods in classes of MLlib

[ https://issues.apache.org/jira/browse/SPARK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077605#comment-16077605 ] Yan Facai (颜发才) edited comment on SPARK-21331 at 7/7/17 5:21 AM: --

[jira] [Commented] (SPARK-21331) java.lang.NullPointerException for certain methods in classes of MLlib

[ https://issues.apache.org/jira/browse/SPARK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077605#comment-16077605 ] Yan Facai (颜发才) commented on SPARK-21331: - Hi, I run the code in description on m

[jira] [Commented] (SPARK-1691) Support quoted arguments inside of spark-submit

[ https://issues.apache.org/jira/browse/SPARK-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077600#comment-16077600 ] Apache Spark commented on SPARK-1691: - User 'pwendell' has created a pull request for

[jira] [Resolved] (SPARK-21217) Support ColumnVector.Array.toArray()

[ https://issues.apache.org/jira/browse/SPARK-21217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21217. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18425 [https://githu

[jira] [Assigned] (SPARK-21217) Support ColumnVector.Array.toArray()

[ https://issues.apache.org/jira/browse/SPARK-21217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21217: --- Assignee: Kazuaki Ishizaki > Support ColumnVector.Array.toArray() >

[jira] [Resolved] (SPARK-21327) ArrayConstructor should handle an array of typecode 'l' as long rather than int in Python 2.

[ https://issues.apache.org/jira/browse/SPARK-21327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-21327. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18553 [https://g

[jira] [Assigned] (SPARK-21327) ArrayConstructor should handle an array of typecode 'l' as long rather than int in Python 2.

[ https://issues.apache.org/jira/browse/SPARK-21327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-21327: - Assignee: Takuya Ueshin > ArrayConstructor should handle an array of typecode 'l' as lon

[jira] [Updated] (SPARK-20566) ColumnVector should support `appendFloats` for array

[ https://issues.apache.org/jira/browse/SPARK-20566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-20566: Issue Type: Improvement (was: Bug) > ColumnVector should support `appendFloats` for array > --

[jira] [Resolved] (SPARK-21066) LibSVM load just one input file

[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21066. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18556 [https://githu

[jira] [Assigned] (SPARK-21066) LibSVM load just one input file

[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21066: --- Assignee: Hyukjin Kwon > LibSVM load just one input file > --- >

[jira] [Resolved] (SPARK-21326) Use TextFileFormat in implementation of LibSVMFileFormat

[ https://issues.apache.org/jira/browse/SPARK-21326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21326. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18556 [https://githu

[jira] [Assigned] (SPARK-21326) Use TextFileFormat in implementation of LibSVMFileFormat

[ https://issues.apache.org/jira/browse/SPARK-21326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21326: --- Assignee: Hyukjin Kwon > Use TextFileFormat in implementation of LibSVMFileFormat >

[jira] [Assigned] (SPARK-21335) support un-aliased subquery

[ https://issues.apache.org/jira/browse/SPARK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21335: Assignee: Apache Spark (was: Wenchen Fan) > support un-aliased subquery > ---

[jira] [Commented] (SPARK-21335) support un-aliased subquery

[ https://issues.apache.org/jira/browse/SPARK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077540#comment-16077540 ] Apache Spark commented on SPARK-21335: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-21335) support un-aliased subquery

[ https://issues.apache.org/jira/browse/SPARK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21335: Assignee: Wenchen Fan (was: Apache Spark) > support un-aliased subquery > ---

[jira] [Reopened] (SPARK-21107) Pyspark: ISO-8859-1 column names inconsistently converted to UTF-8

[ https://issues.apache.org/jira/browse/SPARK-21107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-21107: -- Oh, wait, it describes ISO-8859-1 specific issue. Yea, we have a strong assumption about UTF-8 in

[jira] [Updated] (SPARK-21335) support un-aliased subquery

[ https://issues.apache.org/jira/browse/SPARK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-21335: Description: un-aliased subquery is supported by Spark SQL for a long time. Its semantic was not w

[jira] [Created] (SPARK-21335) support un-aliased subquery

Wenchen Fan created SPARK-21335: --- Summary: support un-aliased subquery Key: SPARK-21335 URL: https://issues.apache.org/jira/browse/SPARK-21335 Project: Spark Issue Type: Bug Component

[jira] [Resolved] (SPARK-21107) Pyspark: ISO-8859-1 column names inconsistently converted to UTF-8

[ https://issues.apache.org/jira/browse/SPARK-21107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21107. -- Resolution: Invalid I can't follow what it describes. {code} >>> u'L\xc3\xa0' == u"Là" False {

[jira] [Updated] (SPARK-21334) Fix metrics for external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-21334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raajay Viswanathan updated SPARK-21334: --- Labels: external-shuffle-service (was: shuffle) > Fix metrics for external shuffle s

[jira] [Created] (SPARK-21334) Fix metrics for external shuffle service

Raajay Viswanathan created SPARK-21334: -- Summary: Fix metrics for external shuffle service Key: SPARK-21334 URL: https://issues.apache.org/jira/browse/SPARK-21334 Project: Spark Issue Ty

[jira] [Commented] (SPARK-6679) java.lang.ClassNotFoundException on Mesos fine grained mode and input replication

[ https://issues.apache.org/jira/browse/SPARK-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077500#comment-16077500 ] Anwar HUda commented on SPARK-6679: --- I am also facing the same issue > java.lang.ClassN

[jira] [Commented] (SPARK-20703) Add an operator for writing data out

[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077494#comment-16077494 ] Apache Spark commented on SPARK-20703: -- User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077484#comment-16077484 ] Reynold Xin commented on SPARK-21190: - [~bryanc] Sorry I don't think it makes sense t

[jira] [Resolved] (SPARK-21328) Corpus creation using sparkR for textmining

[ https://issues.apache.org/jira/browse/SPARK-21328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21328. -- Resolution: Invalid I am resolving this per the type. Questions should go to mailing list. > C

[jira] [Resolved] (SPARK-21329) Make EventTimeWatermarkExec explicitly UnaryExecNode

[ https://issues.apache.org/jira/browse/SPARK-21329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-21329. -- Resolution: Fixed Assignee: Jacek Laskowski Fix Version/s: 2.3.0 > Make EventTi

[jira] [Commented] (SPARK-20566) ColumnVector should support `appendFloats` for array

[ https://issues.apache.org/jira/browse/SPARK-20566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077433#comment-16077433 ] Apache Spark commented on SPARK-20566: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Resolved] (SPARK-20946) Do not update conf for existing SparkContext in SparkSession.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-20946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20946. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18536 [https://githu

[jira] [Resolved] (SPARK-21267) Improvements to the Structured Streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-21267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-21267. -- Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > Improvements to the St

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077390#comment-16077390 ] Bryan Cutler commented on SPARK-21190: -- This is a great discussion so far and I wou

[jira] [Assigned] (SPARK-21333) joinWith documents and analysis allow invalid join types

[ https://issues.apache.org/jira/browse/SPARK-21333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21333: Assignee: Apache Spark > joinWith documents and analysis allow invalid join types > --

[jira] [Assigned] (SPARK-21333) joinWith documents and analysis allow invalid join types

[ https://issues.apache.org/jira/browse/SPARK-21333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21333: Assignee: (was: Apache Spark) > joinWith documents and analysis allow invalid join typ

[jira] [Commented] (SPARK-21333) joinWith documents and analysis allow invalid join types

[ https://issues.apache.org/jira/browse/SPARK-21333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077381#comment-16077381 ] Apache Spark commented on SPARK-21333: -- User 'coreywoodfield' has created a pull req

[jira] [Created] (SPARK-21333) joinWith documents and analysis allow invalid join types

Corey Woodfield created SPARK-21333: --- Summary: joinWith documents and analysis allow invalid join types Key: SPARK-21333 URL: https://issues.apache.org/jira/browse/SPARK-21333 Project: Spark

[jira] [Created] (SPARK-21332) Incorrect result type inferred for some decimal expressions

Alexander Shkapsky created SPARK-21332: -- Summary: Incorrect result type inferred for some decimal expressions Key: SPARK-21332 URL: https://issues.apache.org/jira/browse/SPARK-21332 Project: Spar

[jira] [Updated] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-21190: Description: *Background and Motivation* Python is one of the most popular programming languages am

[jira] [Created] (SPARK-21331) java.lang.NullPointerException for certain methods in classes of MLlib

Anirban Das created SPARK-21331: --- Summary: java.lang.NullPointerException for certain methods in classes of MLlib Key: SPARK-21331 URL: https://issues.apache.org/jira/browse/SPARK-21331 Project: Spark

[jira] [Resolved] (SPARK-21323) Rename sql.catalyst.plans.logical.statsEstimation.Range to ValueInterval

[ https://issues.apache.org/jira/browse/SPARK-21323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-21323. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.3.0 > Rename sql.cata

[jira] [Updated] (SPARK-18724) Add TuningSummary for TrainValidationSplit and CountVectorizer

[ https://issues.apache.org/jira/browse/SPARK-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-18724: --- Summary: Add TuningSummary for TrainValidationSplit and CountVectorizer (was: Add TuningSummary for

[jira] [Assigned] (SPARK-21204) RuntimeException with Set and Case Class in Spark 2.1.1

[ https://issues.apache.org/jira/browse/SPARK-21204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21204: --- Assignee: Liang-Chi Hsieh > RuntimeException with Set and Case Class in Spark 2.1.1 > --

[jira] [Resolved] (SPARK-21204) RuntimeException with Set and Case Class in Spark 2.1.1

[ https://issues.apache.org/jira/browse/SPARK-21204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21204. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18416 [https://githu

[jira] [Assigned] (SPARK-21228) InSet incorrect handling of structs

[ https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21228: --- Assignee: Bogdan Raducanu > InSet incorrect handling of structs > --

[jira] [Resolved] (SPARK-21228) InSet incorrect handling of structs

[ https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21228. - Resolution: Fixed Fix Version/s: 2.3.0 > InSet incorrect handling of structs > ---

[jira] [Resolved] (SPARK-21182) Structured streaming on Spark-shell on windows

[ https://issues.apache.org/jira/browse/SPARK-21182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21182. -- Resolution: Cannot Reproduce I am resolving this as I can't reproduce this and the reporter loo

[jira] [Comment Edited] (SPARK-21227) Unicode in Json field causes AnalysisException when selecting from Dataframe

[ https://issues.apache.org/jira/browse/SPARK-21227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076897#comment-16076897 ] Seydou Dia edited comment on SPARK-21227 at 7/6/17 5:02 PM: H

[jira] [Commented] (SPARK-21316) Dataset Union output is not consistent with the column sequence

[ https://issues.apache.org/jira/browse/SPARK-21316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076900#comment-16076900 ] Dongjoon Hyun commented on SPARK-21316: --- [~skp33]. It's not `specified in alphabeti

[jira] [Comment Edited] (SPARK-21227) Unicode in Json field causes AnalysisException when selecting from Dataframe

[ https://issues.apache.org/jira/browse/SPARK-21227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076897#comment-16076897 ] Seydou Dia edited comment on SPARK-21227 at 7/6/17 5:02 PM: H

[jira] [Comment Edited] (SPARK-21227) Unicode in Json field causes AnalysisException when selecting from Dataframe

[ https://issues.apache.org/jira/browse/SPARK-21227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076897#comment-16076897 ] Seydou Dia edited comment on SPARK-21227 at 7/6/17 5:01 PM: H

[jira] [Comment Edited] (SPARK-21227) Unicode in Json field causes AnalysisException when selecting from Dataframe

[ https://issues.apache.org/jira/browse/SPARK-21227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076897#comment-16076897 ] Seydou Dia edited comment on SPARK-21227 at 7/6/17 4:59 PM: H

[jira] [Comment Edited] (SPARK-21227) Unicode in Json field causes AnalysisException when selecting from Dataframe

[ https://issues.apache.org/jira/browse/SPARK-21227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076897#comment-16076897 ] Seydou Dia edited comment on SPARK-21227 at 7/6/17 4:59 PM: H

[jira] [Commented] (SPARK-21227) Unicode in Json field causes AnalysisException when selecting from Dataframe

[ https://issues.apache.org/jira/browse/SPARK-21227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076897#comment-16076897 ] Seydou Dia commented on SPARK-21227: Hi [~srowen], I had time to dig further the iss

[jira] [Comment Edited] (SPARK-21227) Unicode in Json field causes AnalysisException when selecting from Dataframe

[ https://issues.apache.org/jira/browse/SPARK-21227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076897#comment-16076897 ] Seydou Dia edited comment on SPARK-21227 at 7/6/17 4:58 PM: H

[jira] [Assigned] (SPARK-21326) Use TextFileFormat in implementation of LibSVMFileFormat

[ https://issues.apache.org/jira/browse/SPARK-21326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21326: Assignee: Apache Spark > Use TextFileFormat in implementation of LibSVMFileFormat > --

[jira] [Commented] (SPARK-21326) Use TextFileFormat in implementation of LibSVMFileFormat

[ https://issues.apache.org/jira/browse/SPARK-21326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076884#comment-16076884 ] Apache Spark commented on SPARK-21326: -- User 'HyukjinKwon' has created a pull reques

[jira] [Commented] (SPARK-21066) LibSVM load just one input file

[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076885#comment-16076885 ] Apache Spark commented on SPARK-21066: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-21326) Use TextFileFormat in implementation of LibSVMFileFormat

[ https://issues.apache.org/jira/browse/SPARK-21326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21326: Assignee: (was: Apache Spark) > Use TextFileFormat in implementation of LibSVMFileForm

[jira] [Updated] (SPARK-21321) Spark very verbose on shutdown confusing users

[ https://issues.apache.org/jira/browse/SPARK-21321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jong Yoon Lee updated SPARK-21321: -- Description: On shutdown, spark can be very verbose and can spit out errors that causes the us

[jira] [Commented] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076646#comment-16076646 ] Cody Koeninger commented on SPARK-19680: Direct Stream can take a mapping from to

[jira] [Comment Edited] (SPARK-19606) Support constraints in spark-dispatcher

[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076510#comment-16076510 ] Pascal GILLET edited comment on SPARK-19606 at 7/6/17 2:13 PM:

[jira] [Commented] (SPARK-19606) Support constraints in spark-dispatcher

[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076510#comment-16076510 ] Pascal GILLET commented on SPARK-19606: --- +1 Need to run Spark drivers and executors

[jira] [Commented] (SPARK-21326) Use TextFileFormat in implementation of LibSVMFileFormat

[ https://issues.apache.org/jira/browse/SPARK-21326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076477#comment-16076477 ] Nick Pentreath commented on SPARK-21326: I think SPARK-21066 for multiple input f

[jira] [Commented] (SPARK-18859) Catalyst codegen does not mark column as nullable when it should. Causes NPE

[ https://issues.apache.org/jira/browse/SPARK-18859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076476#comment-16076476 ] Takeshi Yamamuro commented on SPARK-18859: -- we better asking qualified guys cc:

[jira] [Commented] (SPARK-21280) org.apache.spark.util.sketch.BloomFilter not bean compliant

[ https://issues.apache.org/jira/browse/SPARK-21280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076466#comment-16076466 ] Eran Moscovici commented on SPARK-21280: Thanks for your responses. Unfortunately

[jira] [Created] (SPARK-21330) Bad partitioning does not allow to read a JDBC table with extreme values on the partition column

Stefano Parmesan created SPARK-21330: Summary: Bad partitioning does not allow to read a JDBC table with extreme values on the partition column Key: SPARK-21330 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Commented] (SPARK-18859) Catalyst codegen does not mark column as nullable when it should. Causes NPE

[ https://issues.apache.org/jira/browse/SPARK-18859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076463#comment-16076463 ] Anton Okolnychyi commented on SPARK-18859: -- [~maropu] I think the approached sug

[jira] [Comment Edited] (SPARK-19341) Bucketing support for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-19341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058590#comment-16058590 ] Fei Shao edited comment on SPARK-19341 at 7/6/17 11:57 AM: --- [~t

[jira] [Resolved] (SPARK-20950) add a new config to diskWriteBufferSize which is hard coded before

[ https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20950. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18174 [https://githu

[jira] [Assigned] (SPARK-20950) add a new config to diskWriteBufferSize which is hard coded before

[ https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20950: --- Assignee: caoxuewen > add a new config to diskWriteBufferSize which is hard coded before > -

[jira] [Assigned] (SPARK-21329) Make EventTimeWatermarkExec explicitly UnaryExecNode

[ https://issues.apache.org/jira/browse/SPARK-21329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21329: Assignee: (was: Apache Spark) > Make EventTimeWatermarkExec explicitly UnaryExecNode >

[jira] [Assigned] (SPARK-21329) Make EventTimeWatermarkExec explicitly UnaryExecNode

[ https://issues.apache.org/jira/browse/SPARK-21329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21329: Assignee: Apache Spark > Make EventTimeWatermarkExec explicitly UnaryExecNode > --

[jira] [Commented] (SPARK-21329) Make EventTimeWatermarkExec explicitly UnaryExecNode

[ https://issues.apache.org/jira/browse/SPARK-21329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076383#comment-16076383 ] Apache Spark commented on SPARK-21329: -- User 'jaceklaskowski' has created a pull req

[jira] [Created] (SPARK-21329) Make EventTimeWatermarkExec explicitly UnaryExecNode

Jacek Laskowski created SPARK-21329: --- Summary: Make EventTimeWatermarkExec explicitly UnaryExecNode Key: SPARK-21329 URL: https://issues.apache.org/jira/browse/SPARK-21329 Project: Spark Is

[jira] [Commented] (SPARK-21316) Dataset Union output is not consistent with the column sequence

[ https://issues.apache.org/jira/browse/SPARK-21316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076337#comment-16076337 ] Kaushal Prajapati commented on SPARK-21316: --- [~dongjoon] It works when the colu

[jira] [Assigned] (SPARK-21306) OneVsRest Conceals Columns That May Be Relevant To Underlying Classifier

[ https://issues.apache.org/jira/browse/SPARK-21306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21306: Assignee: (was: Apache Spark) > OneVsRest Conceals Columns That May Be Relevant To Und

[jira] [Assigned] (SPARK-21306) OneVsRest Conceals Columns That May Be Relevant To Underlying Classifier

[ https://issues.apache.org/jira/browse/SPARK-21306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21306: Assignee: Apache Spark > OneVsRest Conceals Columns That May Be Relevant To Underlying Cla

[jira] [Commented] (SPARK-21306) OneVsRest Conceals Columns That May Be Relevant To Underlying Classifier

[ https://issues.apache.org/jira/browse/SPARK-21306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076274#comment-16076274 ] Apache Spark commented on SPARK-21306: -- User 'facaiy' has created a pull request for

[jira] [Updated] (SPARK-21326) Use TextFileFormat in implementation of LibSVMFileFormat

[ https://issues.apache.org/jira/browse/SPARK-21326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-21326: - Description: This is related with SPARK-19918 and SPARK-18362. There are three points here: - T

[jira] [Comment Edited] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076244#comment-16076244 ] guoxiaolongzte edited comment on SPARK-21325 at 7/6/17 9:36 AM: ---

[jira] [Resolved] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte resolved SPARK-21325. Resolution: Fixed This question has been modified by jerryshao. [~jerryshao] > The shell o

[jira] [Updated] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-21325: --- Description: 1.My submit way: spark-submit --class cn.gxl.TestSql{color:red} --jars hdfs://n

[jira] [Updated] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-21325: --- Description: 1.My submit way: spark-submit --class cn.gxl.TestSql{color:red} --jars hdfs://n

[jira] [Assigned] (SPARK-21327) ArrayConstructor should handle an array of typecode 'l' as long rather than int in Python 2.

[ https://issues.apache.org/jira/browse/SPARK-21327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21327: Assignee: Apache Spark > ArrayConstructor should handle an array of typecode 'l' as long r

[jira] [Assigned] (SPARK-21327) ArrayConstructor should handle an array of typecode 'l' as long rather than int in Python 2.

[ https://issues.apache.org/jira/browse/SPARK-21327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21327: Assignee: (was: Apache Spark) > ArrayConstructor should handle an array of typecode 'l

[jira] [Updated] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-21325: --- Description: 1.My submit way: spark-submit --class cn.gxl.TestSql{color:red} --jars hdfs://n

[jira] [Created] (SPARK-21328) Corpus creation using sparkR for textmining

Joe created SPARK-21328: --- Summary: Corpus creation using sparkR for textmining Key: SPARK-21328 URL: https://issues.apache.org/jira/browse/SPARK-21328 Project: Spark Issue Type: Question Comp

[jira] [Commented] (SPARK-21327) ArrayConstructor should handle an array of typecode 'l' as long rather than int in Python 2.

[ https://issues.apache.org/jira/browse/SPARK-21327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076226#comment-16076226 ] Apache Spark commented on SPARK-21327: -- User 'ueshin' has created a pull request for

[jira] [Updated] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-21325: --- Description: 1.My submit way: spark-submit --class cn.gxl.TestSql --jars hdfs://nameservice:

  1   2   >