[jira] [Commented] (SPARK-8658) AttributeReference equals method only compare name, exprId and dataType

[ https://issues.apache.org/jira/browse/SPARK-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008226#comment-15008226 ] Apache Spark commented on SPARK-8658: - User 'gatorsmile' has created a pull request fo

[jira] [Commented] (SPARK-8352) Affixed table of contents, similar to Bootstrap 3 docs

[ https://issues.apache.org/jira/browse/SPARK-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008201#comment-15008201 ] Kai Jiang commented on SPARK-8352: -- Hi [~joshrosen], I am working on this. The attachmen

[jira] [Updated] (SPARK-8352) Affixed table of contents, similar to Bootstrap 3 docs

[ https://issues.apache.org/jira/browse/SPARK-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang updated SPARK-8352: - Attachment: sidebar2.1.0.png > Affixed table of contents, similar to Bootstrap 3 docs > --

[jira] [Resolved] (SPARK-11447) Null comparison requires type information but type extraction fails for complex types

[ https://issues.apache.org/jira/browse/SPARK-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11447. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9720 [https://github.com/a

[jira] [Updated] (SPARK-11447) Null comparison requires type information but type extraction fails for complex types

[ https://issues.apache.org/jira/browse/SPARK-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11447: - Assignee: kevin yu > Null comparison requires type information but type extraction fails for > complex t

[jira] [Commented] (SPARK-11767) Easy to OOM when cache large column

[ https://issues.apache.org/jira/browse/SPARK-11767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008145#comment-15008145 ] Apache Spark commented on SPARK-11767: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-11767) Easy to OOM when cache large column

[ https://issues.apache.org/jira/browse/SPARK-11767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11767: Assignee: Davies Liu (was: Apache Spark) > Easy to OOM when cache large column >

[jira] [Assigned] (SPARK-11767) Easy to OOM when cache large column

[ https://issues.apache.org/jira/browse/SPARK-11767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11767: Assignee: Apache Spark (was: Davies Liu) > Easy to OOM when cache large column >

[jira] [Resolved] (SPARK-11693) spark kafka direct streaming exception

[ https://issues.apache.org/jira/browse/SPARK-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaoxiaoluo resolved SPARK-11693. - Resolution: Fixed > spark kafka direct streaming exception >

[jira] [Commented] (SPARK-11772) DataFrame.show() fails with non-ASCII strings

[ https://issues.apache.org/jira/browse/SPARK-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008096#comment-15008096 ] Greg Baker commented on SPARK-11772: Also occurs in 1.5.2, which I can't select in th

[jira] [Created] (SPARK-11772) DataFrame.show() fails with non-ASCII strings

Greg Baker created SPARK-11772: -- Summary: DataFrame.show() fails with non-ASCII strings Key: SPARK-11772 URL: https://issues.apache.org/jira/browse/SPARK-11772 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003468#comment-15003468 ] yuhao yang edited comment on SPARK-9273 at 11/17/15 5:36 AM: -

[jira] [Comment Edited] (SPARK-11153) Turns off Parquet filter push-down for string and binary columns

[ https://issues.apache.org/jira/browse/SPARK-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008074#comment-15008074 ] Ian edited comment on SPARK-11153 at 11/17/15 5:18 AM: --- Hi, Cheng:

[jira] [Commented] (SPARK-11153) Turns off Parquet filter push-down for string and binary columns

[ https://issues.apache.org/jira/browse/SPARK-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008074#comment-15008074 ] Ian commented on SPARK-11153: - Hi, Cheng: Filter pushdown for Timestamp type? It appeared t

[jira] [Commented] (SPARK-11771) Maximum memory is determined by two params but error message only lists one.

[ https://issues.apache.org/jira/browse/SPARK-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008060#comment-15008060 ] Apache Spark commented on SPARK-11771: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-11753) Understand why allowNonNumericNumbers JSON option doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11753: Assignee: Apache Spark > Understand why allowNonNumericNumbers JSON option doesn't work >

[jira] [Assigned] (SPARK-11753) Understand why allowNonNumericNumbers JSON option doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11753: Assignee: (was: Apache Spark) > Understand why allowNonNumericNumbers JSON option does

[jira] [Assigned] (SPARK-11771) Maximum memory is determined by two params but error message only lists one.

[ https://issues.apache.org/jira/browse/SPARK-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11771: Assignee: (was: Apache Spark) > Maximum memory is determined by two params but error m

[jira] [Commented] (SPARK-11753) Understand why allowNonNumericNumbers JSON option doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008061#comment-15008061 ] Apache Spark commented on SPARK-11753: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-11771) Maximum memory is determined by two params but error message only lists one.

[ https://issues.apache.org/jira/browse/SPARK-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11771: Assignee: Apache Spark > Maximum memory is determined by two params but error message only

[jira] [Created] (SPARK-11771) Maximum memory is determined by two params but error message only lists one.

holdenk created SPARK-11771: --- Summary: Maximum memory is determined by two params but error message only lists one. Key: SPARK-11771 URL: https://issues.apache.org/jira/browse/SPARK-11771 Project: Spark

[jira] [Resolved] (SPARK-9196) DatetimeExpressionsSuite: function current_timestamp is flaky

[ https://issues.apache.org/jira/browse/SPARK-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9196. Resolution: Fixed Assignee: Reynold Xin (was: Adrian Wang) Fix Version/s: 1.6.0 > D

[jira] [Resolved] (SPARK-11768) Support now function in SQL (alias for current_timestamp)

[ https://issues.apache.org/jira/browse/SPARK-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11768. - Resolution: Fixed Fix Version/s: 1.6.0 > Support now function in SQL (alias for current_ti

[jira] [Commented] (SPARK-5918) Spark Thrift server reports metadata for VARCHAR column as STRING in result set schema

[ https://issues.apache.org/jira/browse/SPARK-5918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15008027#comment-15008027 ] Brody Messmer commented on SPARK-5918: -- Where this becomes an issue is when you utili

[jira] [Commented] (SPARK-11753) Understand why allowNonNumericNumbers JSON option doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007999#comment-15007999 ] Xiao Li commented on SPARK-11753: - I see. Will do. Thanks! > Understand why allowNonNume

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007981#comment-15007981 ] LingZhou commented on SPARK-11617: -- While running sort in spark-perf there are still exc

[jira] [Commented] (SPARK-10562) .partitionBy() creates the metastore partition columns in all lowercase, but persists the data path as MixedCase resulting in an error when the data is later attempted

[ https://issues.apache.org/jira/browse/SPARK-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007980#comment-15007980 ] Yin Huai commented on SPARK-10562: -- [~lockwobr] Looks like this is a problem with 1.4.x

[jira] [Commented] (SPARK-11439) Optimization of creating sparse feature without dense one

[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007968#comment-15007968 ] Apache Spark commented on SPARK-11439: -- User 'nakul02' has created a pull request fo

[jira] [Comment Edited] (SPARK-11753) Understand why allowNonNumericNumbers JSON option doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007958#comment-15007958 ] Reynold Xin edited comment on SPARK-11753 at 11/17/15 3:43 AM:

[jira] [Commented] (SPARK-11753) Understand why allowNonNumericNumbers JSON option doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007958#comment-15007958 ] Reynold Xin commented on SPARK-11753: - I don't think this is urgent, so take your tim

[jira] [Commented] (SPARK-11753) Understand why allowNonNumericNumbers JSON option doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007953#comment-15007953 ] Zee Chen commented on SPARK-11753: -- Took a quick look with jackson-core 2.4.4, the follo

[jira] [Commented] (SPARK-11753) Understand why allowNonNumericNumbers JSON option doesn't work

[ https://issues.apache.org/jira/browse/SPARK-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007950#comment-15007950 ] Xiao Li commented on SPARK-11753: - I can try it if this is not an urgent issue. > Under

[jira] [Created] (SPARK-11770) Spark SQL field resolution error in GROUP BY HAVING clause

Simeon Simeonov created SPARK-11770: --- Summary: Spark SQL field resolution error in GROUP BY HAVING clause Key: SPARK-11770 URL: https://issues.apache.org/jira/browse/SPARK-11770 Project: Spark

[jira] [Updated] (SPARK-6763) CountMinSketch

[ https://issues.apache.org/jira/browse/SPARK-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6763: --- Assignee: Liang-Chi Hsieh > CountMinSketch > -- > > Key: SPARK-6763 >

[jira] [Closed] (SPARK-6788) Model export/import for spark.ml: Tokenizer

[ https://issues.apache.org/jira/browse/SPARK-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-6788. Resolution: Duplicate > Model export/import for spark.ml: Tokenizer > --

[jira] [Closed] (SPARK-6786) Model export/import for spark.ml: Normalizer

[ https://issues.apache.org/jira/browse/SPARK-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-6786. Resolution: Duplicate > Model export/import for spark.ml: Normalizer > -

[jira] [Commented] (SPARK-6727) Model export/import for spark.ml: HashingTF

[ https://issues.apache.org/jira/browse/SPARK-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007900#comment-15007900 ] Joseph K. Bradley commented on SPARK-6727: -- [~EarthsonLu] Apologies for the slow

[jira] [Closed] (SPARK-6727) Model export/import for spark.ml: HashingTF

[ https://issues.apache.org/jira/browse/SPARK-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-6727. Resolution: Duplicate > Model export/import for spark.ml: HashingTF > --

[jira] [Commented] (SPARK-11769) Model export/import for spark.ml: all basic Transformers

[ https://issues.apache.org/jira/browse/SPARK-11769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007893#comment-15007893 ] Apache Spark commented on SPARK-11769: -- User 'jkbradley' has created a pull request

[jira] [Assigned] (SPARK-11769) Model export/import for spark.ml: all basic Transformers

[ https://issues.apache.org/jira/browse/SPARK-11769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11769: Assignee: Joseph K. Bradley (was: Apache Spark) > Model export/import for spark.ml: all b

[jira] [Assigned] (SPARK-11769) Model export/import for spark.ml: all basic Transformers

[ https://issues.apache.org/jira/browse/SPARK-11769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11769: Assignee: Apache Spark (was: Joseph K. Bradley) > Model export/import for spark.ml: all b

[jira] [Created] (SPARK-11769) Model export/import for spark.ml: all basic Transformers

Joseph K. Bradley created SPARK-11769: - Summary: Model export/import for spark.ml: all basic Transformers Key: SPARK-11769 URL: https://issues.apache.org/jira/browse/SPARK-11769 Project: Spark

[jira] [Updated] (SPARK-11600) Spark MLlib 1.6 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11600: -- Description: This JIRA lists tasks for the next MLlib release's QA period. h2. API *

[jira] [Updated] (SPARK-2838) performance tests for feature transformations

[ https://issues.apache.org/jira/browse/SPARK-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-2838: - Issue Type: Test (was: Sub-task) Parent: (was: SPARK-2829) > performance test

[jira] [Closed] (SPARK-11433) [SQL] Rule EliminateSubQueries does not clean the parent Project's qualifiers

[ https://issues.apache.org/jira/browse/SPARK-11433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-11433. --- Resolution: Won't Fix > [SQL] Rule EliminateSubQueries does not clean the parent Project's qualifiers > -

[jira] [Commented] (SPARK-11694) Parquet logical types are not being tested properly

[ https://issues.apache.org/jira/browse/SPARK-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007837#comment-15007837 ] Apache Spark commented on SPARK-11694: -- User 'HyukjinKwon' has created a pull reques

[jira] [Commented] (SPARK-11748) Result is null after alter column name of table stored as Parquet

[ https://issues.apache.org/jira/browse/SPARK-11748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007828#comment-15007828 ] Xin Wu commented on SPARK-11748: I can recreate it for parquet format.. but not for orc o

[jira] [Commented] (SPARK-11768) Support now function in SQL (alias for current_timestamp)

[ https://issues.apache.org/jira/browse/SPARK-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007821#comment-15007821 ] Apache Spark commented on SPARK-11768: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11768) Support now function in SQL (alias for current_timestamp)

[ https://issues.apache.org/jira/browse/SPARK-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11768: Assignee: Reynold Xin (was: Apache Spark) > Support now function in SQL (alias for curren

[jira] [Commented] (SPARK-9196) DatetimeExpressionsSuite: function current_timestamp is flaky

[ https://issues.apache.org/jira/browse/SPARK-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007822#comment-15007822 ] Apache Spark commented on SPARK-9196: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-11768) Support now function in SQL (alias for current_timestamp)

[ https://issues.apache.org/jira/browse/SPARK-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11768: Assignee: Apache Spark (was: Reynold Xin) > Support now function in SQL (alias for curren

[jira] [Created] (SPARK-11768) Support now function in SQL (alias for current_timestamp)

Reynold Xin created SPARK-11768: --- Summary: Support now function in SQL (alias for current_timestamp) Key: SPARK-11768 URL: https://issues.apache.org/jira/browse/SPARK-11768 Project: Spark Issue

[jira] [Issue Comment Deleted] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Earthson Lu updated SPARK-8332: --- Comment: was deleted (was: SparkUI not works when upgrade fasterxml.jackson to 2.5.3) > NoSuchMethodE

[jira] [Commented] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007792#comment-15007792 ] Felix Cheung commented on SPARK-11756: -- Fix use of aliases and changes uses of @rdna

[jira] [Created] (SPARK-11767) Easy to OOM when cache large column

Davies Liu created SPARK-11767: -- Summary: Easy to OOM when cache large column Key: SPARK-11767 URL: https://issues.apache.org/jira/browse/SPARK-11767 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-11767) Easy to OOM when cache large column

[ https://issues.apache.org/jira/browse/SPARK-11767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-11767: -- Assignee: Davies Liu > Easy to OOM when cache large column > -

[jira] [Resolved] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11617. Resolution: Fixed Fix Version/s: 1.6.0 > MEMORY LEAK: ByteBuf.release() was not call

[jira] [Resolved] (SPARK-11612) Model export/import for spark.ml: Pipeline and PipelineModel

[ https://issues.apache.org/jira/browse/SPARK-11612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11612. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9674 [ht

[jira] [Commented] (SPARK-11765) Avoid assign UI port between browser unsafe ports (or just 4045: lockd)

[ https://issues.apache.org/jira/browse/SPARK-11765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007740#comment-15007740 ] Jakob Odersky commented on SPARK-11765: --- I think adding a "blacklist" of ports coul

[jira] [Commented] (SPARK-10562) .partitionBy() creates the metastore partition columns in all lowercase, but persists the data path as MixedCase resulting in an error when the data is later attempted

[ https://issues.apache.org/jira/browse/SPARK-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007739#comment-15007739 ] Brian Lockwood commented on SPARK-10562: It seems that I am running into this in

[jira] [Issue Comment Deleted] (SPARK-10673) spark.sql.hive.verifyPartitionPath Attempts to Verify Unregistered Partitions

[ https://issues.apache.org/jira/browse/SPARK-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Wu updated SPARK-10673: --- Comment: was deleted (was: I will look into this one. ) > spark.sql.hive.verifyPartitionPath Attempts to Ver

[jira] [Resolved] (SPARK-11710) Document new memory management model

[ https://issues.apache.org/jira/browse/SPARK-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11710. --- Resolution: Fixed Fix Version/s: 1.6.0 > Document new memory management model > --

[jira] [Resolved] (SPARK-11480) Wrong callsite is displayed when using AsyncRDDActions#takeAsync

[ https://issues.apache.org/jira/browse/SPARK-11480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11480. --- Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 1.6.0 > Wrong callsite is d

[jira] [Issue Comment Deleted] (SPARK-10673) spark.sql.hive.verifyPartitionPath Attempts to Verify Unregistered Partitions

[ https://issues.apache.org/jira/browse/SPARK-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Wu updated SPARK-10673: --- Comment: was deleted (was: The fix is being tested.. will submit PR shortly.) > spark.sql.hive.verifyPartiti

[jira] [Issue Comment Deleted] (SPARK-10673) spark.sql.hive.verifyPartitionPath Attempts to Verify Unregistered Partitions

[ https://issues.apache.org/jira/browse/SPARK-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Wu updated SPARK-10673: --- Comment: was deleted (was: if the default is false, {code} if (!sc.conf.verifyPartitionPath) { partitionT

[jira] [Assigned] (SPARK-11766) JSON serialization of Vectors

[ https://issues.apache.org/jira/browse/SPARK-11766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11766: Assignee: Xiangrui Meng (was: Apache Spark) > JSON serialization of Vectors > ---

[jira] [Assigned] (SPARK-11766) JSON serialization of Vectors

[ https://issues.apache.org/jira/browse/SPARK-11766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11766: Assignee: Apache Spark (was: Xiangrui Meng) > JSON serialization of Vectors > ---

[jira] [Commented] (SPARK-11766) JSON serialization of Vectors

[ https://issues.apache.org/jira/browse/SPARK-11766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007719#comment-15007719 ] Apache Spark commented on SPARK-11766: -- User 'mengxr' has created a pull request for

[jira] [Updated] (SPARK-11755) SparkR can not output help information for SparkR:::predict

[ https://issues.apache.org/jira/browse/SPARK-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11755: - Component/s: SparkR > SparkR can not output help information for SparkR:::predict > -

[jira] [Created] (SPARK-11765) Avoid assign UI port between browser unsafe ports (or just 4045: lockd)

Jungtaek Lim created SPARK-11765: Summary: Avoid assign UI port between browser unsafe ports (or just 4045: lockd) Key: SPARK-11765 URL: https://issues.apache.org/jira/browse/SPARK-11765 Project: Spar

[jira] [Created] (SPARK-11766) JSON serialization of Vectors

Xiangrui Meng created SPARK-11766: - Summary: JSON serialization of Vectors Key: SPARK-11766 URL: https://issues.apache.org/jira/browse/SPARK-11766 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11756: Assignee: (was: Apache Spark) > SparkR can not output help information for SparkR:::su

[jira] [Commented] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007703#comment-15007703 ] Apache Spark commented on SPARK-11756: -- User 'felixcheung' has created a pull reques

[jira] [Assigned] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11756: Assignee: Apache Spark > SparkR can not output help information for SparkR:::summary corre

[jira] [Commented] (SPARK-11763) Refactoring to create template for Estimator, Model pairs

[ https://issues.apache.org/jira/browse/SPARK-11763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007677#comment-15007677 ] Apache Spark commented on SPARK-11763: -- User 'jkbradley' has created a pull request

[jira] [Created] (SPARK-11764) JSON serialization of Param[Vector]

Xiangrui Meng created SPARK-11764: - Summary: JSON serialization of Param[Vector] Key: SPARK-11764 URL: https://issues.apache.org/jira/browse/SPARK-11764 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-11763) Refactoring to create template for Estimator, Model pairs

Joseph K. Bradley created SPARK-11763: - Summary: Refactoring to create template for Estimator, Model pairs Key: SPARK-11763 URL: https://issues.apache.org/jira/browse/SPARK-11763 Project: Spark

[jira] [Commented] (SPARK-11633) HiveContext throws TreeNode Exception : Failed to Copy Node

[ https://issues.apache.org/jira/browse/SPARK-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007668#comment-15007668 ] Xiao Li commented on SPARK-11633: - The fix is ready. Will deliver it soon. > HiveContex

[jira] [Updated] (SPARK-11634) Make simple transformers and estimators implement default read/write

[ https://issues.apache.org/jira/browse/SPARK-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11634: -- Assignee: Joseph K. Bradley (was: Xiangrui Meng) > Make simple transformers and estimators imp

[jira] [Commented] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007640#comment-15007640 ] Charles Allen commented on SPARK-11016: --- [~davies] Was in a meeting, looks like you

[jira] [Updated] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11725: - Target Version/s: 1.6.0 Priority: Blocker (was: Major) Issue Type:

[jira] [Commented] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007620#comment-15007620 ] Apache Spark commented on SPARK-11016: -- User 'davies' has created a pull request for

[jira] [Updated] (SPARK-8658) AttributeReference equals method only compare name, exprId and dataType

[ https://issues.apache.org/jira/browse/SPARK-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8658: Assignee: Xiao Li > AttributeReference equals method only compare name, exprId and dataType

[jira] [Resolved] (SPARK-8658) AttributeReference equals method only compare name, exprId and dataType

[ https://issues.apache.org/jira/browse/SPARK-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8658. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9216 [https:/

[jira] [Updated] (SPARK-11553) row.getInt(i) if row[i]=null returns 0

[ https://issues.apache.org/jira/browse/SPARK-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11553: - Assignee: Bartlomiej Alberski > row.getInt(i) if row[i]=null returns 0 >

[jira] [Resolved] (SPARK-11553) row.getInt(i) if row[i]=null returns 0

[ https://issues.apache.org/jira/browse/SPARK-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11553. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9642 [http

[jira] [Assigned] (SPARK-11762) TransportResponseHandler should consider open streams when counting outstanding requests

[ https://issues.apache.org/jira/browse/SPARK-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11762: Assignee: Apache Spark > TransportResponseHandler should consider open streams when counti

[jira] [Commented] (SPARK-11762) TransportResponseHandler should consider open streams when counting outstanding requests

[ https://issues.apache.org/jira/browse/SPARK-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007604#comment-15007604 ] Apache Spark commented on SPARK-11762: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-11762) TransportResponseHandler should consider open streams when counting outstanding requests

[ https://issues.apache.org/jira/browse/SPARK-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11762: Assignee: (was: Apache Spark) > TransportResponseHandler should consider open streams

[jira] [Commented] (SPARK-11583) Make MapStatus use less memory uage

[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007600#comment-15007600 ] Apache Spark commented on SPARK-11583: -- User 'davies' has created a pull request for

[jira] [Updated] (SPARK-11259) Params.validateParams() should be called automatically

[ https://issues.apache.org/jira/browse/SPARK-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11259: -- Target Version/s: 1.6.1, 1.7.0 > Params.validateParams() should be called automatically

[jira] [Resolved] (SPARK-11742) Show batch failures in the Streaming UI landing page

[ https://issues.apache.org/jira/browse/SPARK-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11742. --- Resolution: Fixed Fix Version/s: 1.6.0 > Show batch failures in the Streaming UI landi

[jira] [Updated] (SPARK-11742) Show batch failures in the Streaming UI landing page

[ https://issues.apache.org/jira/browse/SPARK-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-11742: -- Assignee: Shixiong Zhu > Show batch failures in the Streaming UI landing page > ---

[jira] [Closed] (SPARK-11271) MapStatus too large for driver

[ https://issues.apache.org/jira/browse/SPARK-11271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-11271. -- Resolution: Duplicate Assignee: (was: Liang-Chi Hsieh) Fix Version/s: (was: 1.6.

[jira] [Reopened] (SPARK-11271) MapStatus too large for driver

[ https://issues.apache.org/jira/browse/SPARK-11271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-11271: https://github.com/apache/spark/pull/9243 is reverted > MapStatus too large for driver > -

[jira] [Commented] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007565#comment-15007565 ] Davies Liu commented on SPARK-11016: [~charles.al...@acxiom.com] Could you send your

[jira] [Reopened] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-11016: Assignee: (was: Liang-Chi Hsieh) https://github.com/apache/spark/pull/9243 is reverted > Spa

[jira] [Commented] (SPARK-11747) Can not specify input path in python logistic_regression example under ml

[ https://issues.apache.org/jira/browse/SPARK-11747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007528#comment-15007528 ] Joseph K. Bradley commented on SPARK-11747: --- Although there are some examples w

[jira] [Commented] (SPARK-11439) Optimization of creating sparse feature without dense one

[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007487#comment-15007487 ] Nakul Jindal commented on SPARK-11439: -- Thanks [~lewuathe]. I've also updated the co

[jira] [Updated] (SPARK-11390) Query plan with/without filterPushdown indistinguishable

[ https://issues.apache.org/jira/browse/SPARK-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11390: - Assignee: Zee Chen > Query plan with/without filterPushdown indistinguishable > -

  1   2   3   >