[jira] [Resolved] (SPARK-17532) Add thread lock information from JMX to thread dump UI

[ https://issues.apache.org/jira/browse/SPARK-17532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17532. - Resolution: Fixed Assignee: Ryan Blue Fix Version/s: 2.1.0 > Add thread lock info

[jira] [Commented] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns

[ https://issues.apache.org/jira/browse/SPARK-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628001#comment-15628001 ] Yanbo Liang commented on SPARK-16000: - [~josephkb] Yep, all the sub tasks complete. W

[jira] [Created] (SPARK-18218) Optimize BlockMatrix multiplication, which may cause OOM and low parallelism usage problem in several cases

Weichen Xu created SPARK-18218: -- Summary: Optimize BlockMatrix multiplication, which may cause OOM and low parallelism usage problem in several cases Key: SPARK-18218 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-18218) Optimize BlockMatrix multiplication, which may cause OOM and low parallelism usage problem in several cases

[ https://issues.apache.org/jira/browse/SPARK-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-18218: --- Issue Type: Improvement (was: Bug) > Optimize BlockMatrix multiplication, which may cause OOM and lo

[jira] [Resolved] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17683. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.1.0 > Support Array

[jira] [Commented] (SPARK-18218) Optimize BlockMatrix multiplication, which may cause OOM and low parallelism usage problem in several cases

[ https://issues.apache.org/jira/browse/SPARK-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628022#comment-15628022 ] Apache Spark commented on SPARK-18218: -- User 'WeichenXu123' has created a pull reque

[jira] [Assigned] (SPARK-18218) Optimize BlockMatrix multiplication, which may cause OOM and low parallelism usage problem in several cases

[ https://issues.apache.org/jira/browse/SPARK-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18218: Assignee: Apache Spark > Optimize BlockMatrix multiplication, which may cause OOM and low

[jira] [Assigned] (SPARK-18218) Optimize BlockMatrix multiplication, which may cause OOM and low parallelism usage problem in several cases

[ https://issues.apache.org/jira/browse/SPARK-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18218: Assignee: (was: Apache Spark) > Optimize BlockMatrix multiplication, which may cause O

[jira] [Reopened] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-17683: - > Support ArrayType in Literal.apply > -- > > Key: SP

[jira] [Updated] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17683: Fix Version/s: (was: 2.1.0) > Support ArrayType in Literal.apply >

[jira] [Updated] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17683: Target Version/s: 2.1.0 > Support ArrayType in Literal.apply > -- >

[jira] [Assigned] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17683: Assignee: Apache Spark (was: Takeshi Yamamuro) > Support ArrayType in Literal.apply > ---

[jira] [Assigned] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17683: Assignee: Takeshi Yamamuro (was: Apache Spark) > Support ArrayType in Literal.apply > ---

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628070#comment-15628070 ] Liang-Chi Hsieh commented on SPARK-18209: - I just think of not built-in UDFs whic

[jira] [Resolved] (SPARK-11868) wrong results returned from dataframe create from Rows without consistent schma on pyspark

[ https://issues.apache.org/jira/browse/SPARK-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-11868. -- Resolution: Cannot Reproduce I still can't repdocue this in the master. It seems this is resolv

[jira] [Updated] (SPARK-18215) Make Column.expr public

[ https://issues.apache.org/jira/browse/SPARK-18215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18215: Fix Version/s: 2.1.0 > Make Column.expr public > --- > > Key: S

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628084#comment-15628084 ] Reynold Xin commented on SPARK-18209: - UDFs should be valid -- temp UDFs should not b

[jira] [Created] (SPARK-18219) Move commit protocol API from sql to core module

Reynold Xin created SPARK-18219: --- Summary: Move commit protocol API from sql to core module Key: SPARK-18219 URL: https://issues.apache.org/jira/browse/SPARK-18219 Project: Spark Issue Type: Su

[jira] [Commented] (SPARK-18219) Move commit protocol API from sql to core module

[ https://issues.apache.org/jira/browse/SPARK-18219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628094#comment-15628094 ] Apache Spark commented on SPARK-18219: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-18219) Move commit protocol API from sql to core module

[ https://issues.apache.org/jira/browse/SPARK-18219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18219: Assignee: Reynold Xin (was: Apache Spark) > Move commit protocol API from sql to core mod

[jira] [Assigned] (SPARK-18219) Move commit protocol API from sql to core module

[ https://issues.apache.org/jira/browse/SPARK-18219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18219: Assignee: Apache Spark (was: Reynold Xin) > Move commit protocol API from sql to core mod

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628099#comment-15628099 ] Liang-Chi Hsieh commented on SPARK-18209: - Can we guarantee temp UDFs still valid

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628117#comment-15628117 ] Reynold Xin commented on SPARK-18209: - No. > More robust view canonicalization with

[jira] [Created] (SPARK-18220) ClassCastException occurs when using select query on ORC file

Jerryjung created SPARK-18220: - Summary: ClassCastException occurs when using select query on ORC file Key: SPARK-18220 URL: https://issues.apache.org/jira/browse/SPARK-18220 Project: Spark Issu

[jira] [Updated] (SPARK-18220) ClassCastException occurs when using select query on ORC file

[ https://issues.apache.org/jira/browse/SPARK-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerryjung updated SPARK-18220: -- Description: Error message is below. == 16/11/0

[jira] [Updated] (SPARK-18220) ClassCastException occurs when using select query on ORC file

[ https://issues.apache.org/jira/browse/SPARK-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerryjung updated SPARK-18220: -- Environment: (was: ORC dump info. == File Ve

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628128#comment-15628128 ] Liang-Chi Hsieh commented on SPARK-18209: - So I think permanent views shouldn't b

[jira] [Commented] (SPARK-18212) Flaky test: org.apache.spark.sql.kafka010.KafkaSourceSuite.assign from specific offsets

[ https://issues.apache.org/jira/browse/SPARK-18212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628170#comment-15628170 ] Michael Armbrust commented on SPARK-18212: -- +1 to upping the timeout. We run wit

[jira] [Commented] (SPARK-18073) Migrate wiki to spark.apache.org web site

[ https://issues.apache.org/jira/browse/SPARK-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628222#comment-15628222 ] Sean Owen commented on SPARK-18073: --- Yes please go ahead. Ping for a review after you h

[jira] [Created] (SPARK-18221) Wrong ApproximatePercentile answer when multiple records have the minimum value(for branch 2.0)

Zhenhua Wang created SPARK-18221: Summary: Wrong ApproximatePercentile answer when multiple records have the minimum value(for branch 2.0) Key: SPARK-18221 URL: https://issues.apache.org/jira/browse/SPARK-18221

[jira] [Resolved] (SPARK-12355) Implement unhandledFilter interface for Parquet

[ https://issues.apache.org/jira/browse/SPARK-12355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-12355. -- Resolution: Not A Problem >From the past discussion, I guess it seems we want to use Spark-side

[jira] [Resolved] (SPARK-12354) Implement unhandledFilter interface

[ https://issues.apache.org/jira/browse/SPARK-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-12354. -- Resolution: Done marking this Umbrella as "Done" as it is done. > Implement unhandledFilter in

[jira] [Closed] (SPARK-12483) Data Frame as() does not work in Java

[ https://issues.apache.org/jira/browse/SPARK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon closed SPARK-12483. Resolution: Invalid I am closing this as Invalid because {{Dataset.as}} API refers the alias for t

[jira] [Assigned] (SPARK-18221) Wrong ApproximatePercentile answer when multiple records have the minimum value(for branch 2.0)

[ https://issues.apache.org/jira/browse/SPARK-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18221: Assignee: Apache Spark > Wrong ApproximatePercentile answer when multiple records have the

[jira] [Commented] (SPARK-18221) Wrong ApproximatePercentile answer when multiple records have the minimum value(for branch 2.0)

[ https://issues.apache.org/jira/browse/SPARK-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628287#comment-15628287 ] Apache Spark commented on SPARK-18221: -- User 'wzhfy' has created a pull request for

[jira] [Assigned] (SPARK-18221) Wrong ApproximatePercentile answer when multiple records have the minimum value(for branch 2.0)

[ https://issues.apache.org/jira/browse/SPARK-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18221: Assignee: (was: Apache Spark) > Wrong ApproximatePercentile answer when multiple recor

[jira] [Resolved] (SPARK-18221) Wrong ApproximatePercentile answer when multiple records have the minimum value(for branch 2.0)

[ https://issues.apache.org/jira/browse/SPARK-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18221. --- Resolution: Duplicate Target Version/s: (was: 2.0.1) Don't open a different JIRA in this

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628295#comment-15628295 ] zhangxinyu edited comment on SPARK-17935 at 11/2/16 9:10 AM: -

[jira] [Resolved] (SPARK-18198) Highlight code snippets for Streaming integretion docs

[ https://issues.apache.org/jira/browse/SPARK-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18198. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15715 [https://github.co

[jira] [Commented] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628295#comment-15628295 ] zhangxinyu commented on SPARK-17935: Thank you for your suggestions. Kafka sink will

[jira] [Commented] (SPARK-12677) Lazy file discovery for parquet

[ https://issues.apache.org/jira/browse/SPARK-12677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628301#comment-15628301 ] Hyukjin Kwon commented on SPARK-12677: -- I am pretty sure you meant reading schema wh

[jira] [Updated] (SPARK-18198) Highlight code snippets for Streaming integretion docs

[ https://issues.apache.org/jira/browse/SPARK-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18198: -- Assignee: Liwei Lin(Inactive) > Highlight code snippets for Streaming integretion docs > --

[jira] [Commented] (SPARK-18221) Wrong ApproximatePercentile answer when multiple records have the minimum value(for branch 2.0)

[ https://issues.apache.org/jira/browse/SPARK-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628306#comment-15628306 ] Zhenhua Wang commented on SPARK-18221: -- Oh, sorry, should I close this one? > Wrong

[jira] [Updated] (SPARK-18198) Highlight code snippets for Streaming integretion docs

[ https://issues.apache.org/jira/browse/SPARK-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18198: -- Assignee: Liwei Lin (was: Liwei Lin(Inactive)) > Highlight code snippets for Streaming integretion doc

[jira] [Commented] (SPARK-18111) Wrong ApproximatePercentile answer when multiple records have the minimum value

[ https://issues.apache.org/jira/browse/SPARK-18111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628309#comment-15628309 ] Apache Spark commented on SPARK-18111: -- User 'wzhfy' has created a pull request for

[jira] [Resolved] (SPARK-13342) Cannot run INSERT statements in Spark

[ https://issues.apache.org/jira/browse/SPARK-13342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-13342. -- Resolution: Cannot Reproduce I am resolving this as Cannot Reproduce as I can't reproduce. Plea

[jira] [Commented] (SPARK-13417) SQL subquery support

[ https://issues.apache.org/jira/browse/SPARK-13417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628324#comment-15628324 ] Hyukjin Kwon commented on SPARK-13417: -- Hi [~rxin], I just happened to look at this

[jira] [Resolved] (SPARK-18204) Remove SparkUI.appUIAddress

[ https://issues.apache.org/jira/browse/SPARK-18204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18204. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15603 [https://github.co

[jira] [Updated] (SPARK-18204) Remove SparkUI.appUIAddress

[ https://issues.apache.org/jira/browse/SPARK-18204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18204: -- Assignee: Jacek Laskowski > Remove SparkUI.appUIAddress > --- > >

[jira] [Updated] (SPARK-18133) Python ML Pipeline Example has syntax errors

[ https://issues.apache.org/jira/browse/SPARK-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18133: -- Fix Version/s: 2.0.3 > Python ML Pipeline Example has syntax errors > -

[jira] [Commented] (SPARK-18213) Syntactic sugar over Pipeline API

[ https://issues.apache.org/jira/browse/SPARK-18213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628333#comment-15628333 ] Sean Owen commented on SPARK-18213: --- I personally don't think this adds much; it's not

[jira] [Issue Comment Deleted] (SPARK-16845) org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16845: -- Comment: was deleted (was: I am currently out of office, and will be back on Tuesday, 1st of November,

[jira] [Resolved] (SPARK-13480) Regression with percentile() + function in GROUP BY

[ https://issues.apache.org/jira/browse/SPARK-13480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-13480. -- Resolution: Cannot Reproduce I am resolving this issue as Cannot Reproduce because it seems thi

[jira] [Commented] (SPARK-18207) class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628338#comment-15628338 ] Sean Owen commented on SPARK-18207: --- SPARK-16845 is unresolved and this seems to be exa

[jira] [Commented] (SPARK-15784) Add Power Iteration Clustering to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628347#comment-15628347 ] Yanbo Liang commented on SPARK-15784: - I'm prefer to #1 and #3, but it looks like we

[jira] [Comment Edited] (SPARK-15784) Add Power Iteration Clustering to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628347#comment-15628347 ] Yanbo Liang edited comment on SPARK-15784 at 11/2/16 9:32 AM: -

[jira] [Resolved] (SPARK-18203) Spark Streaming Kinesis Extension v2.0.1 calls non-existent method

[ https://issues.apache.org/jira/browse/SPARK-18203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18203. --- Resolution: Not A Problem No, it's there in branch-2.0, 2.0.1, etc: https://github.com/apache/spark/

[jira] [Assigned] (SPARK-18076) Fix default Locale used in DateFormat, NumberFormat to Locale.US

[ https://issues.apache.org/jira/browse/SPARK-18076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-18076: - Assignee: Sean Owen > Fix default Locale used in DateFormat, NumberFormat to Locale.US > ---

[jira] [Updated] (SPARK-18076) Fix default Locale used in DateFormat, NumberFormat to Locale.US

[ https://issues.apache.org/jira/browse/SPARK-18076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18076: -- Labels: releasenotes (was: ) > Fix default Locale used in DateFormat, NumberFormat to Locale.US >

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628380#comment-15628380 ] Yanbo Liang commented on SPARK-3181: [~josephkb] Thanks for retargeting. This task was

[jira] [Resolved] (SPARK-18076) Fix default Locale used in DateFormat, NumberFormat to Locale.US

[ https://issues.apache.org/jira/browse/SPARK-18076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18076. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15610 [https://github.co

[jira] [Updated] (SPARK-18204) Remove SparkUI.appUIAddress

[ https://issues.apache.org/jira/browse/SPARK-18204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18204: -- Fix Version/s: (was: 2.1.0) 2.2.0 > Remove SparkUI.appUIAddress > --

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-3181: --- Target Version/s: 2.2.0 > Add Robust Regression Algorithm with Huber Estimator > -

[jira] [Commented] (SPARK-18211) Spark SQL ignores split.size

[ https://issues.apache.org/jira/browse/SPARK-18211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628396#comment-15628396 ] Sean Owen commented on SPARK-18211: --- I'm not sure if this is necessarily supposed to st

[jira] [Resolved] (SPARK-13913) DataFrame.withColumn fails when trying to replace existing column with dot in name

[ https://issues.apache.org/jira/browse/SPARK-13913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-13913. -- Resolution: Cannot Reproduce I am resolving this as Cannot Reproduce as I can't against master.

[jira] [Updated] (SPARK-17692) Document ML/MLlib behavior changes in Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-17692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17692: Description: This JIRA records behavior changes of ML/MLlib between 2.0 and 2.1, so we can note th

[jira] [Commented] (SPARK-14008) Cleanup/Extend the Vectorized Parquet Reader

[ https://issues.apache.org/jira/browse/SPARK-14008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628400#comment-15628400 ] Hyukjin Kwon commented on SPARK-14008: -- Hi [~sameerag], I just wonder if this might

[jira] [Assigned] (SPARK-18138) Remove support for Python 2.6, Hadoop 2.6-, Java 7, and Scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-18138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18138: Assignee: Apache Spark > Remove support for Python 2.6, Hadoop 2.6-, Java 7, and Scala 2.1

[jira] [Assigned] (SPARK-18138) Remove support for Python 2.6, Hadoop 2.6-, Java 7, and Scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-18138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18138: Assignee: (was: Apache Spark) > Remove support for Python 2.6, Hadoop 2.6-, Java 7, an

[jira] [Commented] (SPARK-18138) Remove support for Python 2.6, Hadoop 2.6-, Java 7, and Scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-18138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628424#comment-15628424 ] Apache Spark commented on SPARK-18138: -- User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-18080) Locality Sensitive Hashing (LSH) Python API

[ https://issues.apache.org/jira/browse/SPARK-18080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628449#comment-15628449 ] Yanbo Liang commented on SPARK-18080: - Since SPARK-5992 has been merged, it's better

[jira] [Comment Edited] (SPARK-18080) Locality Sensitive Hashing (LSH) Python API

[ https://issues.apache.org/jira/browse/SPARK-18080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628449#comment-15628449 ] Yanbo Liang edited comment on SPARK-18080 at 11/2/16 10:06 AM:

[jira] [Created] (SPARK-18222) Use math instead of Math

zhengruifeng created SPARK-18222: Summary: Use math instead of Math Key: SPARK-18222 URL: https://issues.apache.org/jira/browse/SPARK-18222 Project: Spark Issue Type: Improvement Co

[jira] [Assigned] (SPARK-18222) Use math instead of Math

[ https://issues.apache.org/jira/browse/SPARK-18222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18222: Assignee: (was: Apache Spark) > Use math instead of Math > >

[jira] [Commented] (SPARK-18222) Use math instead of Math

[ https://issues.apache.org/jira/browse/SPARK-18222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628505#comment-15628505 ] Apache Spark commented on SPARK-18222: -- User 'zhengruifeng' has created a pull reque

[jira] [Assigned] (SPARK-18222) Use math instead of Math

[ https://issues.apache.org/jira/browse/SPARK-18222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18222: Assignee: Apache Spark > Use math instead of Math > > >

[jira] [Commented] (SPARK-18222) Use math instead of Math

[ https://issues.apache.org/jira/browse/SPARK-18222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628515#comment-15628515 ] Sean Owen commented on SPARK-18222: --- I don't believe any of those are usages of scala.M

[jira] [Created] (SPARK-18223) Optimise PartitionedAppendOnlyMap implementation

Adam Roberts created SPARK-18223: Summary: Optimise PartitionedAppendOnlyMap implementation Key: SPARK-18223 URL: https://issues.apache.org/jira/browse/SPARK-18223 Project: Spark Issue Type:

[jira] [Created] (SPARK-18224) Optimise PartitionedPairBuffer implementation

Adam Roberts created SPARK-18224: Summary: Optimise PartitionedPairBuffer implementation Key: SPARK-18224 URL: https://issues.apache.org/jira/browse/SPARK-18224 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-18222) Use math instead of Math

[ https://issues.apache.org/jira/browse/SPARK-18222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628584#comment-15628584 ] zhengruifeng commented on SPARK-18222: -- You are right, I'm sorry to make this mistak

[jira] [Updated] (SPARK-18222) Use math instead of Math

[ https://issues.apache.org/jira/browse/SPARK-18222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-18222: - Description: Unify math/Math usage: use {{scala.math}} instead of {{java.lang.Math}} (was: {{sca

[jira] [Assigned] (SPARK-18223) Optimise PartitionedAppendOnlyMap implementation

[ https://issues.apache.org/jira/browse/SPARK-18223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18223: Assignee: Apache Spark > Optimise PartitionedAppendOnlyMap implementation > --

[jira] [Assigned] (SPARK-18223) Optimise PartitionedAppendOnlyMap implementation

[ https://issues.apache.org/jira/browse/SPARK-18223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18223: Assignee: (was: Apache Spark) > Optimise PartitionedAppendOnlyMap implementation > ---

[jira] [Commented] (SPARK-18223) Optimise PartitionedAppendOnlyMap implementation

[ https://issues.apache.org/jira/browse/SPARK-18223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628669#comment-15628669 ] Apache Spark commented on SPARK-18223: -- User 'a-roberts' has created a pull request

[jira] [Assigned] (SPARK-18224) Optimise PartitionedPairBuffer implementation

[ https://issues.apache.org/jira/browse/SPARK-18224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18224: Assignee: Apache Spark > Optimise PartitionedPairBuffer implementation > -

[jira] [Commented] (SPARK-18224) Optimise PartitionedPairBuffer implementation

[ https://issues.apache.org/jira/browse/SPARK-18224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628685#comment-15628685 ] Apache Spark commented on SPARK-18224: -- User 'a-roberts' has created a pull request

[jira] [Assigned] (SPARK-18224) Optimise PartitionedPairBuffer implementation

[ https://issues.apache.org/jira/browse/SPARK-18224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18224: Assignee: (was: Apache Spark) > Optimise PartitionedPairBuffer implementation > --

[jira] [Created] (SPARK-18225) job will miss when driver removed by master in spark streaming

liujianhui created SPARK-18225: -- Summary: job will miss when driver removed by master in spark streaming Key: SPARK-18225 URL: https://issues.apache.org/jira/browse/SPARK-18225 Project: Spark

[jira] [Commented] (SPARK-16808) History Server main page does not honor APPLICATION_WEB_PROXY_BASE

[ https://issues.apache.org/jira/browse/SPARK-16808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628853#comment-15628853 ] Jeff Antes commented on SPARK-16808: One possible solution is in the /core/src/main/

[jira] [Comment Edited] (SPARK-16808) History Server main page does not honor APPLICATION_WEB_PROXY_BASE

[ https://issues.apache.org/jira/browse/SPARK-16808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628853#comment-15628853 ] Jeff Antes edited comment on SPARK-16808 at 11/2/16 12:46 PM: -

[jira] [Created] (SPARK-18226) SparkR displaying vector columns in incorrect way

Grzegorz Chilkiewicz created SPARK-18226: Summary: SparkR displaying vector columns in incorrect way Key: SPARK-18226 URL: https://issues.apache.org/jira/browse/SPARK-18226 Project: Spark

[jira] [Updated] (SPARK-18226) SparkR displaying vector columns in incorrect way

[ https://issues.apache.org/jira/browse/SPARK-18226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grzegorz Chilkiewicz updated SPARK-18226: - Description: I have encountered a problem with SparkR presenting Spark vectors fr

[jira] [Updated] (SPARK-18226) SparkR displaying vector columns in incorrect way

[ https://issues.apache.org/jira/browse/SPARK-18226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grzegorz Chilkiewicz updated SPARK-18226: - Description: I have encountered a problem with SparkR presenting Spark vectors fr

[jira] [Updated] (SPARK-18226) SparkR displaying vector columns in incorrect way

[ https://issues.apache.org/jira/browse/SPARK-18226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grzegorz Chilkiewicz updated SPARK-18226: - Description: I have encountered a problem with SparkR presenting Spark vectors fr

[jira] [Updated] (SPARK-18176) Kafka010 .createRDD() scala API should expect scala Map

[ https://issues.apache.org/jira/browse/SPARK-18176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-18176: -- Description: Thoughout {{external/kafka-010}}, Java APIs are expecting {{java.util.Maps}} and Scala API

[jira] [Commented] (SPARK-18176) Kafka010 .createRDD() scala API should expect scala Map

[ https://issues.apache.org/jira/browse/SPARK-18176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628895#comment-15628895 ] Liwei Lin commented on SPARK-18176: --- Closing this for now; we can re-open if any people

[jira] [Closed] (SPARK-18176) Kafka010 .createRDD() scala API should expect scala Map

[ https://issues.apache.org/jira/browse/SPARK-18176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin closed SPARK-18176. - Resolution: Not A Problem > Kafka010 .createRDD() scala API should expect scala Map > ---

[jira] [Resolved] (SPARK-18223) Optimise PartitionedAppendOnlyMap implementation

[ https://issues.apache.org/jira/browse/SPARK-18223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18223. --- Resolution: Duplicate Let's put these changes together because they're virtually identical. > Optimi

[jira] [Created] (SPARK-18227) Parquet file stream sink create a hidden directory "_spark_metadata" cause the DataFrame read failed

Lantao Jin created SPARK-18227: -- Summary: Parquet file stream sink create a hidden directory "_spark_metadata" cause the DataFrame read failed Key: SPARK-18227 URL: https://issues.apache.org/jira/browse/SPARK-18227

[jira] [Updated] (SPARK-18227) Parquet file stream sink create a hidden directory "_spark_metadata" cause the DataFrame read failed

[ https://issues.apache.org/jira/browse/SPARK-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-18227: --- Description: When we set an out directory as a streaming sink with parquet format in structured stre

  1   2   3   >