[jira] [Assigned] (SPARK-8804) order of UTF8String is wrong if there is any non-ascii character in it

[ https://issues.apache.org/jira/browse/SPARK-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8804: --- Assignee: Davies Liu (was: Apache Spark) > order of UTF8String is wrong if there is any non

[jira] [Commented] (SPARK-8804) order of UTF8String is wrong if there is any non-ascii character in it

[ https://issues.apache.org/jira/browse/SPARK-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614166#comment-14614166 ] Apache Spark commented on SPARK-8804: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-8804) order of UTF8String is wrong if there is any non-ascii character in it

[ https://issues.apache.org/jira/browse/SPARK-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8804: --- Assignee: Apache Spark (was: Davies Liu) > order of UTF8String is wrong if there is any non

[jira] [Assigned] (SPARK-8753) Create an IntervalType data type

[ https://issues.apache.org/jira/browse/SPARK-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8753: --- Assignee: Apache Spark > Create an IntervalType data type >

[jira] [Assigned] (SPARK-8753) Create an IntervalType data type

[ https://issues.apache.org/jira/browse/SPARK-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8753: --- Assignee: (was: Apache Spark) > Create an IntervalType data type > --

[jira] [Commented] (SPARK-8753) Create an IntervalType data type

[ https://issues.apache.org/jira/browse/SPARK-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614144#comment-14614144 ] Apache Spark commented on SPARK-8753: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-8826) Fix ClassCastException in GeneratedAggregate

[ https://issues.apache.org/jira/browse/SPARK-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8826: --- Assignee: (was: Apache Spark) > Fix ClassCastException in GeneratedAggregate > --

[jira] [Commented] (SPARK-8826) Fix ClassCastException in GeneratedAggregate

[ https://issues.apache.org/jira/browse/SPARK-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614139#comment-14614139 ] Apache Spark commented on SPARK-8826: - User 'navis' has created a pull request for thi

[jira] [Assigned] (SPARK-8826) Fix ClassCastException in GeneratedAggregate

[ https://issues.apache.org/jira/browse/SPARK-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8826: --- Assignee: Apache Spark > Fix ClassCastException in GeneratedAggregate > -

[jira] [Created] (SPARK-8826) Fix ClassCastException in GeneratedAggregate

Navis created SPARK-8826: Summary: Fix ClassCastException in GeneratedAggregate Key: SPARK-8826 URL: https://issues.apache.org/jira/browse/SPARK-8826 Project: Spark Issue Type: Bug Componen

[jira] [Updated] (SPARK-6442) MLlib 1.4 Local Linear Algebra Package

[ https://issues.apache.org/jira/browse/SPARK-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-6442: --- Description: MLlib's local linear algebra package doesn't have any support for any type of matrix ope

[jira] [Created] (SPARK-8825) Spark build fails

Nicholas Brown created SPARK-8825: - Summary: Spark build fails Key: SPARK-8825 URL: https://issues.apache.org/jira/browse/SPARK-8825 Project: Spark Issue Type: Bug Components: Build

[jira] [Commented] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614080#comment-14614080 ] Davies Liu commented on SPARK-8636: --- [~smolav] I'm just curious that how can we sort of

[jira] [Updated] (SPARK-6774) Implement Parquet complex types backwards-compatiblity rules

[ https://issues.apache.org/jira/browse/SPARK-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6774: -- Shepherd: Cheng Lian > Implement Parquet complex types backwards-compatiblity rules > --

[jira] [Commented] (SPARK-8784) Add python API for hex/unhex

[ https://issues.apache.org/jira/browse/SPARK-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614016#comment-14614016 ] Apache Spark commented on SPARK-8784: - User 'davies' has created a pull request for th

[jira] [Resolved] (SPARK-8822) clean up type checking in math.scala

[ https://issues.apache.org/jira/browse/SPARK-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8822. Resolution: Fixed Fix Version/s: 1.5.0 > clean up type checking in math.scala > -

[jira] [Commented] (SPARK-2344) Add Fuzzy C-Means algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613928#comment-14613928 ] Beniamino commented on SPARK-2344: -- Hi Alex! I'm not going to submit the algorithm since

[jira] [Commented] (SPARK-6442) MLlib 1.4 Local Linear Algebra Package

[ https://issues.apache.org/jira/browse/SPARK-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613665#comment-14613665 ] Emrehan Tuzun commented on SPARK-6442: -- The version in the comment should be updated

[jira] [Created] (SPARK-8824) Support Parquet logical types TIMESTAMP_MILLIS and TIMESTAMP_MICROS

Cheng Lian created SPARK-8824: - Summary: Support Parquet logical types TIMESTAMP_MILLIS and TIMESTAMP_MICROS Key: SPARK-8824 URL: https://issues.apache.org/jira/browse/SPARK-8824 Project: Spark

[jira] [Resolved] (SPARK-8270) string function: levenshtein

[ https://issues.apache.org/jira/browse/SPARK-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8270. Resolution: Fixed Fix Version/s: 1.5.0 > string function: levenshtein > -

[jira] [Commented] (SPARK-8811) Read array struct data from parquet error

[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613594#comment-14613594 ] Cheng Lian commented on SPARK-8811: --- This is actually a known Parquet compatibility issu

[jira] [Assigned] (SPARK-8823) Optimizations for sparse vector products in pyspark.mllib.linalg

[ https://issues.apache.org/jira/browse/SPARK-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8823: --- Assignee: (was: Apache Spark) > Optimizations for sparse vector products in pyspark.mllib

[jira] [Assigned] (SPARK-8823) Optimizations for sparse vector products in pyspark.mllib.linalg

[ https://issues.apache.org/jira/browse/SPARK-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8823: --- Assignee: Apache Spark > Optimizations for sparse vector products in pyspark.mllib.linalg > -

[jira] [Commented] (SPARK-8823) Optimizations for sparse vector products in pyspark.mllib.linalg

[ https://issues.apache.org/jira/browse/SPARK-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613590#comment-14613590 ] Apache Spark commented on SPARK-8823: - User 'MechCoder' has created a pull request for

[jira] [Created] (SPARK-8823) Optimizations for sparse vector products in pyspark.mllib.linalg

Manoj Kumar created SPARK-8823: -- Summary: Optimizations for sparse vector products in pyspark.mllib.linalg Key: SPARK-8823 URL: https://issues.apache.org/jira/browse/SPARK-8823 Project: Spark I

[jira] [Updated] (SPARK-8541) sumApprox and meanApprox doctests are incorrect

[ https://issues.apache.org/jira/browse/SPARK-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8541: - Fix Version/s: 1.3.2 > sumApprox and meanApprox doctests are incorrect > -

[jira] [Commented] (SPARK-8819) Spark doesn't compile with maven 3.3.x

[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613587#comment-14613587 ] Sean Owen commented on SPARK-8819: -- PS I don't believe it has anything to do with Maven.

[jira] [Commented] (SPARK-8815) illegal java package names in jar

[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613586#comment-14613586 ] Sean Owen commented on SPARK-8815: -- Hm [~fommil] I see that a PackageSpecifier is basical

[jira] [Updated] (SPARK-8606) Exceptions in RDD.getPreferredLocations() and getPartitions() should not be able to crash DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8606: - Fix Version/s: 1.3.2 > Exceptions in RDD.getPreferredLocations() and getPartitions() should not be > able

[jira] [Updated] (SPARK-8525) Bug in Streaming k-means documentation

[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8525: - Fix Version/s: 1.3.2 1.2.3 1.1.2 > Bug in Streaming k-means document

[jira] [Updated] (SPARK-8607) SparkR - Third party jars are not being added to classpath in SparkRBackend

[ https://issues.apache.org/jira/browse/SPARK-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8607: - Fix Version/s: (was: 1.4.2) 1.4.1 > SparkR - Third party jars are not being added t

[jira] [Updated] (SPARK-8410) Hive VersionsSuite RuntimeException

[ https://issues.apache.org/jira/browse/SPARK-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8410: - Fix Version/s: (was: 1.4.2) 1.4.1 > Hive VersionsSuite RuntimeException > -

[jira] [Updated] (SPARK-8619) Can't find the keytab file when recovering the streaming application.

[ https://issues.apache.org/jira/browse/SPARK-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8619: - Fix Version/s: (was: 1.4.2) 1.4.1 > Can't find the keytab file when recovering the

[jira] [Updated] (SPARK-7810) rdd.py "_load_from_socket" cannot load data from jvm socket if ipv6 is used

[ https://issues.apache.org/jira/browse/SPARK-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7810: - Fix Version/s: (was: 1.4.2) (was: 1.3.2) 1.4.1 > rdd.py "_lo

[jira] [Updated] (SPARK-8715) ArrayOutOfBoundsException for DataFrameStatSuite.crosstab

[ https://issues.apache.org/jira/browse/SPARK-8715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8715: - Fix Version/s: (was: 1.4.2) 1.4.1 > ArrayOutOfBoundsException for DataFrameStatSuit

[jira] [Updated] (SPARK-8662) [SparkR] SparkSQL tests fail in R 3.2

[ https://issues.apache.org/jira/browse/SPARK-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8662: - Fix Version/s: (was: 1.4.2) 1.4.1 > [SparkR] SparkSQL tests fail in R 3.2 > ---

[jira] [Updated] (SPARK-8710) ScalaReflection.mirror should be a def

[ https://issues.apache.org/jira/browse/SPARK-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8710: - Fix Version/s: (was: 1.4.2) 1.4.1 > ScalaReflection.mirror should be a def > --

[jira] [Updated] (SPARK-8634) Fix flaky test StreamingListenerSuite "receiver info reporting"

[ https://issues.apache.org/jira/browse/SPARK-8634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8634: - Fix Version/s: (was: 1.4.2) 1.4.1 > Fix flaky test StreamingListenerSuite "receiver

[jira] [Updated] (SPARK-8678) Default values in Pipeline API should be immutable

[ https://issues.apache.org/jira/browse/SPARK-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8678: - Fix Version/s: (was: 1.4.2) 1.4.1 > Default values in Pipeline API should be immuta

[jira] [Updated] (SPARK-8355) Python DataFrameReader/Writer should mirror scala

[ https://issues.apache.org/jira/browse/SPARK-8355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8355: - Fix Version/s: (was: 1.4.2) 1.4.1 > Python DataFrameReader/Writer should mirror sca

[jira] [Updated] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8437: - Fix Version/s: (was: 1.4.2) 1.4.1 > Using directory path without wildcard for filen

[jira] [Updated] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8475: - Fix Version/s: (was: 1.4.2) 1.4.1 > SparkSubmit with Ivy jars is very slow to load

[jira] [Updated] (SPARK-8525) Bug in Streaming k-means documentation

[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8525: - Fix Version/s: (was: 1.4.2) (was: 1.2.3) (was: 1.3.2)

[jira] [Updated] (SPARK-8399) Overlap between histograms and axis' name in Spark Streaming UI

[ https://issues.apache.org/jira/browse/SPARK-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8399: - Fix Version/s: (was: 1.4.2) 1.4.1 > Overlap between histograms and axis' name in Sp

[jira] [Updated] (SPARK-8630) Prevent from checkpointing QueueInputDStream

[ https://issues.apache.org/jira/browse/SPARK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8630: - Fix Version/s: (was: 1.4.2) 1.4.1 > Prevent from checkpointing QueueInputDStream >

[jira] [Updated] (SPARK-8541) sumApprox and meanApprox doctests are incorrect

[ https://issues.apache.org/jira/browse/SPARK-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8541: - Fix Version/s: (was: 1.4.2) (was: 1.3.2) 1.4.1 > sumApprox a

[jira] [Updated] (SPARK-8681) crosstab column names in wrong order

[ https://issues.apache.org/jira/browse/SPARK-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8681: - Fix Version/s: (was: 1.4.2) 1.4.1 > crosstab column names in wrong order >

[jira] [Updated] (SPARK-8606) Exceptions in RDD.getPreferredLocations() and getPartitions() should not be able to crash DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8606: - Fix Version/s: (was: 1.4.2) (was: 1.3.2) 1.4.1 > Exceptions

[jira] [Updated] (SPARK-8815) illegal java package names in jar

[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8815: - Priority: Minor (was: Major) Component/s: Spark Core PS I do see that package names are just ident

[jira] [Commented] (SPARK-3449) Akka-based receiver can't find messages defined in uploaded jar

[ https://issues.apache.org/jira/browse/SPARK-3449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613578#comment-14613578 ] Sean Cho commented on SPARK-3449: - any update for this issue? > Akka-based receiver can't

[jira] [Updated] (SPARK-8591) Block failed to unroll to memory should not be replicated for MEMORY_ONLY_2 StorageLevel

[ https://issues.apache.org/jira/browse/SPARK-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dibyendu Bhattacharya updated SPARK-8591: - Description: Block which failed to unroll to memory and returned iterator and size

[jira] [Updated] (SPARK-8591) Block failed to unroll to memory should not be replicated for MEMORY_ONLY_2 StorageLevel

[ https://issues.apache.org/jira/browse/SPARK-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dibyendu Bhattacharya updated SPARK-8591: - Description: Block which failed to unroll to memory and returned iterator and size

[jira] [Updated] (SPARK-8591) Block failed to unroll to memory should not be replicated for MEMORY_ONLY_2 StorageLevel

[ https://issues.apache.org/jira/browse/SPARK-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dibyendu Bhattacharya updated SPARK-8591: - Description: Block which failed to unroll to memory and returned iterator and size