[jira] [Commented] (SPARK-11560) Optimize KMeans implementation

[ https://issues.apache.org/jira/browse/SPARK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105379#comment-15105379 ] Apache Spark commented on SPARK-11560: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-8519) Blockify distance computation in k-means

[ https://issues.apache.org/jira/browse/SPARK-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105378#comment-15105378 ] Apache Spark commented on SPARK-8519: - User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-11559) Make `runs` no effect in k-means

[ https://issues.apache.org/jira/browse/SPARK-11559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105380#comment-15105380 ] Apache Spark commented on SPARK-11559: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Updated] (SPARK-12878) Dataframe fails with nested User Defined Types

[ https://issues.apache.org/jira/browse/SPARK-12878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao updated SPARK-12878: - Description: Spark 1.6.0 crashes when using nested User Defined Types in a Dataframe. In version 1.5.2 the code

[jira] [Created] (SPARK-12878) Dataframe fails with nested User Defined Types

Joao created SPARK-12878: Summary: Dataframe fails with nested User Defined Types Key: SPARK-12878 URL: https://issues.apache.org/jira/browse/SPARK-12878 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-1529) Support DFS based shuffle in addition to Netty shuffle

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1529. -- Resolution: Won't Fix > Support DFS based shuffle in addition to Netty shuffle >

[jira] [Updated] (SPARK-2153) CassandraTest fails for newer Cassandra due to case insensitive key space

[ https://issues.apache.org/jira/browse/SPARK-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2153: - Labels: (was: examples) Issue Type: Improvement (was: Bug) [~vishnusubramanian] would this be

[jira] [Resolved] (SPARK-2703) Make Tachyon related unit tests execute without deploying a Tachyon system locally.

[ https://issues.apache.org/jira/browse/SPARK-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2703. -- Resolution: Won't Fix Assignee: (was: Rong Gu) > Make Tachyon related unit tests execute

[jira] [Resolved] (SPARK-10264) Add @Since annotation to ml.recoomendation

[ https://issues.apache.org/jira/browse/SPARK-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10264. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10756

[jira] [Resolved] (SPARK-1169) Add countApproxDistinctByKey to PySpark

[ https://issues.apache.org/jira/browse/SPARK-1169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1169. -- Resolution: Won't Fix > Add countApproxDistinctByKey to PySpark >

[jira] [Resolved] (SPARK-2653) Heap size should be the sum of driver.memory and executor.memory in local mode

[ https://issues.apache.org/jira/browse/SPARK-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2653. -- Resolution: Not A Problem Although I don't feel so strongly about this either way, it would be a

[jira] [Resolved] (SPARK-3437) Adapt maven build to work without the need of hardcoding scala binary version in artifact id.

[ https://issues.apache.org/jira/browse/SPARK-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3437. -- Resolution: Won't Fix > Adapt maven build to work without the need of hardcoding scala binary version

[jira] [Resolved] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3107. -- Resolution: Duplicate I think the result was that this was resolved, narrowly, by SPARK-2933 > Don't

[jira] [Issue Comment Deleted] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11518: -- Comment: was deleted (was: No. I just use work around to not put Spark into a such folder.) > The

[jira] [Issue Comment Deleted] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11518: -- Comment: was deleted (was: No. I just use work around to not put Spark into a such folder.) > The

[jira] [Commented] (SPARK-12863) missing api for renaming and mapping result of operations on GroupedDataset to case classes

[ https://issues.apache.org/jira/browse/SPARK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105262#comment-15105262 ] Milad Khajavi commented on SPARK-12863: --- I'm doing it with Dataframe api, but Dataset api doesn't

[jira] [Comment Edited] (SPARK-12863) missing api for renaming and mapping result of operations on GroupedDataset to case classes

[ https://issues.apache.org/jira/browse/SPARK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105262#comment-15105262 ] Milad Khajavi edited comment on SPARK-12863 at 1/18/16 1:18 PM: I'm doing

[jira] [Resolved] (SPARK-3872) Rewrite the test for ActorInputStream.

[ https://issues.apache.org/jira/browse/SPARK-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3872. -- Resolution: Won't Fix > Rewrite the test for ActorInputStream. >

[jira] [Commented] (SPARK-8519) Blockify distance computation in k-means

[ https://issues.apache.org/jira/browse/SPARK-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105426#comment-15105426 ] Apache Spark commented on SPARK-8519: - User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-11559) Make `runs` no effect in k-means

[ https://issues.apache.org/jira/browse/SPARK-11559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105428#comment-15105428 ] Apache Spark commented on SPARK-11559: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-11560) Optimize KMeans implementation

[ https://issues.apache.org/jira/browse/SPARK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105427#comment-15105427 ] Apache Spark commented on SPARK-11560: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15104911#comment-15104911 ] Ma Xiaoyu commented on SPARK-5159: -- Sorry and I realised that I messed up my PR with SPARK-6910. My code

[jira] [Comment Edited] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15104911#comment-15104911 ] Ma Xiaoyu edited comment on SPARK-5159 at 1/18/16 8:16 AM: --- Sorry and I realised

[jira] [Comment Edited] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15104911#comment-15104911 ] Ma Xiaoyu edited comment on SPARK-5159 at 1/18/16 8:17 AM: --- Sorry and I realised

[jira] [Commented] (SPARK-3159) Check for reducible DecisionTree

[ https://issues.apache.org/jira/browse/SPARK-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105061#comment-15105061 ] Sean Owen commented on SPARK-3159: -- [~josephkb] I noticed a number of fairly old issues (~18 months) from

[jira] [Resolved] (SPARK-2780) Create a StreamingContext.setLocalProperty for setting local property of jobs launched by streaming

[ https://issues.apache.org/jira/browse/SPARK-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2780. -- Resolution: Won't Fix > Create a StreamingContext.setLocalProperty for setting local property of jobs

[jira] [Resolved] (SPARK-2255) create a self destructing iterator that releases records from hash maps

[ https://issues.apache.org/jira/browse/SPARK-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2255. -- Resolution: Won't Fix I'm guessing this isn't going anywhere or is obsolete > create a self

[jira] [Resolved] (SPARK-748) Add documentation page describing interoperability with other software (e.g. HBase, JDBC, Kafka, etc.)

[ https://issues.apache.org/jira/browse/SPARK-748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-748. - Resolution: Won't Fix Some of this exists in pieces in the docs. It's also committing to update and

[jira] [Created] (SPARK-12875) Add Weight of Evidence and Information value to Spark.ml as a feature transformer

yuhao yang created SPARK-12875: -- Summary: Add Weight of Evidence and Information value to Spark.ml as a feature transformer Key: SPARK-12875 URL: https://issues.apache.org/jira/browse/SPARK-12875

[jira] [Updated] (SPARK-12860) speed up safe projection for primitive types

[ https://issues.apache.org/jira/browse/SPARK-12860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12860: -- Assignee: Wenchen Fan > speed up safe projection for primitive types >

[jira] [Updated] (SPARK-12868) ADD JAR via sparkSQL JDBC will fail when using a HDFS URL

[ https://issues.apache.org/jira/browse/SPARK-12868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12868: -- Component/s: SQL > ADD JAR via sparkSQL JDBC will fail when using a HDFS URL >

[jira] [Resolved] (SPARK-578) Fix interpreter code generation to only capture needed dependencies

[ https://issues.apache.org/jira/browse/SPARK-578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-578. - Resolution: Not A Problem This is so old that I think it's obsolete > Fix interpreter code generation to

[jira] [Resolved] (SPARK-634) Track and display a read count for each block replica in BlockManager

[ https://issues.apache.org/jira/browse/SPARK-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-634. - Resolution: Won't Fix Closing just because of extreme age > Track and display a read count for each block

[jira] [Commented] (SPARK-11714) Make Spark on Mesos honor port restrictions

[ https://issues.apache.org/jira/browse/SPARK-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105017#comment-15105017 ] Stavros Kontopoulos commented on SPARK-11714: - soon i will have a pull request... > Make

[jira] [Resolved] (SPARK-12803) Consider adding ability to profile specific instances of executors in spark

[ https://issues.apache.org/jira/browse/SPARK-12803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12803. --- Resolution: Won't Fix > Consider adding ability to profile specific instances of executors in spark

[jira] [Resolved] (SPARK-2962) Suboptimal scheduling in spark

[ https://issues.apache.org/jira/browse/SPARK-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2962. -- Resolution: Not A Problem Given the final comment, sounds like there is a belief this was in fact

[jira] [Resolved] (SPARK-3927) Extends SPARK-2577 to fix secondary resources

[ https://issues.apache.org/jira/browse/SPARK-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3927. -- Resolution: Won't Fix > Extends SPARK-2577 to fix secondary resources >

[jira] [Resolved] (SPARK-729) Closures not always serialized at capture time

[ https://issues.apache.org/jira/browse/SPARK-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-729. - Resolution: Won't Fix I'm tentatively closing for lack of activity; it is problematic to implement and

[jira] [Assigned] (SPARK-12871) Support to specify the option for compression codec.

[ https://issues.apache.org/jira/browse/SPARK-12871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12871: Assignee: Apache Spark > Support to specify the option for compression codec. >

[jira] [Commented] (SPARK-12871) Support to specify the option for compression codec.

[ https://issues.apache.org/jira/browse/SPARK-12871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105086#comment-15105086 ] Apache Spark commented on SPARK-12871: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-12871) Support to specify the option for compression codec.

[ https://issues.apache.org/jira/browse/SPARK-12871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12871: Assignee: (was: Apache Spark) > Support to specify the option for compression codec.

[jira] [Commented] (SPARK-12875) Add Weight of Evidence and Information value to Spark.ml as a feature transformer

[ https://issues.apache.org/jira/browse/SPARK-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105000#comment-15105000 ] Apache Spark commented on SPARK-12875: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12875) Add Weight of Evidence and Information value to Spark.ml as a feature transformer

[ https://issues.apache.org/jira/browse/SPARK-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12875: Assignee: (was: Apache Spark) > Add Weight of Evidence and Information value to

[jira] [Assigned] (SPARK-12875) Add Weight of Evidence and Information value to Spark.ml as a feature transformer

[ https://issues.apache.org/jira/browse/SPARK-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12875: Assignee: Apache Spark > Add Weight of Evidence and Information value to Spark.ml as a

[jira] [Resolved] (SPARK-540) Add API to customize in-memory representation of RDDs

[ https://issues.apache.org/jira/browse/SPARK-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-540. - Resolution: Not A Problem I assume this is subsumed by things like dataframes and the dataset API. > Add

[jira] [Commented] (SPARK-3981) Consider a better approach to initialize SerDe on executors

[ https://issues.apache.org/jira/browse/SPARK-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105064#comment-15105064 ] Sean Owen commented on SPARK-3981: -- Is this still an issue? > Consider a better approach to initialize

[jira] [Assigned] (SPARK-11714) Make Spark on Mesos honor port restrictions

[ https://issues.apache.org/jira/browse/SPARK-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11714: Assignee: Apache Spark > Make Spark on Mesos honor port restrictions >

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105560#comment-15105560 ] Mario Briggs commented on SPARK-12177: -- Hi Nikita, great. 1 - We should also have a

[jira] [Commented] (SPARK-9976) create function do not work

[ https://issues.apache.org/jira/browse/SPARK-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105570#comment-15105570 ] Yin Huai commented on SPARK-9976: - what version of spark are you using? Also, what is the error message?

[jira] [Commented] (SPARK-11714) Make Spark on Mesos honor port restrictions

[ https://issues.apache.org/jira/browse/SPARK-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105554#comment-15105554 ] Apache Spark commented on SPARK-11714: -- User 'skonto' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11714) Make Spark on Mesos honor port restrictions

[ https://issues.apache.org/jira/browse/SPARK-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11714: Assignee: (was: Apache Spark) > Make Spark on Mesos honor port restrictions >

[jira] [Resolved] (SPARK-11139) Make SparkContext.stop() exception-safe

[ https://issues.apache.org/jira/browse/SPARK-11139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11139. --- Resolution: Duplicate OK then this one is the duplicate > Make SparkContext.stop() exception-safe >

[jira] [Created] (SPARK-12879) improve unsafe row writing framework

Wenchen Fan created SPARK-12879: --- Summary: improve unsafe row writing framework Key: SPARK-12879 URL: https://issues.apache.org/jira/browse/SPARK-12879 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12879) improve unsafe row writing framework

[ https://issues.apache.org/jira/browse/SPARK-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12879: Assignee: (was: Apache Spark) > improve unsafe row writing framework >

[jira] [Commented] (SPARK-12879) improve unsafe row writing framework

[ https://issues.apache.org/jira/browse/SPARK-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105608#comment-15105608 ] Apache Spark commented on SPARK-12879: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12879) improve unsafe row writing framework

[ https://issues.apache.org/jira/browse/SPARK-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12879: Assignee: Apache Spark > improve unsafe row writing framework >

[jira] [Commented] (SPARK-12867) Nullability of Intersect can be stricter

[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105616#comment-15105616 ] Cheng Lian commented on SPARK-12867: Thanks for helping! Go ahead, please. I'm assigning this to you.

[jira] [Updated] (SPARK-12867) Nullability of Intersect can be stricter

[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12867: --- Assignee: Xiao Li > Nullability of Intersect can be stricter >

[jira] [Commented] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105619#comment-15105619 ] Apache Spark commented on SPARK-10620: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105621#comment-15105621 ] Gabor Feher commented on SPARK-3630: Hi, I've run into this problem as well. {code}

[jira] [Commented] (SPARK-12867) Nullability of Intersect can be stricter

[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105622#comment-15105622 ] Xiao Li commented on SPARK-12867: - Thank you! > Nullability of Intersect can be stricter >

[jira] [Commented] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105643#comment-15105643 ] Apache Spark commented on SPARK-10620: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Created] (SPARK-12880) Different results on groupBy after window function

Saif Addin Ellafi created SPARK-12880: - Summary: Different results on groupBy after window function Key: SPARK-12880 URL: https://issues.apache.org/jira/browse/SPARK-12880 Project: Spark

[jira] [Created] (SPARK-12876) Race condition when driver rapidly shutdown after started.

jeffonia Tung created SPARK-12876: - Summary: Race condition when driver rapidly shutdown after started. Key: SPARK-12876 URL: https://issues.apache.org/jira/browse/SPARK-12876 Project: Spark

[jira] [Commented] (SPARK-9976) create function do not work

[ https://issues.apache.org/jira/browse/SPARK-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105168#comment-15105168 ] ocean commented on SPARK-9976: -- Does sparksql support temporary udf function which extends udf now? Now I

[jira] [Updated] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Rosner updated SPARK-12823: - Description: h5. Problem It is not possible to apply a UDF to a column that has a struct data

[jira] [Updated] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Rosner updated SPARK-12823: - Description: h5. Problem It is not possible to apply a UDF to a column that has a struct data

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12876: -- Priority: Minor (was: Major) How do you reproduce it? > Race condition when driver rapidly shutdown

[jira] [Created] (SPARK-12877) TrainValidationSplit is missing in pyspark.ml.tuning

Wojciech Jurczyk created SPARK-12877: Summary: TrainValidationSplit is missing in pyspark.ml.tuning Key: SPARK-12877 URL: https://issues.apache.org/jira/browse/SPARK-12877 Project: Spark

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeffonia Tung updated SPARK-12876: -- Description: It's a little same as the issue: SPARK-4300 [INFO 2016-01-18 17:12:35

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeffonia Tung updated SPARK-12876: -- Description: It's a little same as the issue: SPARK-4300. Well, this time, it's happen on the

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeffonia Tung updated SPARK-12876: -- Description: It's a little same as the issue: SPARK-4300. Well, this time, it's happen on the

[jira] [Resolved] (SPARK-12863) missing api for renaming and mapping result of operations on GroupedDataset to case classes

[ https://issues.apache.org/jira/browse/SPARK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12863. --- Resolution: Not A Problem You haven't proposed an API; you're asking how to do something, which can

[jira] [Closed] (SPARK-12863) missing api for renaming and mapping result of operations on GroupedDataset to case classes

[ https://issues.apache.org/jira/browse/SPARK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-12863. - > missing api for renaming and mapping result of operations on GroupedDataset > to case classes >

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeffonia Tung updated SPARK-12876: -- Description: It's a little same as the issue: SPARK-4300. Well, this time, it's happen on the

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeffonia Tung updated SPARK-12876: -- Description: It's a little same as the issue: SPARK-4300. Well, this time, it's happen on the

[jira] [Reopened] (SPARK-12863) missing api for renaming and mapping result of operations on GroupedDataset to case classes

[ https://issues.apache.org/jira/browse/SPARK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milad Khajavi reopened SPARK-12863: --- I have no question. The spark 1.6.0 have missing api for this problem. > missing api for

[jira] [Commented] (SPARK-11948) Permanent UDF not work

[ https://issues.apache.org/jira/browse/SPARK-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105170#comment-15105170 ] ocean commented on SPARK-11948: --- Does sparksql support temporary udf function which extends udf now? Now I

[jira] [Updated] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Rosner updated SPARK-12823: - Description: h5. Problem It is not possible to apply a UDF to a column that has a struct data

[jira] [Updated] (SPARK-12823) Cannot create UDF with StructType input

[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Rosner updated SPARK-12823: - Description: h5. Problem It is not possible to apply a UDF to a column that has a struct data

[jira] [Commented] (SPARK-11139) Make SparkContext.stop() exception-safe

[ https://issues.apache.org/jira/browse/SPARK-11139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105519#comment-15105519 ] Thomas Sebastian commented on SPARK-11139: -- I have re-opened the issue SPARK-11137 , for this

[jira] [Commented] (SPARK-11137) Make StreamingContext.stop() exception-safe

[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105524#comment-15105524 ] Apache Spark commented on SPARK-11137: -- User 'jayadevanmurali' has created a pull request for this

[jira] [Assigned] (SPARK-11137) Make StreamingContext.stop() exception-safe

[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11137: Assignee: (was: Apache Spark) > Make StreamingContext.stop() exception-safe >

[jira] [Assigned] (SPARK-11137) Make StreamingContext.stop() exception-safe

[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11137: Assignee: Apache Spark > Make StreamingContext.stop() exception-safe >

[jira] [Reopened] (SPARK-11137) Make StreamingContext.stop() exception-safe

[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Sebastian reopened SPARK-11137: -- Re-opening this issue based on the discussion at

[jira] [Commented] (SPARK-11137) Make StreamingContext.stop() exception-safe

[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105523#comment-15105523 ] Jayadevan M commented on SPARK-11137: - [~thomastechs] working on the fix > Make

[jira] [Commented] (SPARK-12864) initialize executorIdCounter after ApplicationMaster killed for max number of executor failures reached

[ https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105671#comment-15105671 ] Saisai Shao commented on SPARK-12864: - What's Spark version are you using? I remember I fixed a

[jira] [Updated] (SPARK-12880) Different results on groupBy after window function

[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin Ellafi updated SPARK-12880: -- Description: scala> val overVint = Window.partitionBy("product", "bnd",

[jira] [Comment Edited] (SPARK-12864) initialize executorIdCounter after ApplicationMaster killed for max number of executor failures reached

[ https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105671#comment-15105671 ] Saisai Shao edited comment on SPARK-12864 at 1/18/16 7:03 PM: -- What Spark

[jira] [Updated] (SPARK-12880) Different results on groupBy after window function

[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-12880: -- Description: {noformat} scala> val overVint = Window.partitionBy("product", "bnd",

[jira] [Commented] (SPARK-12880) Different results on groupBy after window function

[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105678#comment-15105678 ] Herman van Hovell commented on SPARK-12880: --- You are ordering by {{MM}} and it looks like

[jira] [Updated] (SPARK-12880) Different results on groupBy after window function

[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-12880: -- Priority: Major (was: Critical) > Different results on groupBy after window function

[jira] [Resolved] (SPARK-12873) Add more comment in HiveTypeCoercion for type widening

[ https://issues.apache.org/jira/browse/SPARK-12873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12873. - Resolution: Fixed Fix Version/s: 2.0.0 > Add more comment in HiveTypeCoercion for type

[jira] [Assigned] (SPARK-12867) Nullability of Intersect can be stricter

[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12867: Assignee: Xiao Li (was: Apache Spark) > Nullability of Intersect can be stricter >

[jira] [Assigned] (SPARK-12867) Nullability of Intersect can be stricter

[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12867: Assignee: Apache Spark (was: Xiao Li) > Nullability of Intersect can be stricter >

[jira] [Commented] (SPARK-12867) Nullability of Intersect can be stricter

[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105725#comment-15105725 ] Apache Spark commented on SPARK-12867: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Closed] (SPARK-12880) Different results on groupBy after window function

[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin Ellafi closed SPARK-12880. - Resolution: Not A Problem > Different results on groupBy after window function >

[jira] [Commented] (SPARK-12880) Different results on groupBy after window function

[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105748#comment-15105748 ] Saif Addin Ellafi commented on SPARK-12880: --- Thank you, I think what you mention is the case. I

[jira] [Commented] (SPARK-12880) Different results on groupBy after window function

[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105751#comment-15105751 ] Herman van Hovell commented on SPARK-12880: --- No Problem. You don't have to delete this, since

[jira] [Updated] (SPARK-12893) RM redirects to incorrect URL in Spark HistoryServer for yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-12893: Attachment: Screen Shot 2016-01-18 at 3.47.24 PM.png > RM redirects to incorrect URL in Spark

  1   2   3   >