[jira] [Commented] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604437#comment-15604437 ] Hyukjin Kwon commented on SPARK-18068: -- Oh, it is documented only in codes - https:

[jira] [Comment Edited] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604377#comment-15604377 ] Hyukjin Kwon edited comment on SPARK-18068 at 10/25/16 7:01 AM: ---

[jira] [Commented] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-25 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604443#comment-15604443 ] Stephane Maarek commented on SPARK-18068: - Would be awesome to expose it in the o

[jira] [Resolved] (SPARK-18026) should not always lowercase partition columns of partition spec in parser

2016-10-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18026. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15566 [https://githu

[jira] [Created] (SPARK-18091) Deep if expressions cause Generated SpecificUnsafeProjection code to exceed JVM code size limit

2016-10-25 Thread Kapil Singh (JIRA)
Kapil Singh created SPARK-18091: --- Summary: Deep if expressions cause Generated SpecificUnsafeProjection code to exceed JVM code size limit Key: SPARK-18091 URL: https://issues.apache.org/jira/browse/SPARK-18091

[jira] [Updated] (SPARK-18091) Deep if expressions cause Generated SpecificUnsafeProjection code to exceed JVM code size limit

2016-10-25 Thread Kapil Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kapil Singh updated SPARK-18091: Description: *Problem Description:* I have an application in which a lot of if-else decisioning is

[jira] [Commented] (SPARK-13331) AES support for over-the-wire encryption

2016-10-25 Thread Junjie Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604582#comment-15604582 ] Junjie Chen commented on SPARK-13331: - Hi [~vanzin] The updated patch was committed

[jira] [Commented] (SPARK-18091) Deep if expressions cause Generated SpecificUnsafeProjection code to exceed JVM code size limit

2016-10-25 Thread Kapil Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604587#comment-15604587 ] Kapil Singh commented on SPARK-18091: - I've started working on this > Deep if expres

[jira] [Resolved] (SPARK-14745) CEP support in Spark Streaming

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14745. --- Resolution: Won't Fix > CEP support in Spark Streaming > -- > >

[jira] [Commented] (SPARK-14634) Add BisectingKMeansSummary

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604652#comment-15604652 ] Apache Spark commented on SPARK-14634: -- User 'zhengruifeng' has created a pull reque

[jira] [Resolved] (SPARK-14230) Config the start time (jitter) for streaming jobs

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14230. --- Resolution: Won't Fix > Config the start time (jitter) for streaming jobs > -

[jira] [Resolved] (SPARK-15429) When `spark.streaming.concurrentJobs > 1`, PIDRateEstimator cannot estimate the receiving rate accurately.

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15429. --- Resolution: Won't Fix > When `spark.streaming.concurrentJobs > 1`, PIDRateEstimator cannot estimate

[jira] [Resolved] (SPARK-18039) ReceiverTracker run dummyjob too fast cause receiver scheduling unbalaced

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18039. --- Resolution: Won't Fix > ReceiverTracker run dummyjob too fast cause receiver scheduling unbalaced > -

[jira] [Commented] (SPARK-18065) Spark 2 allows filter/where on columns not in current schema

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604777#comment-15604777 ] Sean Owen commented on SPARK-18065: --- It might be a little late, but if you find a good

[jira] [Resolved] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17987. --- Resolution: Not A Problem > ML Evaluator fails to handle null values in the dataset > ---

[jira] [Resolved] (SPARK-10319) ALS training using PySpark throws a StackOverflowError

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10319. --- Resolution: Cannot Reproduce > ALS training using PySpark throws a StackOverflowError > -

[jira] [Commented] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604794#comment-15604794 ] Sean Owen commented on SPARK-18068: --- It's documented in the API docs, as in: https://s

[jira] [Commented] (SPARK-17748) One-pass algorithm for linear regression with L1 and elastic-net penalties

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604805#comment-15604805 ] Apache Spark commented on SPARK-17748: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-18091) Deep if expressions cause Generated SpecificUnsafeProjection code to exceed JVM code size limit

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18091: Assignee: Apache Spark > Deep if expressions cause Generated SpecificUnsafeProjection code

[jira] [Assigned] (SPARK-18091) Deep if expressions cause Generated SpecificUnsafeProjection code to exceed JVM code size limit

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18091: Assignee: (was: Apache Spark) > Deep if expressions cause Generated SpecificUnsafeProj

[jira] [Commented] (SPARK-18091) Deep if expressions cause Generated SpecificUnsafeProjection code to exceed JVM code size limit

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604806#comment-15604806 ] Apache Spark commented on SPARK-18091: -- User 'kapilsingh5050' has created a pull req

[jira] [Commented] (SPARK-17959) spark.sql.join.preferSortMergeJoin has no effect for simple join due to calculated size of LogicalRdd

2016-10-25 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604810#comment-15604810 ] Stavros Kontopoulos commented on SPARK-17959: - [~srowen]What do you think? I

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604813#comment-15604813 ] Sean Owen commented on SPARK-18085: --- How does this relate to https://issues.apache.org/

[jira] [Comment Edited] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604437#comment-15604437 ] Hyukjin Kwon edited comment on SPARK-18068 at 10/25/16 9:48 AM: ---

[jira] [Updated] (SPARK-17959) spark.sql.join.preferSortMergeJoin has no effect for simple join due to calculated size of LogicalRdd

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17959: -- Issue Type: Improvement (was: Bug) Not sure, it's not my area. It may not be a bug though, but at best

[jira] [Commented] (SPARK-18068) Spark SQL doesn't parse some ISO 8601 formatted dates

2016-10-25 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604903#comment-15604903 ] Stephane Maarek commented on SPARK-18068: - Thanks for the links guys! Really help

[jira] [Resolved] (SPARK-17875) Remove unneeded direct dependence on Netty 3.x

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17875. --- Resolution: Later Target Version/s: (was: 2.1.0) Although I successfully removed the depe

[jira] [Commented] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-25 Thread Martha Solarte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605175#comment-15605175 ] Martha Solarte commented on SPARK-18009: Hi, I got the same error with spark 2.0

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Peng Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605211#comment-15605211 ] Peng Meng commented on SPARK-18088: --- Hi [~josephkb] , I am not quite understand "Testin

[jira] [Commented] (SPARK-16987) Add spark-default.conf property to define https port for spark history server

2016-10-25 Thread chie hayashida (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605225#comment-15605225 ] chie hayashida commented on SPARK-16987: Can I work on this issue? > Add spark-d

[jira] [Created] (SPARK-18092) add type cast to avoid error "Column prediction must be of type DoubleType but was actually FloatType"

2016-10-25 Thread albert fang (JIRA)
albert fang created SPARK-18092: --- Summary: add type cast to avoid error "Column prediction must be of type DoubleType but was actually FloatType" Key: SPARK-18092 URL: https://issues.apache.org/jira/browse/SPARK-180

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Peng Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605231#comment-15605231 ] Peng Meng commented on SPARK-18088: --- In the previous implementation, testing against o

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605239#comment-15605239 ] Sean Owen commented on SPARK-18088: --- [~josephkb] could we pause and discuss this? I'm n

[jira] [Assigned] (SPARK-18092) add type cast to avoid error "Column prediction must be of type DoubleType but was actually FloatType"

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18092: Assignee: Apache Spark > add type cast to avoid error "Column prediction must be of type D

[jira] [Commented] (SPARK-18092) add type cast to avoid error "Column prediction must be of type DoubleType but was actually FloatType"

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605261#comment-15605261 ] Apache Spark commented on SPARK-18092: -- User 'd2Code' has created a pull request for

[jira] [Assigned] (SPARK-18092) add type cast to avoid error "Column prediction must be of type DoubleType but was actually FloatType"

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18092: Assignee: (was: Apache Spark) > add type cast to avoid error "Column prediction must b

[jira] [Created] (SPARK-18093) Fix default value test in SQLConfSuite to work regardless of warehouse dir's existence

2016-10-25 Thread Mark Grover (JIRA)
Mark Grover created SPARK-18093: --- Summary: Fix default value test in SQLConfSuite to work regardless of warehouse dir's existence Key: SPARK-18093 URL: https://issues.apache.org/jira/browse/SPARK-18093

[jira] [Updated] (SPARK-18093) Fix default value test in SQLConfSuite to work regardless of warehouse dir's existence

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18093: -- Priority: Minor (was: Major) Hm, I thought it would definitely exist at that point in the test. It pas

[jira] [Assigned] (SPARK-18093) Fix default value test in SQLConfSuite to work regardless of warehouse dir's existence

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18093: Assignee: (was: Apache Spark) > Fix default value test in SQLConfSuite to work regardl

[jira] [Commented] (SPARK-18093) Fix default value test in SQLConfSuite to work regardless of warehouse dir's existence

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605355#comment-15605355 ] Apache Spark commented on SPARK-18093: -- User 'markgrover' has created a pull request

[jira] [Assigned] (SPARK-18093) Fix default value test in SQLConfSuite to work regardless of warehouse dir's existence

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18093: Assignee: Apache Spark > Fix default value test in SQLConfSuite to work regardless of ware

[jira] [Commented] (SPARK-18093) Fix default value test in SQLConfSuite to work regardless of warehouse dir's existence

2016-10-25 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605356#comment-15605356 ] Mark Grover commented on SPARK-18093: - Yeah, I thought so too - but it failed on two

[jira] [Updated] (SPARK-18093) Fix default value test in SQLConfSuite to work regardless of warehouse dir's existence

2016-10-25 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover updated SPARK-18093: Description: At least on my mac (with JDK 1.7.0_67), {{default value of WAREHOUSE_PATH}} in SQLCon

[jira] [Updated] (SPARK-15819) Add KMeanSummary in KMeans of PySpark

2016-10-25 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15819: Shepherd: Yanbo Liang Assignee: Jeff Zhang > Add KMeanSummary in KMeans of PySpark > --

[jira] [Created] (SPARK-18094) Move group analytics test cases from `SQLQuerySuite` into a query file test

2016-10-25 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-18094: Summary: Move group analytics test cases from `SQLQuerySuite` into a query file test Key: SPARK-18094 URL: https://issues.apache.org/jira/browse/SPARK-18094 Project:

[jira] [Commented] (SPARK-18094) Move group analytics test cases from `SQLQuerySuite` into a query file test

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605655#comment-15605655 ] Apache Spark commented on SPARK-18094: -- User 'jiangxb1987' has created a pull reques

[jira] [Assigned] (SPARK-18094) Move group analytics test cases from `SQLQuerySuite` into a query file test

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18094: Assignee: (was: Apache Spark) > Move group analytics test cases from `SQLQuerySuite` i

[jira] [Assigned] (SPARK-18094) Move group analytics test cases from `SQLQuerySuite` into a query file test

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18094: Assignee: Apache Spark > Move group analytics test cases from `SQLQuerySuite` into a query

[jira] [Created] (SPARK-18095) There is a display problem in spark UI storage tab when rdd was persisted in multiple replicas

2016-10-25 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-18095: -- Summary: There is a display problem in spark UI storage tab when rdd was persisted in multiple replicas Key: SPARK-18095 URL: https://issues.apache.org/jira/browse/SPARK-18095

[jira] [Created] (SPARK-18096) Spark on have - 'Update' save mode

2016-10-25 Thread David Hodeffi (JIRA)
David Hodeffi created SPARK-18096: - Summary: Spark on have - 'Update' save mode Key: SPARK-18096 URL: https://issues.apache.org/jira/browse/SPARK-18096 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-18095) There is a display problem in spark UI storage tab when rdd was persisted in multiple replicas

2016-10-25 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-18095: --- Description: There is a display problem in spark UI storage tab when rdd was persisted in multiple r

[jira] [Commented] (SPARK-18095) There is a display problem in spark UI storage tab when rdd was persisted in multiple replicas

2016-10-25 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605712#comment-15605712 ] Weichen Xu commented on SPARK-18095: I am working on it... > There is a display prob

[jira] [Commented] (SPARK-17748) One-pass algorithm for linear regression with L1 and elastic-net penalties

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605719#comment-15605719 ] Apache Spark commented on SPARK-17748: -- User 'yanboliang' has created a pull request

[jira] [Created] (SPARK-18097) Can't drop a table from Hive if the schema is corrupt

2016-10-25 Thread Davies Liu (JIRA)
Davies Liu created SPARK-18097: -- Summary: Can't drop a table from Hive if the schema is corrupt Key: SPARK-18097 URL: https://issues.apache.org/jira/browse/SPARK-18097 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-18095) There is a display problem in spark UI storage tab when rdd was persisted in multiple replicas

2016-10-25 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-18095: --- Comment: was deleted (was: I am working on it...) > There is a display problem in spark UI storage t

[jira] [Updated] (SPARK-18097) Can't drop a table from Hive if the schema is corrupt

2016-10-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-18097: --- Description: When the schema of Hive table is broken, we can't drop the table using Spark SQL, for e

[jira] [Updated] (SPARK-18097) Can't drop a table from Hive if the schema is corrupt

2016-10-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-18097: --- Description: When the schema of Hive table is broken, we can't drop the table using Spark SQL, for e

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

2016-10-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605815#comment-15605815 ] Marcelo Vanzin commented on SPARK-18085: It's mildly related. The changes here do

[jira] [Reopened] (SPARK-6951) History server slow startup if the event log directory is large

2016-10-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reopened SPARK-6951: --- > History server slow startup if the event log directory is large > --

[jira] [Commented] (SPARK-6951) History server slow startup if the event log directory is large

2016-10-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605820#comment-15605820 ] Marcelo Vanzin commented on SPARK-6951: --- I reopened this after discussion in the bug

[jira] [Created] (SPARK-18098) Broadcast creates 1 instance / core, not 1 instance / executor

2016-10-25 Thread Anthony Sciola (JIRA)
Anthony Sciola created SPARK-18098: -- Summary: Broadcast creates 1 instance / core, not 1 instance / executor Key: SPARK-18098 URL: https://issues.apache.org/jira/browse/SPARK-18098 Project: Spark

[jira] [Assigned] (SPARK-17829) Stable format for offset log

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17829: Assignee: Apache Spark (was: Tyson Condie) > Stable format for offset log > -

[jira] [Commented] (SPARK-17829) Stable format for offset log

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605879#comment-15605879 ] Apache Spark commented on SPARK-17829: -- User 'tcondie' has created a pull request fo

[jira] [Assigned] (SPARK-17829) Stable format for offset log

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17829: Assignee: Tyson Condie (was: Apache Spark) > Stable format for offset log > -

[jira] [Commented] (SPARK-18098) Broadcast creates 1 instance / core, not 1 instance / executor

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605898#comment-15605898 ] Sean Owen commented on SPARK-18098: --- It shouldn't work that way. The value is loaded in

[jira] [Resolved] (SPARK-18010) Remove unneeded heavy work performed by FsHistoryProvider for building up the application listing UI page

2016-10-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-18010. Resolution: Fixed Assignee: Vinayak Joshi Fix Version/s: 2.1.0 > Remove unn

[jira] [Updated] (SPARK-16183) Large Spark SQL commands cause StackOverflowError in parser when using sqlContext.sql

2016-10-25 Thread Matthew Porter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Porter updated SPARK-16183: --- Affects Version/s: 2.0.0 > Large Spark SQL commands cause StackOverflowError in parser when u

[jira] [Created] (SPARK-18099) Spark distributed cache should throw exception if same file is specified to dropped in --files --archives

2016-10-25 Thread Kishor Patil (JIRA)
Kishor Patil created SPARK-18099: Summary: Spark distributed cache should throw exception if same file is specified to dropped in --files --archives Key: SPARK-18099 URL: https://issues.apache.org/jira/browse/SPAR

[jira] [Commented] (SPARK-18099) Spark distributed cache should throw exception if same file is specified to dropped in --files --archives

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606068#comment-15606068 ] Apache Spark commented on SPARK-18099: -- User 'kishorvpatil' has created a pull reque

[jira] [Assigned] (SPARK-18099) Spark distributed cache should throw exception if same file is specified to dropped in --files --archives

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18099: Assignee: (was: Apache Spark) > Spark distributed cache should throw exception if same

[jira] [Assigned] (SPARK-18099) Spark distributed cache should throw exception if same file is specified to dropped in --files --archives

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18099: Assignee: Apache Spark > Spark distributed cache should throw exception if same file is sp

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606142#comment-15606142 ] Joseph K. Bradley commented on SPARK-18088: --- Ahh, you're right, sorry, I see th

[jira] [Updated] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18088: -- Description: There are several cleanups I'd like to make as a follow-up to the PRs from

[jira] [Updated] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18088: -- Issue Type: Improvement (was: Bug) > ChiSqSelector FPR PR cleanups > -

[jira] [Updated] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18088: -- Priority: Minor (was: Major) > ChiSqSelector FPR PR cleanups > ---

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606146#comment-15606146 ] Joseph K. Bradley commented on SPARK-18088: --- How do you feel about renaming the

[jira] [Commented] (SPARK-17692) Document ML/MLlib behavior changes in Spark 2.1

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606178#comment-15606178 ] Joseph K. Bradley commented on SPARK-17692: --- [SPARK-17870] changes the output o

[jira] [Resolved] (SPARK-18070) binary operator should not consider nullability when comparing input types

2016-10-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18070. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 Issue resolved by pull request 1

[jira] [Issue Comment Deleted] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18088: -- Comment: was deleted (was: Calling this a bug since FPR is not implemented correctly.)

[jira] [Created] (SPARK-18100) Improve the performance of get_json_object using Gson

2016-10-25 Thread Davies Liu (JIRA)
Davies Liu created SPARK-18100: -- Summary: Improve the performance of get_json_object using Gson Key: SPARK-18100 URL: https://issues.apache.org/jira/browse/SPARK-18100 Project: Spark Issue Type:

[jira] [Updated] (SPARK-18100) Improve the performance of get_json_object using Gson

2016-10-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-18100: --- Issue Type: Improvement (was: Bug) > Improve the performance of get_json_object using Gson > ---

[jira] [Resolved] (SPARK-18019) Log instrumentation in GBTs

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-18019. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15574 [h

[jira] [Commented] (SPARK-17471) Add compressed method for Matrix class

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606347#comment-15606347 ] Apache Spark commented on SPARK-17471: -- User 'sethah' has created a pull request for

[jira] [Assigned] (SPARK-17471) Add compressed method for Matrix class

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17471: Assignee: (was: Apache Spark) > Add compressed method for Matrix class > -

[jira] [Assigned] (SPARK-17471) Add compressed method for Matrix class

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17471: Assignee: Apache Spark > Add compressed method for Matrix class >

[jira] [Created] (SPARK-18101) ExternalCatalogSuite should test with mixed case fields

2016-10-25 Thread Eric Liang (JIRA)
Eric Liang created SPARK-18101: -- Summary: ExternalCatalogSuite should test with mixed case fields Key: SPARK-18101 URL: https://issues.apache.org/jira/browse/SPARK-18101 Project: Spark Issue Typ

[jira] [Updated] (SPARK-18101) ExternalCatalogSuite should test with mixed case fields

2016-10-25 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-18101: --- Issue Type: Sub-task (was: Test) Parent: SPARK-17861 > ExternalCatalogSuite should test with

[jira] [Created] (SPARK-18102) Failed to deserialize the result of task

2016-10-25 Thread Davies Liu (JIRA)
Davies Liu created SPARK-18102: -- Summary: Failed to deserialize the result of task Key: SPARK-18102 URL: https://issues.apache.org/jira/browse/SPARK-18102 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-18103) Rename *FileCatalog to *FileProvider

2016-10-25 Thread Eric Liang (JIRA)
Eric Liang created SPARK-18103: -- Summary: Rename *FileCatalog to *FileProvider Key: SPARK-18103 URL: https://issues.apache.org/jira/browse/SPARK-18103 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-18084) write.partitionBy() does not recognize nested columns that select() can access

2016-10-25 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606484#comment-15606484 ] Nicholas Chammas commented on SPARK-18084: -- cc [~marmbrus] - Dunno if this is ac

[jira] [Updated] (SPARK-18014) Filters are incorrectly being grouped together when there is processing in between

2016-10-25 Thread Michael Patterson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Patterson updated SPARK-18014: -- Environment: Pyspark 2.0.0, Ipython 4.2 (was: Pyspark 2.0.1, Ipython 4.2) > Filters ar

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

2016-10-25 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606523#comment-15606523 ] Alex Bozarth commented on SPARK-18085: -- I am *very* interested in working with you o

[jira] [Commented] (SPARK-15482) ClassCast exception when join two tables.

2016-10-25 Thread roberto sancho rojas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606601#comment-15606601 ] roberto sancho rojas commented on SPARK-15482: -- I have the same problem, whe

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Assignee: chie hayashida > spark history server log needs to be fixed to show https url when

[jira] [Resolved] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-16988. Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 > spark history serv

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Component/s: Spark Core > spark history server log needs to be fixed to show https url when s

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Component/s: (was: Spark Shell) > spark history server log needs to be fixed to show http

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Component/s: (was: Spark Core) Web UI > spark history server log needs t

[jira] [Updated] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18009: Target Version/s: 2.0.1, 2.1.0 > Spark 2.0.1 SQL Thrift Error > > >

[jira] [Updated] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18009: Labels: thrift (was: sql thrift) > Spark 2.0.1 SQL Thrift Error > > >

  1   2   >