[jira] [Assigned] (SPARK-12937) Bloom filter serialization

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12937: Assignee: Apache Spark (was: Wenchen Fan) > Bloom filter serialization >

[jira] [Commented] (SPARK-12937) Bloom filter serialization

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116855#comment-15116855 ] Apache Spark commented on SPARK-12937: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-12937) Bloom filter serialization

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12937: Assignee: Wenchen Fan (was: Apache Spark) > Bloom filter serialization >

[jira] [Updated] (SPARK-12993) Remove usage of ADD_FILES in pyspark

2016-01-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-12993: --- Description: environment variable ADD_FILES is created for adding python files to spark context (SPAR

[jira] [Commented] (SPARK-12977) Factoring out StreamingListener and UI to support history UI

2016-01-25 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116844#comment-15116844 ] Saisai Shao commented on SPARK-12977: - Attach the current working progress, still som

[jira] [Updated] (SPARK-12977) Factoring out StreamingListener and UI to support history UI

2016-01-25 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-12977: Attachment: screenshot-1.png > Factoring out StreamingListener and UI to support history UI > -

[jira] [Closed] (SPARK-12702) Populate statistics for DataFrame when reading CSV

2016-01-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12702. --- Resolution: Duplicate Closing this because it is just part of SPARK-12996. > Populate statistics fo

[jira] [Closed] (SPARK-12670) Use spark internal utilities wherever possible

2016-01-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12670. --- Resolution: Won't Fix Going to close this one since it is a little bit too broad. > Use spark inter

[jira] [Updated] (SPARK-12834) Use type conversion instead of Ser/De of Pickle to transform JavaArray and JavaList

2016-01-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12834: -- Assignee: Xusen Yin > Use type conversion instead of Ser/De of Pickle to transform Java

[jira] [Resolved] (SPARK-12834) Use type conversion instead of Ser/De of Pickle to transform JavaArray and JavaList

2016-01-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12834. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10772 [h

[jira] [Created] (SPARK-12997) Use cast expression to perform type cast in csv

2016-01-25 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12997: --- Summary: Use cast expression to perform type cast in csv Key: SPARK-12997 URL: https://issues.apache.org/jira/browse/SPARK-12997 Project: Spark Issue Type: Sub

[jira] [Resolved] (SPARK-11922) Python API for ml.feature.QuantileDiscretizer

2016-01-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11922. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10085 [h

[jira] [Updated] (SPARK-12995) Remove deprecate APIs from Pregel

2016-01-25 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-12995: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-11806 > Remove deprecate A

[jira] [Created] (SPARK-12996) CSVRelation should be based on HadoopFsRelation

2016-01-25 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12996: --- Summary: CSVRelation should be based on HadoopFsRelation Key: SPARK-12996 URL: https://issues.apache.org/jira/browse/SPARK-12996 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-12996) CSVRelation should be based on HadoopFsRelation

2016-01-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116774#comment-15116774 ] Reynold Xin commented on SPARK-12996: - cc [~hyukjin.kwon] would you be interested in

[jira] [Assigned] (SPARK-12995) Remove deprecate APIs from Pregel

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12995: Assignee: (was: Apache Spark) > Remove deprecate APIs from Pregel > --

[jira] [Assigned] (SPARK-12995) Remove deprecate APIs from Pregel

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12995: Assignee: Apache Spark > Remove deprecate APIs from Pregel > -

[jira] [Commented] (SPARK-12995) Remove deprecate APIs from Pregel

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116773#comment-15116773 ] Apache Spark commented on SPARK-12995: -- User 'maropu' has created a pull request for

[jira] [Created] (SPARK-12995) Remove deprecate APIs from Pregel

2016-01-25 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-12995: Summary: Remove deprecate APIs from Pregel Key: SPARK-12995 URL: https://issues.apache.org/jira/browse/SPARK-12995 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-12888) benchmark the new hash expression

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116747#comment-15116747 ] Apache Spark commented on SPARK-12888: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-12968) Implement command to set current database

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116735#comment-15116735 ] Apache Spark commented on SPARK-12968: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-12968) Implement command to set current database

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12968: Assignee: (was: Apache Spark) > Implement command to set current database > --

[jira] [Assigned] (SPARK-12968) Implement command to set current database

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12968: Assignee: Apache Spark > Implement command to set current database > -

[jira] [Commented] (SPARK-11780) Provide type aliases in org.apache.spark.sql.types for backwards compatibility

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116724#comment-15116724 ] Apache Spark commented on SPARK-11780: -- User 'maropu' has created a pull request for

[jira] [Assigned] (SPARK-12994) It is not necessary to create ExecutorAllocationManager in local mode

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12994: Assignee: Apache Spark > It is not necessary to create ExecutorAllocationManager in local

[jira] [Commented] (SPARK-12994) It is not necessary to create ExecutorAllocationManager in local mode

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116693#comment-15116693 ] Apache Spark commented on SPARK-12994: -- User 'zjffdu' has created a pull request for

[jira] [Assigned] (SPARK-12994) It is not necessary to create ExecutorAllocationManager in local mode

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12994: Assignee: (was: Apache Spark) > It is not necessary to create ExecutorAllocationManage

[jira] [Created] (SPARK-12994) It is not necessary to create ExecutorAllocationManager in local mode

2016-01-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-12994: -- Summary: It is not necessary to create ExecutorAllocationManager in local mode Key: SPARK-12994 URL: https://issues.apache.org/jira/browse/SPARK-12994 Project: Spark

[jira] [Assigned] (SPARK-12993) Remove usage of ADD_FILES in pyspark

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12993: Assignee: Apache Spark > Remove usage of ADD_FILES in pyspark > --

[jira] [Assigned] (SPARK-12993) Remove usage of ADD_FILES in pyspark

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12993: Assignee: (was: Apache Spark) > Remove usage of ADD_FILES in pyspark > ---

[jira] [Commented] (SPARK-12993) Remove usage of ADD_FILES in pyspark

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116647#comment-15116647 ] Apache Spark commented on SPARK-12993: -- User 'zjffdu' has created a pull request for

[jira] [Commented] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

2016-01-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116645#comment-15116645 ] Felix Cheung commented on SPARK-12984: -- You should specify 'source' - otherwise it d

[jira] [Created] (SPARK-12993) Remove usage of ADD_FILES in pyspark

2016-01-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-12993: -- Summary: Remove usage of ADD_FILES in pyspark Key: SPARK-12993 URL: https://issues.apache.org/jira/browse/SPARK-12993 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-12987) Drop fails when columns contain dots

2016-01-25 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116589#comment-15116589 ] Thomas Sebastian commented on SPARK-12987: -- I am able to replicate the issue. Lo

[jira] [Issue Comment Deleted] (SPARK-12941) Spark-SQL JDBC Oracle dialect fails to map string datatypes to Oracle VARCHAR datatype

2016-01-25 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Sebastian updated SPARK-12941: - Comment: was deleted (was: Added a pull request https://github.com/thomastechs/spark/pull

[jira] [Commented] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

2016-01-25 Thread Jack Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116545#comment-15116545 ] Jack Hu commented on SPARK-6847: Hi [~zsxwing] Even user does not implicit do checkpoint

[jira] [Assigned] (SPARK-12941) Spark-SQL JDBC Oracle dialect fails to map string datatypes to Oracle VARCHAR datatype

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12941: Assignee: Apache Spark > Spark-SQL JDBC Oracle dialect fails to map string datatypes to Or

[jira] [Assigned] (SPARK-12941) Spark-SQL JDBC Oracle dialect fails to map string datatypes to Oracle VARCHAR datatype

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12941: Assignee: (was: Apache Spark) > Spark-SQL JDBC Oracle dialect fails to map string data

[jira] [Commented] (SPARK-12941) Spark-SQL JDBC Oracle dialect fails to map string datatypes to Oracle VARCHAR datatype

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116543#comment-15116543 ] Apache Spark commented on SPARK-12941: -- User 'thomastechs' has created a pull reques

[jira] [Commented] (SPARK-11560) Optimize KMeans implementation

2016-01-25 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116519#comment-15116519 ] yuhao yang commented on SPARK-11560: Will the new version support sparse data better,

[jira] [Commented] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

2016-01-25 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116515#comment-15116515 ] Sun Rui commented on SPARK-12984: - Could you follow the instructions at https://github.c

[jira] [Updated] (SPARK-11922) Python API for ml.feature.QuantileDiscretizer

2016-01-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11922: -- Shepherd: Joseph K. Bradley Target Version/s: 2.0.0 > Python API for ml.fe

[jira] [Resolved] (SPARK-12936) Initial bloom filter implementation

2016-01-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12936. - Resolution: Fixed Fix Version/s: 2.0.0 > Initial bloom filter implementation > ---

[jira] [Commented] (SPARK-12260) Graceful Shutdown with In-Memory State

2016-01-25 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116487#comment-15116487 ] Zhichao Zhang commented on SPARK-12260: [~srowen], thanks for your reply. Are th

[jira] [Commented] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2016-01-25 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116478#comment-15116478 ] Eron Wright commented on SPARK-4940: - Another benefit of maximizing the # of allocate

[jira] [Commented] (SPARK-12958) Map accumulator in spark

2016-01-25 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116461#comment-15116461 ] Jakob Odersky commented on SPARK-12958: --- I agree that it's very specific, maybe it

[jira] [Assigned] (SPARK-12935) Count-min sketch DataFrame API integration

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12935: Assignee: Cheng Lian (was: Apache Spark) > Count-min sketch DataFrame API integration > -

[jira] [Commented] (SPARK-12935) Count-min sketch DataFrame API integration

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116452#comment-15116452 ] Apache Spark commented on SPARK-12935: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-12935) Count-min sketch DataFrame API integration

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12935: Assignee: Apache Spark (was: Cheng Lian) > Count-min sketch DataFrame API integration > -

[jira] [Commented] (SPARK-10086) Flaky StreamingKMeans test in PySpark

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116422#comment-15116422 ] Apache Spark commented on SPARK-10086: -- User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-8171) Support Javascript-based infinite scrolling in Spark log viewers

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8171: --- Assignee: Apache Spark > Support Javascript-based infinite scrolling in Spark log viewers > -

[jira] [Commented] (SPARK-8171) Support Javascript-based infinite scrolling in Spark log viewers

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116420#comment-15116420 ] Apache Spark commented on SPARK-8171: - User 'ajbozarth' has created a pull request for

[jira] [Assigned] (SPARK-8171) Support Javascript-based infinite scrolling in Spark log viewers

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8171: --- Assignee: (was: Apache Spark) > Support Javascript-based infinite scrolling in Spark log

[jira] [Commented] (SPARK-12990) Fatal warnings on @transient parameters (Scala 2.11)

2016-01-25 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116409#comment-15116409 ] Jakob Odersky commented on SPARK-12990: --- marking as critical since it breaks the bu

[jira] [Updated] (SPARK-12990) Fatal warnings on @transient parameters (Scala 2.11)

2016-01-25 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Odersky updated SPARK-12990: -- Priority: Critical (was: Major) > Fatal warnings on @transient parameters (Scala 2.11) > -

[jira] [Commented] (SPARK-10086) Flaky StreamingKMeans test in PySpark

2016-01-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116391#comment-15116391 ] Xiangrui Meng commented on SPARK-10086: --- Saw more failures recently and changed the

[jira] [Commented] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

2016-01-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116390#comment-15116390 ] Shixiong Zhu commented on SPARK-12695: -- I just wrote a simple test here: https://git

[jira] [Updated] (SPARK-10086) Flaky StreamingKMeans test in PySpark

2016-01-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10086: -- Priority: Critical (was: Major) > Flaky StreamingKMeans test in PySpark >

[jira] [Commented] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116384#comment-15116384 ] Apache Spark commented on SPARK-12992: -- User 'nongli' has created a pull request for

[jira] [Assigned] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12992: Assignee: (was: Apache Spark) > Vectorize parquet decoding using ColumnarBatch > -

[jira] [Assigned] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12992: Assignee: Apache Spark > Vectorize parquet decoding using ColumnarBatch >

[jira] [Assigned] (SPARK-12958) Map accumulator in spark

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12958: Assignee: Apache Spark > Map accumulator in spark > > >

[jira] [Commented] (SPARK-12958) Map accumulator in spark

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116364#comment-15116364 ] Apache Spark commented on SPARK-12958: -- User 'sourind' has created a pull request fo

[jira] [Resolved] (SPARK-12879) improve unsafe row writing framework

2016-01-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12879. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10809 [https://github.

[jira] [Assigned] (SPARK-12958) Map accumulator in spark

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12958: Assignee: (was: Apache Spark) > Map accumulator in spark > >

[jira] [Created] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

2016-01-25 Thread Nong Li (JIRA)
Nong Li created SPARK-12992: --- Summary: Vectorize parquet decoding using ColumnarBatch Key: SPARK-12992 URL: https://issues.apache.org/jira/browse/SPARK-12992 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2016-01-25 Thread Emlyn Corrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116329#comment-15116329 ] Emlyn Corrin commented on SPARK-9740: - Version 1.6.0 > first/last aggregate NULL beha

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2016-01-25 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116317#comment-15116317 ] Herman van Hovell commented on SPARK-9740: -- [~emlyn] What version of Spark are yo

[jira] [Created] (SPARK-12991) Establish correspondence between SparkPlan and LogicalPlan nodes

2016-01-25 Thread Mikhail Bautin (JIRA)
Mikhail Bautin created SPARK-12991: -- Summary: Establish correspondence between SparkPlan and LogicalPlan nodes Key: SPARK-12991 URL: https://issues.apache.org/jira/browse/SPARK-12991 Project: Spark

[jira] [Closed] (SPARK-12651) mllib deprecation messages mention non-existent version 1.7.0

2016-01-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-12651. - Resolution: Duplicate > mllib deprecation messages mention non-existent version 1.7.0 > -

[jira] [Reopened] (SPARK-12651) mllib deprecation messages mention non-existent version 1.7.0

2016-01-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reopened SPARK-12651: --- > mllib deprecation messages mention non-existent version 1.7.0 > ---

[jira] [Commented] (SPARK-12934) Count-min sketch serialization

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116308#comment-15116308 ] Apache Spark commented on SPARK-12934: -- User 'tedyu' has created a pull request for

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2016-01-25 Thread Emlyn Corrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116297#comment-15116297 ] Emlyn Corrin commented on SPARK-9740: - Here's the stack trace, it fails during compila

[jira] [Commented] (SPARK-12944) CrossValidator doesn't accept a Pipeline as an estimator

2016-01-25 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116286#comment-15116286 ] Seth Hendrickson commented on SPARK-12944: -- This issue was partly addressed by

[jira] [Assigned] (SPARK-12866) Migrate the ExtendedHiveQlParser to the new parser

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12866: Assignee: Apache Spark > Migrate the ExtendedHiveQlParser to the new parser >

[jira] [Commented] (SPARK-12866) Migrate the ExtendedHiveQlParser to the new parser

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116283#comment-15116283 ] Apache Spark commented on SPARK-12866: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-12865) Migrate the SparkSQLParser to the new parser

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12865: Assignee: Apache Spark > Migrate the SparkSQLParser to the new parser > --

[jira] [Assigned] (SPARK-12866) Migrate the ExtendedHiveQlParser to the new parser

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12866: Assignee: (was: Apache Spark) > Migrate the ExtendedHiveQlParser to the new parser > -

[jira] [Commented] (SPARK-12865) Migrate the SparkSQLParser to the new parser

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116282#comment-15116282 ] Apache Spark commented on SPARK-12865: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-12865) Migrate the SparkSQLParser to the new parser

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12865: Assignee: (was: Apache Spark) > Migrate the SparkSQLParser to the new parser > ---

[jira] [Commented] (SPARK-12896) Send only accumulator updates, not TaskMetrics, to the driver

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116265#comment-15116265 ] Apache Spark commented on SPARK-12896: -- User 'andrewor14' has created a pull request

[jira] [Updated] (SPARK-10086) Flaky StreamingKMeans test in PySpark

2016-01-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10086: -- Target Version/s: 2.0.0 > Flaky StreamingKMeans test in PySpark > -

[jira] [Resolved] (SPARK-12934) Count-min sketch serialization

2016-01-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12934. - Resolution: Fixed Fix Version/s: 2.0.0 > Count-min sketch serialization >

[jira] [Assigned] (SPARK-12990) Fatal warnings on @transient parameters (Scala 2.11)

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12990: Assignee: (was: Apache Spark) > Fatal warnings on @transient parameters (Scala 2.11) >

[jira] [Commented] (SPARK-12990) Fatal warnings on @transient parameters (Scala 2.11)

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116221#comment-15116221 ] Apache Spark commented on SPARK-12990: -- User 'jodersky' has created a pull request f

[jira] [Assigned] (SPARK-12990) Fatal warnings on @transient parameters (Scala 2.11)

2016-01-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12990: Assignee: Apache Spark > Fatal warnings on @transient parameters (Scala 2.11) > --

[jira] [Commented] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

2016-01-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116216#comment-15116216 ] Shixiong Zhu commented on SPARK-12695: -- Did you use Python 2 or Python 3? > java.l

[jira] [Created] (SPARK-12990) Fatal warnings on @transient parameters (Scala 2.11)

2016-01-25 Thread Jakob Odersky (JIRA)
Jakob Odersky created SPARK-12990: - Summary: Fatal warnings on @transient parameters (Scala 2.11) Key: SPARK-12990 URL: https://issues.apache.org/jira/browse/SPARK-12990 Project: Spark Issue

[jira] [Commented] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

2016-01-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116160#comment-15116160 ] Shixiong Zhu commented on SPARK-12945: -- Could you share the parquet file, or do you

[jira] [Resolved] (SPARK-12946) The SQL page is empty

2016-01-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12946. -- Resolution: Duplicate > The SQL page is empty > - > > Key:

[jira] [Commented] (SPARK-12986) Fix pydoc warnings in mllib/regression.py

2016-01-25 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116153#comment-15116153 ] Bryan Cutler commented on SPARK-12986: -- It looks like this is caused by an indented

[jira] [Updated] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12905: -- Target Version/s: 2.0.0 > PCAModel return eigenvalues for PySpark > ---

[jira] [Updated] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12905: -- Assignee: Yanbo Liang > PCAModel return eigenvalues for PySpark > -

[jira] [Resolved] (SPARK-12905) PCAModel return eigenvalues for PySpark

2016-01-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12905. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10830 [https://g

[jira] [Created] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

2016-01-25 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-12989: Summary: Bad interaction between StarExpansion and ExtractWindowExpressions Key: SPARK-12989 URL: https://issues.apache.org/jira/browse/SPARK-12989 Project: S

[jira] [Commented] (SPARK-12831) akka.remote.OversizedPayloadException on DirectTaskResult

2016-01-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116142#comment-15116142 ] Shixiong Zhu commented on SPARK-12831: -- Spark 1.6 doesn't enable Akka by default. >

[jira] [Resolved] (SPARK-12831) akka.remote.OversizedPayloadException on DirectTaskResult

2016-01-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12831. -- Resolution: Won't Fix Spark 2.0 doesn't use Akka any more. > akka.remote.OversizedPayloadExcep

[jira] [Resolved] (SPARK-12975) Throwing Exception when Bucketing Columns are part of Partitioning Columns

2016-01-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12975. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10891 [htt

[jira] [Updated] (SPARK-12975) Throwing Exception when Bucketing Columns are part of Partitioning Columns

2016-01-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12975: - Assignee: Xiao Li > Throwing Exception when Bucketing Columns are part of Partitioning Co

[jira] [Commented] (SPARK-12986) Fix pydoc warnings in mllib/regression.py

2016-01-25 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116085#comment-15116085 ] holdenk commented on SPARK-12986: - Do you think we should maybe add make html to the lint

  1   2   3   >