[jira] [Assigned] (SPARK-13385) Enable AssociationRules to generate consequents with user-defined lengths

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13385: Assignee: Apache Spark > Enable AssociationRules to generate consequents with

[jira] [Commented] (SPARK-13385) Enable AssociationRules to generate consequents with user-defined lengths

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153870#comment-15153870 ] Apache Spark commented on SPARK-13385: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-13385) Enable AssociationRules to generate consequents with user-defined lengths

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13385: Assignee: (was: Apache Spark) > Enable AssociationRules to generate consequents with

[jira] [Updated] (SPARK-13385) Enable AssociationRules to generate consequents with user-defined lengths

2016-02-18 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-13385: - Attachment: rule-generation.pdf rule-generation algorithm > Enable AssociationRules to generate

[jira] [Assigned] (SPARK-13381) Support for loading CSV with a single function call

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13381: Assignee: (was: Apache Spark) > Support for loading CSV with a single function call >

[jira] [Commented] (SPARK-13381) Support for loading CSV with a single function call

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153860#comment-15153860 ] Apache Spark commented on SPARK-13381: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-13381) Support for loading CSV with a single function call

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13381: Assignee: Apache Spark > Support for loading CSV with a single function call >

[jira] [Created] (SPARK-13385) Enable AssociationRules to generate consequents with user-defined lengths

2016-02-18 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-13385: Summary: Enable AssociationRules to generate consequents with user-defined lengths Key: SPARK-13385 URL: https://issues.apache.org/jira/browse/SPARK-13385 Project:

[jira] [Assigned] (SPARK-13384) Keep attribute qualifiers after dedup in Analyzer

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13384: Assignee: (was: Apache Spark) > Keep attribute qualifiers after dedup in Analyzer >

[jira] [Commented] (SPARK-13384) Keep attribute qualifiers after dedup in Analyzer

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153793#comment-15153793 ] Apache Spark commented on SPARK-13384: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13384) Keep attribute qualifiers after dedup in Analyzer

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13384: Assignee: Apache Spark > Keep attribute qualifiers after dedup in Analyzer >

[jira] [Created] (SPARK-13384) Keep attribute qualifiers after dedup in Analyzer

2016-02-18 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-13384: --- Summary: Keep attribute qualifiers after dedup in Analyzer Key: SPARK-13384 URL: https://issues.apache.org/jira/browse/SPARK-13384 Project: Spark

[jira] [Assigned] (SPARK-13383) Keep broadcast hint after column pruning

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13383: Assignee: Apache Spark > Keep broadcast hint after column pruning >

[jira] [Assigned] (SPARK-13383) Keep broadcast hint after column pruning

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13383: Assignee: (was: Apache Spark) > Keep broadcast hint after column pruning >

[jira] [Commented] (SPARK-13383) Keep broadcast hint after column pruning

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153788#comment-15153788 ] Apache Spark commented on SPARK-13383: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-13383) Keep broadcast hint after column pruning

2016-02-18 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-13383: --- Summary: Keep broadcast hint after column pruning Key: SPARK-13383 URL: https://issues.apache.org/jira/browse/SPARK-13383 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-13380) Document Rand(seed) and Randn(seed) Return Indeterministic Results When Data Partitions are not fixed

2016-02-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13380. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > Document Rand(seed)

[jira] [Created] (SPARK-13382) Update PySpark testing notes

2016-02-18 Thread holdenk (JIRA)
holdenk created SPARK-13382: --- Summary: Update PySpark testing notes Key: SPARK-13382 URL: https://issues.apache.org/jira/browse/SPARK-13382 Project: Spark Issue Type: Documentation

[jira] [Assigned] (SPARK-13364) history server application column Id not sorting as number

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13364: Assignee: Apache Spark > history server application column Id not sorting as number >

[jira] [Commented] (SPARK-13364) history server application column Id not sorting as number

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153710#comment-15153710 ] Apache Spark commented on SPARK-13364: -- User 'zhuoliu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13364) history server application column Id not sorting as number

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13364: Assignee: (was: Apache Spark) > history server application column Id not sorting as

[jira] [Commented] (SPARK-13381) Support for loading CSV with a single function call

2016-02-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153695#comment-15153695 ] Hyukjin Kwon commented on SPARK-13381: -- [~rxin] I would like to work on this (since it would be

[jira] [Updated] (SPARK-13381) Support for loading CSV with a single function call

2016-02-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-13381: - Description: Just like {{json()}}, {{text()}}, {{orc()}} and {{parquet()}}, it would be great if

[jira] [Commented] (SPARK-13381) Support for loading CSV with a single function call

2016-02-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153698#comment-15153698 ] Reynold Xin commented on SPARK-13381: - Please go ahead! > Support for loading CSV with a single

[jira] [Commented] (SPARK-13381) Support for loading CSV with a single function call

2016-02-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153697#comment-15153697 ] Reynold Xin commented on SPARK-13381: - Please go ahead! > Support for loading CSV with a single

[jira] [Created] (SPARK-13381) Support for loading CSV with a single function call

2016-02-18 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-13381: Summary: Support for loading CSV with a single function call Key: SPARK-13381 URL: https://issues.apache.org/jira/browse/SPARK-13381 Project: Spark Issue

[jira] [Updated] (SPARK-13375) PySpark API Utils missing item: kFold

2016-02-18 Thread Bruno Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Wu updated SPARK-13375: - Target Version/s: 1.6.0 > PySpark API Utils missing item: kFold > -

[jira] [Commented] (SPARK-13375) PySpark API Utils missing item: kFold

2016-02-18 Thread Bruno Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153689#comment-15153689 ] Bruno Wu commented on SPARK-13375: -- Hi. This pull request does not have to do with kFold function. Could

[jira] [Assigned] (SPARK-13380) Document Rand(seed) and Randn(seed) Return Indeterministic Results When Data Partitions are not fixed

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13380: Assignee: Apache Spark > Document Rand(seed) and Randn(seed) Return Indeterministic

[jira] [Assigned] (SPARK-13380) Document Rand(seed) and Randn(seed) Return Indeterministic Results When Data Partitions are not fixed

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13380: Assignee: (was: Apache Spark) > Document Rand(seed) and Randn(seed) Return

[jira] [Commented] (SPARK-13380) Document Rand(seed) and Randn(seed) Return Indeterministic Results When Data Partitions are not fixed

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153687#comment-15153687 ] Apache Spark commented on SPARK-13380: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-13380) Document Rand(seed) and Randn(seed) Return Indeterministic Results When Data Partitions are not fixed

2016-02-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13380: --- Summary: Document Rand(seed) and Randn(seed) Return Indeterministic Results When Data Partitions are not fixed Key: SPARK-13380 URL: https://issues.apache.org/jira/browse/SPARK-13380

[jira] [Commented] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

2016-02-18 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153677#comment-15153677 ] Alex Bozarth commented on SPARK-13241: -- Ok, that makes sense, I've made parameter additions to

[jira] [Commented] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

2016-02-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153674#comment-15153674 ] Reynold Xin commented on SPARK-13241: - I think this API is versioned (v1) because we want to make

[jira] [Commented] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

2016-02-18 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153671#comment-15153671 ] Alex Bozarth commented on SPARK-13241: -- I'm still relatively new to this, but wouldn't we just need

[jira] [Assigned] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13379: Assignee: (was: Apache Spark) > MLlib LogisticRegressionWithLBFGS set regularization

[jira] [Commented] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153630#comment-15153630 ] Apache Spark commented on SPARK-13379: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13379: Assignee: Apache Spark > MLlib LogisticRegressionWithLBFGS set regularization incorrectly

[jira] [Created] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-18 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13379: --- Summary: MLlib LogisticRegressionWithLBFGS set regularization incorrectly Key: SPARK-13379 URL: https://issues.apache.org/jira/browse/SPARK-13379 Project: Spark

[jira] [Commented] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153587#comment-15153587 ] Apache Spark commented on SPARK-12746: -- User 'Earthson' has created a pull request for this issue:

[jira] [Commented] (SPARK-13359) ArrayType(_, true) should also accept ArrayType(_, false) fix for branch-1.6

2016-02-18 Thread Earthson Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153586#comment-15153586 ] Earthson Lu commented on SPARK-13359: - I see:) > ArrayType(_, true) should also accept ArrayType(_,

[jira] [Commented] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

2016-02-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153571#comment-15153571 ] Reynold Xin commented on SPARK-13241: - Won't this break the protocol? > add long--formatted

[jira] [Commented] (SPARK-8000) SQLContext.read.load() should be able to auto-detect input data

2016-02-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153570#comment-15153570 ] Hyukjin Kwon commented on SPARK-8000: - And I got an email from you which was {quote} Thanks for the

[jira] [Commented] (SPARK-8000) SQLContext.read.load() should be able to auto-detect input data

2016-02-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153568#comment-15153568 ] Hyukjin Kwon commented on SPARK-8000: - Actually I sent a email to dev mailing list. The contents was

[jira] [Commented] (SPARK-8000) SQLContext.read.load() should be able to auto-detect input data

2016-02-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153562#comment-15153562 ] Reynold Xin commented on SPARK-8000: I think we can do some simple things first. For example, if the

[jira] [Issue Comment Deleted] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

2016-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13054: -- Comment: was deleted (was: User 'andrewor14' has created a pull request for this issue:

[jira] [Commented] (SPARK-12729) phantom references to replace the finalize call in python broadcast

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153483#comment-15153483 ] Apache Spark commented on SPARK-12729: -- User 'GayathriMurali' has created a pull request for this

[jira] [Commented] (SPARK-13377) binaryFileRDD preferredLocations issue

2016-02-18 Thread Jey Kottalam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153426#comment-15153426 ] Jey Kottalam commented on SPARK-13377: -- Zhao and I looked into this this afternoon and believe this

[jira] [Created] (SPARK-13378) Add tee method to RDD

2016-02-18 Thread Richard Ding (JIRA)
Richard Ding created SPARK-13378: Summary: Add tee method to RDD Key: SPARK-13378 URL: https://issues.apache.org/jira/browse/SPARK-13378 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-13377) binaryFileRDD preferredLocations issue

2016-02-18 Thread Zhao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Zhang updated SPARK-13377: --- Description: I am using the sc.binaryFiles() interface to load a directory of small files into

[jira] [Updated] (SPARK-13377) binaryFileRDD preferredLocations issue

2016-02-18 Thread Zhao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Zhang updated SPARK-13377: --- Description: I am using the sc.binaryFiles() interface to load a directory of small files into

[jira] [Updated] (SPARK-13377) binaryFileRDD preferredLocations issue

2016-02-18 Thread Zhao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Zhang updated SPARK-13377: --- Description: I am using the sc.binaryFiles() interface to load a directory of small files into

[jira] [Updated] (SPARK-13377) binaryFileRDD preferredLocations issue

2016-02-18 Thread Zhao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Zhang updated SPARK-13377: --- Description: I am using the sc.binaryFiles() interface to load a directory of small files into

[jira] [Updated] (SPARK-13377) binaryFileRDD preferredLocations issue

2016-02-18 Thread Zhao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Zhang updated SPARK-13377: --- Description: I am using the sc.binaryFiles() interface to load a directory of small files into

[jira] [Updated] (SPARK-13377) binaryFileRDD preferredLocations issue

2016-02-18 Thread Zhao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Zhang updated SPARK-13377: --- Description: I am using the sc.binaryFiles() interface to load a directory of small files into

[jira] [Updated] (SPARK-13377) binaryFileRDD preferredLocations issue

2016-02-18 Thread Zhao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhao Zhang updated SPARK-13377: --- Description: I am using the sc.binaryFiles() interface to load a directory of small files into

[jira] [Created] (SPARK-13377) binaryFileRDD preferredLocations issue

2016-02-18 Thread Zhao Zhang (JIRA)
Zhao Zhang created SPARK-13377: -- Summary: binaryFileRDD preferredLocations issue Key: SPARK-13377 URL: https://issues.apache.org/jira/browse/SPARK-13377 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-13237) Generate broadcast outer join

2016-02-18 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13237. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11130

[jira] [Assigned] (SPARK-13376) Improve column pruning

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13376: Assignee: Apache Spark (was: Davies Liu) > Improve column pruning >

[jira] [Commented] (SPARK-13376) Improve column pruning

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153310#comment-15153310 ] Apache Spark commented on SPARK-13376: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13376) Improve column pruning

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13376: Assignee: Davies Liu (was: Apache Spark) > Improve column pruning >

[jira] [Created] (SPARK-13376) Improve column pruning

2016-02-18 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13376: -- Summary: Improve column pruning Key: SPARK-13376 URL: https://issues.apache.org/jira/browse/SPARK-13376 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-13364) history server application column Id not sorting as number

2016-02-18 Thread Zhuo Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhuo Liu updated SPARK-13364: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Summary: history server

[jira] [Resolved] (SPARK-13351) Column pruning fails on expand

2016-02-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13351. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11225

[jira] [Comment Edited] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

2016-02-18 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153040#comment-15153040 ] Alex Bozarth edited comment on SPARK-13241 at 2/18/16 8:38 PM: --- Looked into

[jira] [Commented] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

2016-02-18 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153040#comment-15153040 ] Alex Bozarth commented on SPARK-13241: -- Looked into this and I could update the api to include this,

[jira] [Assigned] (SPARK-12759) Spark should fail fast if --executor-memory is too small for spark to start

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12759: Assignee: Apache Spark > Spark should fail fast if --executor-memory is too small for

[jira] [Assigned] (SPARK-12759) Spark should fail fast if --executor-memory is too small for spark to start

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12759: Assignee: (was: Apache Spark) > Spark should fail fast if --executor-memory is too

[jira] [Commented] (SPARK-12759) Spark should fail fast if --executor-memory is too small for spark to start

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153020#comment-15153020 ] Apache Spark commented on SPARK-12759: -- User 'djalova' has created a pull request for this issue:

[jira] [Updated] (SPARK-13371) TaskSetManager.dequeueSpeculativeTask compares Option[String] and String directly.

2016-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13371: -- Assignee: Sean Owen > TaskSetManager.dequeueSpeculativeTask compares Option[String] and String >

[jira] [Resolved] (SPARK-13371) TaskSetManager.dequeueSpeculativeTask compares Option[String] and String directly.

2016-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13371. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 Target Version/s:

[jira] [Assigned] (SPARK-13375) PySpark API Utils missing item: kFold

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13375: Assignee: Apache Spark > PySpark API Utils missing item: kFold >

[jira] [Assigned] (SPARK-13375) PySpark API Utils missing item: kFold

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13375: Assignee: (was: Apache Spark) > PySpark API Utils missing item: kFold >

[jira] [Commented] (SPARK-13375) PySpark API Utils missing item: kFold

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152949#comment-15152949 ] Apache Spark commented on SPARK-13375: -- User 'davies' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-13046) Partitioning looks broken in 1.6

2016-02-18 Thread Julien Baley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152718#comment-15152718 ] Julien Baley edited comment on SPARK-13046 at 2/18/16 7:24 PM: --- Sorry it

[jira] [Created] (SPARK-13375) PySpark API Utils missing item: kFold

2016-02-18 Thread Bruno Wu (JIRA)
Bruno Wu created SPARK-13375: Summary: PySpark API Utils missing item: kFold Key: SPARK-13375 URL: https://issues.apache.org/jira/browse/SPARK-13375 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-13369) Number of consecutive fetch failures for a stage before the job is aborted should be configurable

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13369: Assignee: (was: Apache Spark) > Number of consecutive fetch failures for a stage

[jira] [Assigned] (SPARK-13369) Number of consecutive fetch failures for a stage before the job is aborted should be configurable

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13369: Assignee: Apache Spark > Number of consecutive fetch failures for a stage before the job

[jira] [Commented] (SPARK-13369) Number of consecutive fetch failures for a stage before the job is aborted should be configurable

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152823#comment-15152823 ] Apache Spark commented on SPARK-13369: -- User 'sitalkedia' has created a pull request for this issue:

[jira] [Commented] (SPARK-13046) Partitioning looks broken in 1.6

2016-02-18 Thread Julien Baley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152718#comment-15152718 ] Julien Baley commented on SPARK-13046: -- Sorry it took me so long to come back to you. We're using

[jira] [Commented] (SPARK-10722) Uncaught exception: RDDBlockId not found in driver-heartbeater

2016-02-18 Thread Vincent Primault (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152644#comment-15152644 ] Vincent Primault commented on SPARK-10722: -- Moreover, the problematic part is the following one:

[jira] [Commented] (SPARK-13369) Number of consecutive fetch failures for a stage before the job is aborted should be configurable

2016-02-18 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152626#comment-15152626 ] Sital Kedia commented on SPARK-13369: - [~srowen] This is definitely an issue for streaming jobs. But

[jira] [Assigned] (SPARK-13371) TaskSetManager.dequeueSpeculativeTask compares Option[String] and String directly.

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13371: Assignee: (was: Apache Spark) > TaskSetManager.dequeueSpeculativeTask compares

[jira] [Assigned] (SPARK-13371) TaskSetManager.dequeueSpeculativeTask compares Option[String] and String directly.

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13371: Assignee: Apache Spark > TaskSetManager.dequeueSpeculativeTask compares Option[String]

[jira] [Commented] (SPARK-13371) TaskSetManager.dequeueSpeculativeTask compares Option[String] and String directly.

2016-02-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152618#comment-15152618 ] Apache Spark commented on SPARK-13371: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-10722) Uncaught exception: RDDBlockId not found in driver-heartbeater

2016-02-18 Thread Vincent Primault (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152576#comment-15152576 ] Vincent Primault commented on SPARK-10722: -- Yes, I forgot to mention, I am running Spark 1.6.0.

[jira] [Commented] (SPARK-10722) Uncaught exception: RDDBlockId not found in driver-heartbeater

2016-02-18 Thread Jochen Mader (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152572#comment-15152572 ] Jochen Mader commented on SPARK-10722: -- Just out of curiosity: Are you running 1.6 or a different

[jira] [Commented] (SPARK-10722) Uncaught exception: RDDBlockId not found in driver-heartbeater

2016-02-18 Thread Vincent Primault (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152440#comment-15152440 ] Vincent Primault commented on SPARK-10722: -- I just ran into the same issue (although it was the

[jira] [Commented] (SPARK-13371) TaskSetManager.dequeueSpeculativeTask compares Option[String] and String directly.

2016-02-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152424#comment-15152424 ] Guoqiang Li commented on SPARK-13371: - [~srowen] Of course not. >

[jira] [Issue Comment Deleted] (SPARK-13371) TaskSetManager.dequeueSpeculativeTask compares Option[String] and String directly.

2016-02-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-13371: Comment: was deleted (was: [~srowen] Of course not.) > TaskSetManager.dequeueSpeculativeTask

[jira] [Commented] (SPARK-13371) TaskSetManager.dequeueSpeculativeTask compares Option[String] and String directly.

2016-02-18 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152425#comment-15152425 ] Guoqiang Li commented on SPARK-13371: - [~srowen] Of course not. >

[jira] [Reopened] (SPARK-2541) Standalone mode can't access secure HDFS anymore

2016-02-18 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reopened SPARK-2541: -- > Standalone mode can't access secure HDFS anymore >

[jira] [Commented] (SPARK-2541) Standalone mode can't access secure HDFS anymore

2016-02-18 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152357#comment-15152357 ] Thomas Graves commented on SPARK-2541: -- I'm fine with reopening this. Ideally we would officially

[jira] [Commented] (SPARK-3650) Triangle Count handles reverse edges incorrectly

2016-02-18 Thread Robin East (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152327#comment-15152327 ] Robin East commented on SPARK-3650: --- I did ask if the PR could be revived but never followed up on it.

[jira] [Updated] (SPARK-13356) WebUI missing input informations when recovering from dirver failure

2016-02-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13356: -- Affects Version/s: (was: 1.5.1) (was: 1.5.0) Priority:

[jira] [Updated] (SPARK-13369) Number of consecutive fetch failures for a stage before the job is aborted should be configurable

2016-02-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13369: -- Component/s: Spark Core > Number of consecutive fetch failures for a stage before the job is aborted

[jira] [Updated] (SPARK-13342) Cannot run INSERT statements in Spark

2016-02-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13342: -- Priority: Major (was: Critical) Component/s: SQL > Cannot run INSERT statements in Spark >

[jira] [Updated] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

2016-02-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13341: -- Component/s: SQL > Casting Unix timestamp to SQL timestamp fails >

[jira] [Resolved] (SPARK-13359) ArrayType(_, true) should also accept ArrayType(_, false) fix for branch-1.6

2016-02-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13359. --- Resolution: Duplicate Fix Version/s: (was: 1.6.1) Target Version/s: (was:

[jira] [Resolved] (SPARK-13349) adding a split and union to a streaming application cause big performance hit

2016-02-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13349. --- Resolution: Invalid Fix Version/s: (was: 1.4.2) Questions go to user@ > adding a split

  1   2   >