[jira] [Comment Edited] (SPARK-13183) Bytebuffers occupy a large amount of heap memory

2016-02-16 Thread dylanzhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148205#comment-15148205 ] dylanzhou edited comment on SPARK-13183 at 2/16/16 8:36 AM: @Sean Owen maybe

[jira] [Commented] (SPARK-13331) Spark network encryption optimization

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148314#comment-15148314 ] Sean Owen commented on SPARK-13331: --- This sounds like a duplicate of SPARK-10771. You should provide

[jira] [Commented] (SPARK-13311) prettyString of IN is not good

2016-02-16 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148318#comment-15148318 ] Jayadevan M commented on SPARK-13311: - [~davies] I would like to work on this issue. Could you tell

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2016-02-16 Thread Sateesh Babu G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148342#comment-15148342 ] Sateesh Babu G commented on SPARK-9273: --- Hi All, Is there any CNN implementation for SPARK?

[jira] [Assigned] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10969: Assignee: (was: Apache Spark) > Spark Streaming Kinesis: Allow specifying separate

[jira] [Commented] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148365#comment-15148365 ] Apache Spark commented on SPARK-10969: -- User 'kaklakariada' has created a pull request for this

[jira] [Assigned] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10969: Assignee: Apache Spark > Spark Streaming Kinesis: Allow specifying separate credentials

[jira] [Commented] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2016-02-16 Thread Christoph Pirkl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148366#comment-15148366 ] Christoph Pirkl commented on SPARK-10969: - I created PR

[jira] [Updated] (SPARK-13221) GroupingSets Returns an Incorrect Results

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13221: -- Assignee: Xiao Li > GroupingSets Returns an Incorrect Results >

[jira] [Updated] (SPARK-13317) SPARK_LOCAL_IP does not bind to public IP on Slaves

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13317: -- Priority: Minor (was: Major) Component/s: EC2 Deploy Summary:

[jira] [Resolved] (SPARK-12921) Use SparkHadoopUtil reflection to access TaskAttemptContext in SpecificParquetRecordReaderBase

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12921. --- Resolution: Fixed > Use SparkHadoopUtil reflection to access TaskAttemptContext in >

[jira] [Updated] (SPARK-13331) Spark network encryption optimization

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13331: -- Priority: Minor (was: Major) Component/s: Deploy > Spark network encryption optimization >

[jira] [Resolved] (SPARK-2369) Enable Spark SQL UDF to influence at runtime the decision to read a partition

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2369. -- Resolution: Won't Fix > Enable Spark SQL UDF to influence at runtime the decision to read a partition >

[jira] [Resolved] (SPARK-4224) Support group acls

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4224. -- Resolution: Won't Fix > Support group acls > -- > > Key: SPARK-4224 >

[jira] [Resolved] (SPARK-4474) Improve handling of jars that cannot be included in the uber jar

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4474. -- Resolution: Won't Fix > Improve handling of jars that cannot be included in the uber jar >

[jira] [Resolved] (SPARK-4528) [SQL] add comment support for Spark SQL CLI

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4528. -- Resolution: Won't Fix > [SQL] add comment support for Spark SQL CLI >

[jira] [Resolved] (SPARK-5008) Persistent HDFS does not recognize EBS Volumes

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5008. -- Resolution: Won't Fix > Persistent HDFS does not recognize EBS Volumes >

[jira] [Resolved] (SPARK-5103) Add Functionality to Pass Config Options to KeyConverter and ValueConverter in PySpark

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5103. -- Resolution: Won't Fix > Add Functionality to Pass Config Options to KeyConverter and ValueConverter >

[jira] [Resolved] (SPARK-5318) Add ability to control partition count in SparkSql

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5318. -- Resolution: Won't Fix > Add ability to control partition count in SparkSql >

[jira] [Resolved] (SPARK-4776) Spark IO Messages are difficult to Debug

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4776. -- Resolution: Won't Fix > Spark IO Messages are difficult to Debug >

[jira] [Resolved] (SPARK-5024) Provide duration summary by job group ID

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5024. -- Resolution: Won't Fix > Provide duration summary by job group ID >

[jira] [Resolved] (SPARK-2421) Spark should treat writable as serializable for keys

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2421. -- Resolution: Won't Fix > Spark should treat writable as serializable for keys >

[jira] [Resolved] (SPARK-5590) Create a complete reference of configurable environment variables, config files and command-line parameters

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5590. -- Resolution: Won't Fix > Create a complete reference of configurable environment variables, config >

[jira] [Resolved] (SPARK-5377) Dynamically add jar into Spark Driver's classpath.

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5377. -- Resolution: Won't Fix > Dynamically add jar into Spark Driver's classpath. >

[jira] [Resolved] (SPARK-6002) MLLIB should support the RandomIndexing transform

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6002. -- Resolution: Won't Fix > MLLIB should support the RandomIndexing transform >

[jira] [Resolved] (SPARK-5855) [Spark SQL] 'explain' command in SparkSQL don't support to analyze the DDL 'VIEW'

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5855. -- Resolution: Won't Fix > [Spark SQL] 'explain' command in SparkSQL don't support to analyze the DDL >

[jira] [Created] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

2016-02-16 Thread Zhong Wang (JIRA)
Zhong Wang created SPARK-13337: -- Summary: DataFrame join-on-columns function should support null-safe equal Key: SPARK-13337 URL: https://issues.apache.org/jira/browse/SPARK-13337 Project: Spark

[jira] [Updated] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

2016-02-16 Thread Zhong Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhong Wang updated SPARK-13337: --- Description: Currently, the join-on-columns function: {code} def join(right: DataFrame,

[jira] [Updated] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13337: -- Component/s: SQL > DataFrame join-on-columns function should support null-safe equal >

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2016-02-16 Thread Emlyn Corrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148458#comment-15148458 ] Emlyn Corrin commented on SPARK-9740: - Any update on this? Should I open a new issue for it so it

[jira] [Resolved] (SPARK-6622) Spark SQL cannot communicate with Hive meta store

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6622. -- Resolution: Not A Problem This just looks like you're missing a MySQL driver. It doesn't look

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2016-02-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148463#comment-15148463 ] Herman van Hovell commented on SPARK-9740: -- [~emlyn] We have merged a patch for this, see:

Scanned image from cop...@spark.apache.org

2016-02-16 Thread copier@
Reply to: cop...@spark.apache.org Device Name: COPIER Device Model: MX-2310U File Format: XLS (Medium) Resolution: 200dpi x 200dpi Attached file is scanned document in XLS format. Use Microsoft(R)Excel(R) of Microsoft Systems Incorporated to view the document.

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2016-02-16 Thread Emlyn Corrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148472#comment-15148472 ] Emlyn Corrin commented on SPARK-9740: - Thanks, the {{registerTempTable}} + {{sql}} workaround is fine

[jira] [Created] (SPARK-13338) [ML] Allow setting 'degree' parameter to 1 for PolynomialExpansion

2016-02-16 Thread Grzegorz Chilkiewicz (JIRA)
Grzegorz Chilkiewicz created SPARK-13338: Summary: [ML] Allow setting 'degree' parameter to 1 for PolynomialExpansion Key: SPARK-13338 URL: https://issues.apache.org/jira/browse/SPARK-13338

[jira] [Assigned] (SPARK-13338) [ML] Allow setting 'degree' parameter to 1 for PolynomialExpansion

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13338: Assignee: Apache Spark > [ML] Allow setting 'degree' parameter to 1 for

[jira] [Commented] (SPARK-13338) [ML] Allow setting 'degree' parameter to 1 for PolynomialExpansion

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148525#comment-15148525 ] Apache Spark commented on SPARK-13338: -- User 'grzegorz-chilkiewicz' has created a pull request for

[jira] [Assigned] (SPARK-13338) [ML] Allow setting 'degree' parameter to 1 for PolynomialExpansion

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13338: Assignee: (was: Apache Spark) > [ML] Allow setting 'degree' parameter to 1 for

[jira] [Resolved] (SPARK-12247) Documentation for spark.ml's ALS and collaborative filtering in general

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12247. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10411

[jira] [Resolved] (SPARK-12714) Transforming Dataset with sequences of case classes to RDD causes Task Not Serializable exception

2016-02-16 Thread James Eastwood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Eastwood resolved SPARK-12714. Resolution: Fixed [~marmbrus] Sorry for taking an age to get back to you -- I've tested

[jira] [Created] (SPARK-13339) Clarify commutative / associative operator requirements for reduce, fold

2016-02-16 Thread Sean Owen (JIRA)
Sean Owen created SPARK-13339: - Summary: Clarify commutative / associative operator requirements for reduce, fold Key: SPARK-13339 URL: https://issues.apache.org/jira/browse/SPARK-13339 Project: Spark

[jira] [Assigned] (SPARK-13339) Clarify commutative / associative operator requirements for reduce, fold

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13339: Assignee: Sean Owen (was: Apache Spark) > Clarify commutative / associative operator

[jira] [Commented] (SPARK-13339) Clarify commutative / associative operator requirements for reduce, fold

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148595#comment-15148595 ] Apache Spark commented on SPARK-13339: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13339) Clarify commutative / associative operator requirements for reduce, fold

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13339: Assignee: Apache Spark (was: Sean Owen) > Clarify commutative / associative operator

[jira] [Resolved] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13198. --- Resolution: Not A Problem I don't think this is a problem since the intended usage is 1 context == 1

[jira] [Created] (SPARK-13340) [ML] PolynomialExpansion and Normalizer should validate input type

2016-02-16 Thread Grzegorz Chilkiewicz (JIRA)
Grzegorz Chilkiewicz created SPARK-13340: Summary: [ML] PolynomialExpansion and Normalizer should validate input type Key: SPARK-13340 URL: https://issues.apache.org/jira/browse/SPARK-13340

[jira] [Commented] (SPARK-4224) Support group acls

2016-02-16 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148627#comment-15148627 ] Thomas Graves commented on SPARK-4224: -- why did you close this? > Support group acls >

[jira] [Reopened] (SPARK-4224) Support group acls

2016-02-16 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reopened SPARK-4224: -- > Support group acls > -- > > Key: SPARK-4224 >

[jira] [Commented] (SPARK-4224) Support group acls

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148653#comment-15148653 ] Sean Owen commented on SPARK-4224: -- No follow up in 16 months. I realize that doesn't automatically

[jira] [Commented] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

2016-02-16 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148662#comment-15148662 ] Thomas Graves commented on SPARK-12316: --- I'm not following how this ended up in an infinite loop.

[jira] [Commented] (SPARK-5377) Dynamically add jar into Spark Driver's classpath.

2016-02-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148675#comment-15148675 ] Xuefu Zhang commented on SPARK-5377: [~sowen], I saw you had closed this without giving any

[jira] [Commented] (SPARK-4224) Support group acls

2016-02-16 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148682#comment-15148682 ] Thomas Graves commented on SPARK-4224: -- Ok, I understand closing older things but in this instance I

[jira] [Commented] (SPARK-2421) Spark should treat writable as serializable for keys

2016-02-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148684#comment-15148684 ] Xuefu Zhang commented on SPARK-2421: [~sowen], I saw you had closed this without giving any

[jira] [Assigned] (SPARK-13340) [ML] PolynomialExpansion and Normalizer should validate input type

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13340: Assignee: (was: Apache Spark) > [ML] PolynomialExpansion and Normalizer should

[jira] [Commented] (SPARK-13340) [ML] PolynomialExpansion and Normalizer should validate input type

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148696#comment-15148696 ] Apache Spark commented on SPARK-13340: -- User 'grzegorz-chilkiewicz' has created a pull request for

[jira] [Commented] (SPARK-13317) SPARK_LOCAL_IP does not bind to public IP on Slaves

2016-02-16 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148705#comment-15148705 ] Christopher Bourez commented on SPARK-13317: I'm trying my best, second time, but when I

[jira] [Comment Edited] (SPARK-13317) SPARK_LOCAL_IP does not bind to public IP on Slaves

2016-02-16 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148705#comment-15148705 ] Christopher Bourez edited comment on SPARK-13317 at 2/16/16 2:54 PM: -

[jira] [Commented] (SPARK-2421) Spark should treat writable as serializable for keys

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148776#comment-15148776 ] Sean Owen commented on SPARK-2421: -- Pretty much the same reason in all cases: no activity in 16 months, a

[jira] [Commented] (SPARK-4224) Support group acls

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148796#comment-15148796 ] Sean Owen commented on SPARK-4224: -- I'd encourage anyone to read

[jira] [Commented] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-16 Thread Qi Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148872#comment-15148872 ] Qi Dai commented on SPARK-13289: Hi Sean, Are you able to reproduce the issue? Do you need any other

[jira] [Comment Edited] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-16 Thread Qi Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148872#comment-15148872 ] Qi Dai edited comment on SPARK-13289 at 2/16/16 4:35 PM: - Hi Sean, Are you able

[jira] [Commented] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148876#comment-15148876 ] Sean Owen commented on SPARK-13289: --- I haven't run it. It'd be great if you can run with this and

[jira] [Created] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

2016-02-16 Thread William Dee (JIRA)
William Dee created SPARK-13341: --- Summary: Casting Unix timestamp to SQL timestamp fails Key: SPARK-13341 URL: https://issues.apache.org/jira/browse/SPARK-13341 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-16 Thread Qi Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148920#comment-15148920 ] Qi Dai commented on SPARK-13289: I'm not familiar with the algorithm and implementation. Maybe we need to

[jira] [Commented] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148923#comment-15148923 ] Sean Owen commented on SPARK-13289: --- That's not usually how it works; I wouldn't expect others to debug

[jira] [Commented] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-16 Thread Qi Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148937#comment-15148937 ] Qi Dai commented on SPARK-13289: Yes, just download the data from the url. Unzip it and change the path

[jira] [Created] (SPARK-13342) Cannot run INSERT statements in Spark

2016-02-16 Thread neo (JIRA)
neo created SPARK-13342: --- Summary: Cannot run INSERT statements in Spark Key: SPARK-13342 URL: https://issues.apache.org/jira/browse/SPARK-13342 Project: Spark Issue Type: Bug Affects Versions:

[jira] [Updated] (SPARK-13342) Cannot run INSERT statements in Spark

2016-02-16 Thread neo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] neo updated SPARK-13342: Description: I cannot run a INSERT statement using spark-sql. I tried with both versions 1.5.1 and 1.6.0 without

[jira] [Updated] (SPARK-13342) Cannot run INSERT statements in Spark

2016-02-16 Thread neo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] neo updated SPARK-13342: Description: I cannot run a INSERT statement using spark-sql. I tried with both versions 1.5.1 and 1.6.0 without

[jira] [Updated] (SPARK-13342) Cannot run INSERT statements in Spark

2016-02-16 Thread neo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] neo updated SPARK-13342: Description: I cannot run a INSERT statement using spark-sql. I tried with both versions 1.5.1 and 1.6.0 without

[jira] [Commented] (SPARK-13327) colnames()<- allows invalid column names

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149017#comment-15149017 ] Apache Spark commented on SPARK-13327: -- User 'olarayej' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13327) colnames()<- allows invalid column names

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13327: Assignee: Apache Spark > colnames()<- allows invalid column names >

[jira] [Updated] (SPARK-13342) Cannot run INSERT statements in Spark

2016-02-16 Thread neo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] neo updated SPARK-13342: Priority: Critical (was: Major) > Cannot run INSERT statements in Spark > - >

[jira] [Assigned] (SPARK-13242) Moderately complex `when` expression causes code generation failure

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13242: Assignee: (was: Apache Spark) > Moderately complex `when` expression causes code

[jira] [Commented] (SPARK-13242) Moderately complex `when` expression causes code generation failure

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149036#comment-15149036 ] Apache Spark commented on SPARK-13242: -- User 'joehalliwell' has created a pull request for this

[jira] [Assigned] (SPARK-13242) Moderately complex `when` expression causes code generation failure

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13242: Assignee: Apache Spark > Moderately complex `when` expression causes code generation

[jira] [Commented] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

2016-02-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149053#comment-15149053 ] Joseph K. Bradley commented on SPARK-1: --- I now have a much more complex example which does

[jira] [Created] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success

2016-02-16 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-13343: - Summary: speculative tasks that didn't commit shouldn't be marked as success Key: SPARK-13343 URL: https://issues.apache.org/jira/browse/SPARK-13343 Project: Spark

[jira] [Updated] (SPARK-12976) Add LazilyGenerateOrdering and use it for RangePartitioner of Exchange.

2016-02-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12976: --- Assignee: Takuya Ueshin > Add LazilyGenerateOrdering and use it for RangePartitioner of Exchange. >

[jira] [Resolved] (SPARK-12976) Add LazilyGenerateOrdering and use it for RangePartitioner of Exchange.

2016-02-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12976. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10894

[jira] [Created] (SPARK-13344) SaveLoadSuite has many accumulator exceptions

2016-02-16 Thread Andrew Or (JIRA)
Andrew Or created SPARK-13344: - Summary: SaveLoadSuite has many accumulator exceptions Key: SPARK-13344 URL: https://issues.apache.org/jira/browse/SPARK-13344 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-13344) SaveLoadSuite has many accumulator exceptions

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13344: Assignee: Apache Spark (was: Andrew Or) > SaveLoadSuite has many accumulator exceptions

[jira] [Commented] (SPARK-13344) SaveLoadSuite has many accumulator exceptions

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149106#comment-15149106 ] Apache Spark commented on SPARK-13344: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13344) SaveLoadSuite has many accumulator exceptions

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13344: Assignee: Andrew Or (was: Apache Spark) > SaveLoadSuite has many accumulator exceptions

[jira] [Updated] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

2016-02-16 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-11701: -- Description: I am using dynamic container allocation and speculation and am seeing issues

[jira] [Commented] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-02-16 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149126#comment-15149126 ] Aaditya Ramesh commented on SPARK-13027: Hi [~zsxwing] sorry to bump this again, I've submitted a

[jira] [Resolved] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

2016-02-16 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-11701. --- Resolution: Duplicate > YARN - dynamic allocation and speculation active task accounting

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2016-02-16 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149139#comment-15149139 ] Alexander Ulanov commented on SPARK-9273: - Hi [~gsateesh110], Besides the one mentioned by Yuhao,

[jira] [Resolved] (SPARK-13280) FileBasedWriteAheadLog logger name should be under o.a.s namespace

2016-02-16 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-13280. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.0.0 >

[jira] [Commented] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

2016-02-16 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149155#comment-15149155 ] Xiao Li commented on SPARK-1: - [~josephkb] I found the root cause. : ) In the genCode of Randn and

[jira] [Commented] (SPARK-12154) Upgrade to Jersey 2

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149176#comment-15149176 ] Apache Spark commented on SPARK-12154: -- User 'mccheah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12154) Upgrade to Jersey 2

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12154: Assignee: (was: Apache Spark) > Upgrade to Jersey 2 > --- > >

[jira] [Assigned] (SPARK-12154) Upgrade to Jersey 2

2016-02-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12154: Assignee: Apache Spark > Upgrade to Jersey 2 > --- > >

[jira] [Created] (SPARK-13345) Adding one way ANOVA to Spark ML stat

2016-02-16 Thread yuhao yang (JIRA)
yuhao yang created SPARK-13345: -- Summary: Adding one way ANOVA to Spark ML stat Key: SPARK-13345 URL: https://issues.apache.org/jira/browse/SPARK-13345 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-13346) DataFrame caching is not handled well during planning or execution

2016-02-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149227#comment-15149227 ] Joseph K. Bradley commented on SPARK-13346: --- CC: [~andrewor14] [~joshrosen] whom I spoke with

[jira] [Created] (SPARK-13346) DataFrame caching is not handled well during planning or execution

2016-02-16 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-13346: - Summary: DataFrame caching is not handled well during planning or execution Key: SPARK-13346 URL: https://issues.apache.org/jira/browse/SPARK-13346

[jira] [Commented] (SPARK-10759) Missing Python code example in ML Programming guide

2016-02-16 Thread Jeremy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149266#comment-15149266 ] Jeremy commented on SPARK-10759: Cannot add example for code that doesn't exist. > Missing Python code

[jira] [Resolved] (SPARK-13308) ManagedBuffers passed to OneToOneStreamManager need to be freed in non-error cases

2016-02-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13308. -- Resolution: Fixed Fix Version/s: 2.0.0 > ManagedBuffers passed to OneToOneStreamManager

[jira] [Commented] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode

2016-02-16 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149309#comment-15149309 ] Henry Saputra commented on SPARK-5158: -- All, the PR for this issues are closed. This PR:

[jira] [Comment Edited] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode

2016-02-16 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149309#comment-15149309 ] Henry Saputra edited comment on SPARK-5158 at 2/16/16 9:14 PM: --- HI All,

  1   2   >