[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

2015-11-27 Thread Jose Antonio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029674#comment-15029674 ] Jose Antonio commented on SPARK-5874: - Hello, I am developing a Graphical User Interfa

[jira] [Commented] (SPARK-11148) Unable to create views

2015-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029695#comment-15029695 ] Maciej Bryński commented on SPARK-11148: Any deadline on this issue ? > Unable t

[jira] [Commented] (SPARK-11148) Unable to create views

2015-11-27 Thread Lunen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029732#comment-15029732 ] Lunen commented on SPARK-11148: --- Hi Maciej, Spark implementation at our client site will b

[jira] [Created] (SPARK-12023) Warnings while packaging spark with maven.

2015-11-27 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-12023: --- Summary: Warnings while packaging spark with maven. Key: SPARK-12023 URL: https://issues.apache.org/jira/browse/SPARK-12023 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12023) Warnings while packaging spark with maven.

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029759#comment-15029759 ] Apache Spark commented on SPARK-12023: -- User 'ScrapCodes' has created a pull request

[jira] [Assigned] (SPARK-12023) Warnings while packaging spark with maven.

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12023: Assignee: Apache Spark > Warnings while packaging spark with maven. >

[jira] [Assigned] (SPARK-12023) Warnings while packaging spark with maven.

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12023: Assignee: (was: Apache Spark) > Warnings while packaging spark with maven. > -

[jira] [Created] (SPARK-12024) Improved multi-column counting

2015-11-27 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-12024: - Summary: Improved multi-column counting Key: SPARK-12024 URL: https://issues.apache.org/jira/browse/SPARK-12024 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-12025) Rename window rank function names for SparkR

2015-11-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12025: --- Summary: Rename window rank function names for SparkR Key: SPARK-12025 URL: https://issues.apache.org/jira/browse/SPARK-12025 Project: Spark Issue Type: Improv

[jira] [Assigned] (SPARK-12024) Improved multi-column counting

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12024: Assignee: Apache Spark > Improved multi-column counting > -- >

[jira] [Commented] (SPARK-12024) Improved multi-column counting

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029770#comment-15029770 ] Apache Spark commented on SPARK-12024: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-12024) Improved multi-column counting

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12024: Assignee: (was: Apache Spark) > Improved multi-column counting > -

[jira] [Commented] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029771#comment-15029771 ] Apache Spark commented on SPARK-12025: -- User 'yanboliang' has created a pull request

[jira] [Updated] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12025: Summary: Rename some window rank function names for SparkR (was: Rename window rank function names

[jira] [Assigned] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12025: Assignee: Apache Spark > Rename some window rank function names for SparkR > -

[jira] [Assigned] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12025: Assignee: (was: Apache Spark) > Rename some window rank function names for SparkR > --

[jira] [Updated] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12025: Description: There are two reasons that we should make this change: * We should follow the naming c

[jira] [Updated] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12025: Description: Change cumeDist -> cume_dist, denseRank -> dense_rank, percentRank -> percent_rank, r

[jira] [Commented] (SPARK-12022) spark-shell cannot run on master created with spark-ec2

2015-11-27 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029778#comment-15029778 ] Prashant Sharma commented on SPARK-12022: - You can may be try running with -Djava

[jira] [Updated] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12025: Description: Change cumeDist -> cume_dist, denseRank -> dense_rank, percentRank -> percent_rank, r

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029810#comment-15029810 ] Sean Owen commented on SPARK-10625: --- [~peng] your patch is not mergeable. Please see th

[jira] [Created] (SPARK-12026) ChiSqTest gets slower and slower over time when number of features is large

2015-11-27 Thread Hunter Kelly (JIRA)
Hunter Kelly created SPARK-12026: Summary: ChiSqTest gets slower and slower over time when number of features is large Key: SPARK-12026 URL: https://issues.apache.org/jira/browse/SPARK-12026 Project:

[jira] [Created] (SPARK-12027) Spark on YARN won't ever ask for more executors than there were containers at time of context creation

2015-11-27 Thread Hunter Kelly (JIRA)
Hunter Kelly created SPARK-12027: Summary: Spark on YARN won't ever ask for more executors than there were containers at time of context creation Key: SPARK-12027 URL: https://issues.apache.org/jira/browse/SPARK-1

[jira] [Commented] (SPARK-12027) Spark on YARN won't ever ask for more executors than there were containers at time of context creation

2015-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029840#comment-15029840 ] Sean Owen commented on SPARK-12027: --- This is what dynamic allocation is for -- are you

[jira] [Commented] (SPARK-12026) ChiSqTest gets slower and slower over time when number of features is large

2015-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029843#comment-15029843 ] Sean Owen commented on SPARK-12026: --- Can you narrow down what's slow? this isn't much t

[jira] [Resolved] (SPARK-11853) java.lang.ClassNotFoundException with spray-json on EMR

2015-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11853. --- Resolution: Cannot Reproduce This is just how Java works though. If A loads B and B loads C, B has to

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11918: -- Labels: starter (was: ) Priority: Minor (was: Major) Issue Type: Improvement (was: Bug)

[jira] [Assigned] (SPARK-12002) offsetRanges attribute missing in Kafka RDD when resuming from checkpoint

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12002: Assignee: Apache Spark > offsetRanges attribute missing in Kafka RDD when resuming from ch

[jira] [Commented] (SPARK-12002) offsetRanges attribute missing in Kafka RDD when resuming from checkpoint

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029879#comment-15029879 ] Apache Spark commented on SPARK-12002: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-12002) offsetRanges attribute missing in Kafka RDD when resuming from checkpoint

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12002: Assignee: (was: Apache Spark) > offsetRanges attribute missing in Kafka RDD when resum

[jira] [Commented] (SPARK-12026) ChiSqTest gets slower and slower over time when number of features is large

2015-11-27 Thread Hunter Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029929#comment-15029929 ] Hunter Kelly commented on SPARK-12026: -- Here's the bumpf from the details button on

[jira] [Commented] (SPARK-12026) ChiSqTest gets slower and slower over time when number of features is large

2015-11-27 Thread Hunter Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029932#comment-15029932 ] Hunter Kelly commented on SPARK-12026: -- As for cluster issues; I've done this severa

[jira] [Updated] (SPARK-12026) ChiSqTest gets slower and slower over time when number of features is large

2015-11-27 Thread Hunter Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hunter Kelly updated SPARK-12026: - Attachment: First Stages.png Here's what the start of one of the jobs looks like > ChiSqTest get

[jira] [Updated] (SPARK-12026) ChiSqTest gets slower and slower over time when number of features is large

2015-11-27 Thread Hunter Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hunter Kelly updated SPARK-12026: - Attachment: Latest Stages.png Here's what the final stages of one of the jobs looks like > ChiSq

[jira] [Comment Edited] (SPARK-12026) ChiSqTest gets slower and slower over time when number of features is large

2015-11-27 Thread Hunter Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029929#comment-15029929 ] Hunter Kelly edited comment on SPARK-12026 at 11/27/15 2:57 PM: ---

[jira] [Commented] (SPARK-12027) Spark on YARN won't ever ask for more executors than there were containers at time of context creation

2015-11-27 Thread Hunter Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029948#comment-15029948 ] Hunter Kelly commented on SPARK-12027: -- Yes! I can only ever get it to grab 1 more

[jira] [Commented] (SPARK-11853) java.lang.ClassNotFoundException with spray-json on EMR

2015-11-27 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1503#comment-1503 ] sam commented on SPARK-11853: - Fair enough [~srowen] I'll concede that dependency management

[jira] [Commented] (SPARK-12027) Spark on YARN won't ever ask for more executors than there were containers at time of context creation

2015-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030045#comment-15030045 ] Sean Owen commented on SPARK-12027: --- What are you setting initial/min/max executors to?

[jira] [Commented] (SPARK-12027) Spark on YARN won't ever ask for more executors than there were containers at time of context creation

2015-11-27 Thread Hunter Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030060#comment-15030060 ] Hunter Kelly commented on SPARK-12027: -- "spark.dynamicAllocation.enabled" is set to

[jira] [Updated] (SPARK-12019) SparkR.init have wrong example

2015-11-27 Thread liushiqi9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liushiqi9 updated SPARK-12019: -- Description: https://spark.apache.org/docs/1.5.2/api/R/sparkR.init.html The example says initial the sp

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-11-27 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030087#comment-15030087 ] Peng Cheng commented on SPARK-10625: Yes it is 2 months behind master branch. I've ju

[jira] [Created] (SPARK-12028) [SQL] get_json_object is unable to return a correct result for null literals

2015-11-27 Thread Xiao Li (JIRA)
Xiao Li created SPARK-12028: --- Summary: [SQL] get_json_object is unable to return a correct result for null literals Key: SPARK-12028 URL: https://issues.apache.org/jira/browse/SPARK-12028 Project: Spark

[jira] [Assigned] (SPARK-12028) [SQL] get_json_object is unable to return a correct result for null literals

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12028: Assignee: Apache Spark > [SQL] get_json_object is unable to return a correct result for nu

[jira] [Commented] (SPARK-12028) [SQL] get_json_object is unable to return a correct result for null literals

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030166#comment-15030166 ] Apache Spark commented on SPARK-12028: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-12028) [SQL] get_json_object is unable to return a correct result for null literals

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12028: Assignee: (was: Apache Spark) > [SQL] get_json_object is unable to return a correct re

[jira] [Updated] (SPARK-11980) Fix json_tuple and add unit tests for the Python functions added in SPARK-10621

2015-11-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11980: Summary: Fix json_tuple and add unit tests for the Python functions added in SPARK-10621 (was: Add unit te

[jira] [Resolved] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12025. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12025: -- Assignee: Yanbo Liang > Rename some window rank function names for SparkR > ---

[jira] [Resolved] (SPARK-12021) Fishy test of "don't call ssc.stop in listener"

2015-11-27 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12021. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 Targe

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030229#comment-15030229 ] Felix Cheung commented on SPARK-11886: -- SPARK-12025 renamed several functions that a

[jira] [Created] (SPARK-12029) Improve column functions signature, param check, tests, fix doc and add examples

2015-11-27 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12029: Summary: Improve column functions signature, param check, tests, fix doc and add examples Key: SPARK-12029 URL: https://issues.apache.org/jira/browse/SPARK-12029 Proj

[jira] [Commented] (SPARK-12029) Improve column functions signature, param check, tests, fix doc and add examples

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030232#comment-15030232 ] Apache Spark commented on SPARK-12029: -- User 'felixcheung' has created a pull reques

[jira] [Assigned] (SPARK-12029) Improve column functions signature, param check, tests, fix doc and add examples

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12029: Assignee: (was: Apache Spark) > Improve column functions signature, param check, tests

[jira] [Assigned] (SPARK-12029) Improve column functions signature, param check, tests, fix doc and add examples

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12029: Assignee: Apache Spark > Improve column functions signature, param check, tests, fix doc a

[jira] [Created] (SPARK-12030) Incorrect results when aggregate cached data from JDBC

2015-11-27 Thread JIRA
Maciej Bryński created SPARK-12030: -- Summary: Incorrect results when aggregate cached data from JDBC Key: SPARK-12030 URL: https://issues.apache.org/jira/browse/SPARK-12030 Project: Spark Is

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030247#comment-15030247 ] Apache Spark commented on SPARK-10625: -- User 'tribbloid' has created a pull request

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030248#comment-15030248 ] Apache Spark commented on SPARK-10625: -- User 'tribbloid' has created a pull request

[jira] [Updated] (SPARK-12030) Incorrect results when aggregate cached data from JDBC

2015-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-12030: --- Description: I have following issue. I created 2 dataframes from JDBC (MySQL) and joined them

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030251#comment-15030251 ] Apache Spark commented on SPARK-10625: -- User 'tribbloid' has created a pull request

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-11-27 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030256#comment-15030256 ] Peng Cheng commented on SPARK-10625: rebased on 1.5 branch > Spark SQL JDBC read/wri

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-11-27 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030257#comment-15030257 ] Peng Cheng commented on SPARK-10625: Rebased on 1.6 branch > Spark SQL JDBC read/wri

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-11-27 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030259#comment-15030259 ] Peng Cheng commented on SPARK-10625: squash rebased on master > Spark SQL JDBC read/

[jira] [Resolved] (SPARK-12020) PR builder cannot trigger hadoop 2.0 test

2015-11-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12020. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10010 [https://github.com/

[jira] [Updated] (SPARK-12020) PR builder cannot trigger hadoop 2.0 test

2015-11-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12020: - Fix Version/s: (was: 2.0.0) 1.6.0 > PR builder cannot trigger hadoop 2.0 test > --

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

2015-11-27 Thread Richard Garris (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030319#comment-15030319 ] Richard Garris commented on SPARK-11966: +1 > Spark API for UDTFs > ---

[jira] [Commented] (SPARK-11602) ML 1.6 QA: API: New Scala APIs, docs

2015-11-27 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030372#comment-15030372 ] yuhao yang commented on SPARK-11602: I've finished reviewing scala docs and code chan

[jira] [Commented] (SPARK-11441) HadoopFsRelation is not scalable in number of files read/written

2015-11-27 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030385#comment-15030385 ] koert kuipers commented on SPARK-11441: --- i was able to rather trivially remove the

[jira] [Updated] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-12030: --- Summary: Incorrect results when aggregate joined data (was: Incorrect results when aggregate

[jira] [Updated] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-12030: --- Description: I have following issue. I created 2 dataframes from JDBC (MySQL) and joined them

[jira] [Resolved] (SPARK-12028) [SQL] get_json_object is unable to return a correct result for null literals

2015-11-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12028. Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved by pull reque

[jira] [Commented] (SPARK-12028) [SQL] get_json_object is unable to return a correct result for null literals

2015-11-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030409#comment-15030409 ] Xiao Li commented on SPARK-12028: - [~davies] Thank you! Could you put me as the assignee

[jira] [Updated] (SPARK-7857) IDF w/ minDocFreq on SparseVectors results in literal zeros

2015-11-27 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-7857: --- Shepherd: DB Tsai > IDF w/ minDocFreq on SparseVectors results in literal zeros >

[jira] [Created] (SPARK-12031) Integer overflow when do sampling.

2015-11-27 Thread uncleGen (JIRA)
uncleGen created SPARK-12031: Summary: Integer overflow when do sampling. Key: SPARK-12031 URL: https://issues.apache.org/jira/browse/SPARK-12031 Project: Spark Issue Type: Bug Componen

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

2015-11-27 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-12031: - Description: {code:borderStyle=solid} java.lang.IllegalArgumentException: n must be positive

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

2015-11-27 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-12031: - Description: ``` java.lang.IllegalArgumentException: n must be positive at java.util.Rand

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

2015-11-27 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-12031: - Description: {code:title=Bar.java|borderStyle=solid} java.lang.IllegalArgumentException: n must b

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

2015-11-27 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-12031: - Description: (was: {code:borderStyle=solid} java.lang.IllegalArgumentException: n must be posi

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

2015-11-27 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-12031: - Description: In my case, some partitions contain too much items. When do range partition, exception thro

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

2015-11-27 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-12031: - Description: In my case, some partitions contain too much items. When do range partition, exception thro

[jira] [Assigned] (SPARK-12031) Integer overflow when do sampling.

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12031: Assignee: (was: Apache Spark) > Integer overflow when do sampling. > -

[jira] [Assigned] (SPARK-12031) Integer overflow when do sampling.

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12031: Assignee: Apache Spark > Integer overflow when do sampling. >

[jira] [Commented] (SPARK-12031) Integer overflow when do sampling.

2015-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15030419#comment-15030419 ] Apache Spark commented on SPARK-12031: -- User 'uncleGen' has created a pull request f