[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

2015-10-02 Thread Jim Haughwout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942108#comment-14942108 ] Jim Haughwout commented on SPARK-6270: -- [~tdas]: Was this fixed in 1.5.0? Affecting o

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-02 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942096#comment-14942096 ] Naden Franciscus commented on SPARK-10474: -- I have tried setting spark.buffer.pa

[jira] [Assigned] (SPARK-10917) Improve performance of complex types in columnar cache

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10917: Assignee: Apache Spark (was: Davies Liu) > Improve performance of complex types in column

[jira] [Commented] (SPARK-10917) Improve performance of complex types in columnar cache

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942014#comment-14942014 ] Apache Spark commented on SPARK-10917: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-10917) Improve performance of complex types in columnar cache

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10917: Assignee: Davies Liu (was: Apache Spark) > Improve performance of complex types in column

[jira] [Created] (SPARK-10917) Improve performance of complex types in columnar cache

2015-10-02 Thread Davies Liu (JIRA)
Davies Liu created SPARK-10917: -- Summary: Improve performance of complex types in columnar cache Key: SPARK-10917 URL: https://issues.apache.org/jira/browse/SPARK-10917 Project: Spark Issue Type

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2015-10-02 Thread Evan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941961#comment-14941961 ] Evan Chen commented on SPARK-9487: -- Hey Xiangrui, What would be the preferred num. worke

[jira] [Commented] (SPARK-10916) YARN executors are launched with the default perm gen size

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941958#comment-14941958 ] Apache Spark commented on SPARK-10916: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-10916) YARN executors are launched with the default perm gen size

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10916: Assignee: (was: Apache Spark) > YARN executors are launched with the default perm gen

[jira] [Assigned] (SPARK-10916) YARN executors are launched with the default perm gen size

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10916: Assignee: Apache Spark > YARN executors are launched with the default perm gen size >

[jira] [Commented] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2015-10-02 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941953#comment-14941953 ] Shea Parkes commented on SPARK-10847: - My apologies, I just read your patch and see y

[jira] [Commented] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2015-10-02 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941952#comment-14941952 ] Shea Parkes commented on SPARK-10847: - I appreciate your assistance! I think your pr

[jira] [Assigned] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10847: Assignee: (was: Apache Spark) > Pyspark - DataFrame - Optional Metadata with `None` tr

[jira] [Assigned] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10847: Assignee: Apache Spark > Pyspark - DataFrame - Optional Metadata with `None` triggers cryp

[jira] [Commented] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941929#comment-14941929 ] Apache Spark commented on SPARK-10847: -- User 'jasoncl' has created a pull request fo

[jira] [Resolved] (SPARK-10317) start-history-server.sh CLI parsing incompatible with HistoryServer's arg parsing

2015-10-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10317. Resolution: Fixed Assignee: Rekha Joshi Fix Version/s: 1.6.0 > start-histor

[jira] [Commented] (SPARK-10798) JsonMappingException with Spark Context Parallelize

2015-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941804#comment-14941804 ] Sean Owen commented on SPARK-10798: --- That's Java code, and you're pasting it in the sca

[jira] [Commented] (SPARK-10798) JsonMappingException with Spark Context Parallelize

2015-10-02 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941799#comment-14941799 ] Miao Wang commented on SPARK-10798: --- Hi Dev, When I paste the following line in spark-

[jira] [Commented] (SPARK-10780) Set initialModel in KMeans in Pipelines API

2015-10-02 Thread Jayant Shekhar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941781#comment-14941781 ] Jayant Shekhar commented on SPARK-10780: Almost done with it! I would get some in

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-10-02 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941775#comment-14941775 ] Peng Cheng commented on SPARK-10625: The patch can be merged immediately, can some on

[jira] [Created] (SPARK-10916) YARN executors are launched with the default perm gen size

2015-10-02 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-10916: -- Summary: YARN executors are launched with the default perm gen size Key: SPARK-10916 URL: https://issues.apache.org/jira/browse/SPARK-10916 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-761) Print a nicer error message when incompatible Spark binaries try to talk

2015-10-02 Thread Harsh Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh Gupta updated SPARK-761: -- Comment: was deleted (was: [~aash] What all API should be taken care of ? Which version should it effect

[jira] [Issue Comment Deleted] (SPARK-761) Print a nicer error message when incompatible Spark binaries try to talk

2015-10-02 Thread Harsh Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh Gupta updated SPARK-761: -- Comment: was deleted (was: [~aash] How do I do a compatibility check on API on which they talk ? Can you

[jira] [Commented] (SPARK-9570) Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x'.

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941701#comment-14941701 ] Apache Spark commented on SPARK-9570: - User 'srowen' has created a pull request for th

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-10-02 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-10-02 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-10-02 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-10-02 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Assigned] (SPARK-10779) Set initialModel for KMeans model in PySpark (spark.mllib)

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10779: Assignee: Apache Spark > Set initialModel for KMeans model in PySpark (spark.mllib) >

[jira] [Assigned] (SPARK-10779) Set initialModel for KMeans model in PySpark (spark.mllib)

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10779: Assignee: (was: Apache Spark) > Set initialModel for KMeans model in PySpark (spark.ml

[jira] [Commented] (SPARK-10779) Set initialModel for KMeans model in PySpark (spark.mllib)

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941635#comment-14941635 ] Apache Spark commented on SPARK-10779: -- User 'evanyc15' has created a pull request f

[jira] [Updated] (SPARK-10915) Add support for UDAFs in Python

2015-10-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10915: Affects Version/s: (was: 0.5.0) > Add support for UDAFs in Python > ---

[jira] [Created] (SPARK-10915) Add support for UDAFs in Python

2015-10-02 Thread Justin Uang (JIRA)
Justin Uang created SPARK-10915: --- Summary: Add support for UDAFs in Python Key: SPARK-10915 URL: https://issues.apache.org/jira/browse/SPARK-10915 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-10-02 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-10-02 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Commented] (SPARK-10893) Lag Analytic function broken

2015-10-02 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941553#comment-14941553 ] Jo Desmet commented on SPARK-10893: --- Well part of the problem is that it was not reprod

[jira] [Commented] (SPARK-7275) Make LogicalRelation public

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941541#comment-14941541 ] Apache Spark commented on SPARK-7275: - User 'gweidner' has created a pull request for

[jira] [Updated] (SPARK-8467) Add LDAModel.describeTopics() in Python

2015-10-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8467: - Shepherd: Joseph K. Bradley Assignee: Yu Ishikawa > Add LDAModel.describeTopics() in P

[jira] [Created] (SPARK-10914) Incorrect empty join sets

2015-10-02 Thread Ben Moran (JIRA)
Ben Moran created SPARK-10914: - Summary: Incorrect empty join sets Key: SPARK-10914 URL: https://issues.apache.org/jira/browse/SPARK-10914 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-10798) JsonMappingException with Spark Context Parallelize

2015-10-02 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941461#comment-14941461 ] Miao Wang commented on SPARK-10798: --- Hi Dev, I am interested in working on this issue.

[jira] [Commented] (SPARK-10913) Add attach() function for DataFrame

2015-10-02 Thread Weiqiang Zhuang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941449#comment-14941449 ] Weiqiang Zhuang commented on SPARK-10913: - I think they are different issues. If

[jira] [Commented] (SPARK-5890) Add QuantileDiscretizer

2015-10-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941444#comment-14941444 ] Joseph K. Bradley commented on SPARK-5890: -- [~yinxusen] Could you please create J

[jira] [Commented] (SPARK-6530) ChiSqSelector transformer

2015-10-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941446#comment-14941446 ] Joseph K. Bradley commented on SPARK-6530: -- [~yinxusen] Could you please create J

[jira] [Resolved] (SPARK-6530) ChiSqSelector transformer

2015-10-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6530. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 5742 [https

[jira] [Resolved] (SPARK-5890) Add QuantileDiscretizer

2015-10-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5890. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 5779 [https

[jira] [Commented] (SPARK-10913) Add attach() function for DataFrame

2015-10-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941427#comment-14941427 ] Shivaram Venkataraman commented on SPARK-10913: --- Can this also address SPAR

[jira] [Resolved] (SPARK-9798) CrossValidatorModel Documentation Improvements

2015-10-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9798. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8882 [https

[jira] [Updated] (SPARK-9798) CrossValidatorModel Documentation Improvements

2015-10-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9798: - Assignee: rerngvit yanggratoke > CrossValidatorModel Documentation Improvements >

[jira] [Updated] (SPARK-9622) DecisionTreeRegressor: provide variance of prediction

2015-10-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9622: - Shepherd: Joseph K. Bradley Target Version/s: 1.6.0 > DecisionTreeRegressor: p

[jira] [Commented] (SPARK-10913) Add attach() function for DataFrame

2015-10-02 Thread Weiqiang Zhuang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941393#comment-14941393 ] Weiqiang Zhuang commented on SPARK-10913: - The attach() API is really helpful whe

[jira] [Created] (SPARK-10913) Add attach() function for DataFrame

2015-10-02 Thread Weiqiang Zhuang (JIRA)
Weiqiang Zhuang created SPARK-10913: --- Summary: Add attach() function for DataFrame Key: SPARK-10913 URL: https://issues.apache.org/jira/browse/SPARK-10913 Project: Spark Issue Type: Sub-tas

[jira] [Commented] (SPARK-10894) Add 'drop' support for DataFrame's subset function

2015-10-02 Thread Weiqiang Zhuang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941375#comment-14941375 ] Weiqiang Zhuang commented on SPARK-10894: - Guess it will be difficult to explain

[jira] [Commented] (SPARK-7499) Investigate how to specify columns in SparkR without $ or strings

2015-10-02 Thread Weiqiang Zhuang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941371#comment-14941371 ] Weiqiang Zhuang commented on SPARK-7499: Wondering if there is any update on this

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941353#comment-14941353 ] Shivaram Venkataraman commented on SPARK-10903: --- I'd say lets have one comm

[jira] [Updated] (SPARK-10912) Improve Spark metrics executor.filesystem

2015-10-02 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-10912: - Description: In org.apache.spark.executor.ExecutorSource it has 2 filesystem metrics: "hdfs" and

[jira] [Created] (SPARK-10912) Improve Spark metrics executor.filesystem

2015-10-02 Thread Yongjia Wang (JIRA)
Yongjia Wang created SPARK-10912: Summary: Improve Spark metrics executor.filesystem Key: SPARK-10912 URL: https://issues.apache.org/jira/browse/SPARK-10912 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-7275) Make LogicalRelation public

2015-10-02 Thread Glenn Weidner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941300#comment-14941300 ] Glenn Weidner commented on SPARK-7275: -- I'll submit another pull request today. Than

[jira] [Commented] (SPARK-10889) Upgrade Kinesis Client Library

2015-10-02 Thread Avrohom Katz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941282#comment-14941282 ] Avrohom Katz commented on SPARK-10889: -- Is there a way to get this change into the 1

[jira] [Updated] (SPARK-10889) Upgrade Kinesis Client Library

2015-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10889: -- Affects Version/s: (was: 1.5.2) (was: 1.6.0) (

[jira] [Commented] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-10-02 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941257#comment-14941257 ] Kostas papageorgopoulos commented on SPARK-10909: - You are correct. That

[jira] [Updated] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-10-02 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-10909: Affects Version/s: (was: 1.5.0) 1.5.1 > Spark sq

[jira] [Updated] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10909: -- Target Version/s: (was: 1.5.0) Priority: Minor (was: Major) Fix Version/s: (wa

[jira] [Updated] (SPARK-10905) Export freqItems() for DataFrameStatFunctions in SparkR

2015-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10905: -- Target Version/s: (was: 1.6.0) Priority: Minor (was: Major) Fix Version/s: (wa

[jira] [Commented] (SPARK-10911) Executors should System.exit on clean shutdown

2015-10-02 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941247#comment-14941247 ] Thomas Graves commented on SPARK-10911: --- Note in this case I was running on Yarn an

[jira] [Updated] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

2015-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10865: -- Assignee: Cheng Hao > [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type > ---

[jira] [Updated] (SPARK-10866) [Spark SQL] [UDF] the floor function got wrong return value type

2015-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10866: -- Assignee: Cheng Hao > [Spark SQL] [UDF] the floor function got wrong return value type > --

[jira] [Updated] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

2015-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6882: - Assignee: Steve Loughran > Spark ThriftServer2 Kerberos failed encountering > java.lang.IllegalArgumentEx

[jira] [Created] (SPARK-10911) Executors should System.exit on clean shutdown

2015-10-02 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10911: - Summary: Executors should System.exit on clean shutdown Key: SPARK-10911 URL: https://issues.apache.org/jira/browse/SPARK-10911 Project: Spark Issue Type:

[jira] [Updated] (SPARK-10150) --force=true option is not working in beeline

2015-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10150: -- Component/s: SQL [~Bjangir] this should have a component and SQL is closest. > --force=true option is

[jira] [Updated] (SPARK-10150) --force=true option is not working in beeline

2015-10-02 Thread Babulal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-10150: Component/s: (was: SQL) > --force=true option is not working in beeline >

[jira] [Commented] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-10-02 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941230#comment-14941230 ] Liang-Chi Hsieh commented on SPARK-10909: - [~p02096] I created a pr for this prob

[jira] [Commented] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941228#comment-14941228 ] Apache Spark commented on SPARK-10909: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10909: Assignee: Apache Spark > Spark sql jdbc fails for Oracle NUMBER type columns > ---

[jira] [Assigned] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10909: Assignee: (was: Apache Spark) > Spark sql jdbc fails for Oracle NUMBER type columns >

[jira] [Commented] (SPARK-10436) spark-submit overwrites spark.files defaults with the job script filename

2015-10-02 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941225#comment-14941225 ] Nakul Jindal commented on SPARK-10436: -- I am new to Spark and will take a look at it

[jira] [Comment Edited] (SPARK-10436) spark-submit overwrites spark.files defaults with the job script filename

2015-10-02 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941225#comment-14941225 ] Nakul Jindal edited comment on SPARK-10436 at 10/2/15 3:01 PM:

[jira] [Commented] (SPARK-10910) spark.{executor,driver}.userClassPathFirst don't work for kryo (probably others)

2015-10-02 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941209#comment-14941209 ] Thomas Graves commented on SPARK-10910: --- So I understand that perhaps this mechanis

[jira] [Commented] (SPARK-10910) spark.{executor,driver}.userClassPathFirst don't work for kryo (probably others)

2015-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941175#comment-14941175 ] Sean Owen commented on SPARK-10910: --- I suspect this is one of several libraries that si

[jira] [Created] (SPARK-10910) spark.{executor,driver}.userClassPathFirst don't work for kryo (probably others)

2015-10-02 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10910: - Summary: spark.{executor,driver}.userClassPathFirst don't work for kryo (probably others) Key: SPARK-10910 URL: https://issues.apache.org/jira/browse/SPARK-10910 Pr

[jira] [Commented] (SPARK-6108) No application number limit in spark history server

2015-10-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941125#comment-14941125 ] Steve Loughran commented on SPARK-6108: --- If this is an issue, then having a time win

[jira] [Commented] (SPARK-6951) History server slow startup if the event log directory is large

2015-10-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941121#comment-14941121 ] Steve Loughran commented on SPARK-6951: --- There's a way to address this that I've bee

[jira] [Resolved] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

2015-10-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-6882. --- Resolution: Fixed Fix Version/s: 1.5.1 > Spark ThriftServer2 Kerberos failed encounteri

[jira] [Commented] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

2015-10-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941116#comment-14941116 ] Steve Loughran commented on SPARK-6882: --- This will have gone away with Spark 1.5 and

[jira] [Commented] (SPARK-5925) YARN - Spark progress bar stucks at 10% but after finishing shows 100%

2015-10-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941112#comment-14941112 ] Steve Loughran commented on SPARK-5925: --- I've actually thought about how to do this

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-10-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941109#comment-14941109 ] Steve Loughran commented on SPARK-10873: Note that the problem appears to arise i

[jira] [Updated] (SPARK-10896) Parquet join issue

2015-10-02 Thread Tamas Szuromi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tamas Szuromi updated SPARK-10896: -- Fix Version/s: (was: 1.5.1) (was: 1.6.0) > Parquet join issue >

[jira] [Updated] (SPARK-10896) Parquet join issue

2015-10-02 Thread Tamas Szuromi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tamas Szuromi updated SPARK-10896: -- Fix Version/s: 1.6.0 1.5.1 > Parquet join issue > -- > >

[jira] [Updated] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-10-02 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-10909: Description: When using spark sql to connect to Oracle and run a spark sql

[jira] [Updated] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-10-02 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-10909: Description: When using spark sql to connect to Oracle and run a spark sql

[jira] [Updated] (SPARK-10896) Parquet join issue

2015-10-02 Thread Tamas Szuromi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tamas Szuromi updated SPARK-10896: -- Affects Version/s: 1.5.1 > Parquet join issue > -- > > Key: SPA

[jira] [Created] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-10-02 Thread Kostas papageorgopoulos (JIRA)
Kostas papageorgopoulos created SPARK-10909: --- Summary: Spark sql jdbc fails for Oracle NUMBER type columns Key: SPARK-10909 URL: https://issues.apache.org/jira/browse/SPARK-10909 Project: Spa

[jira] [Commented] (SPARK-10905) Export freqItems() for DataFrameStatFunctions in SparkR

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940891#comment-14940891 ] Apache Spark commented on SPARK-10905: -- User 'rerngvit' has created a pull request f

[jira] [Assigned] (SPARK-10905) Export freqItems() for DataFrameStatFunctions in SparkR

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10905: Assignee: (was: Apache Spark) > Export freqItems() for DataFrameStatFunctions in Spark

[jira] [Commented] (SPARK-10905) Export freqItems() for DataFrameStatFunctions in SparkR

2015-10-02 Thread rerngvit yanggratoke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940890#comment-14940890 ] rerngvit yanggratoke commented on SPARK-10905: -- [~shivaram] I have a PR for

[jira] [Assigned] (SPARK-10905) Export freqItems() for DataFrameStatFunctions in SparkR

2015-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10905: Assignee: Apache Spark > Export freqItems() for DataFrameStatFunctions in SparkR > ---

[jira] [Commented] (SPARK-10880) Hive module build test failed

2015-10-02 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940877#comment-14940877 ] Jean-Baptiste Onofré commented on SPARK-10880: -- So far so good, sorry for th

[jira] [Commented] (SPARK-10880) Hive module build test failed

2015-10-02 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940862#comment-14940862 ] Jean-Baptiste Onofré commented on SPARK-10880: -- Just updated my local copy,

[jira] [Commented] (SPARK-10669) Link to each language's API in codetabs in ML docs: spark.mllib

2015-10-02 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940844#comment-14940844 ] Xin Ren commented on SPARK-10669: - Hi Joseph, I'm just double checking with you that I'm