[jira] [Created] (SPARK-12097) How to do a cached, batched JDBC-lookup in Spark Streaming?

2015-12-02 Thread Christian Kurz (JIRA)
Christian Kurz created SPARK-12097: -- Summary: How to do a cached, batched JDBC-lookup in Spark Streaming? Key: SPARK-12097 URL: https://issues.apache.org/jira/browse/SPARK-12097 Project: Spark

[jira] [Comment Edited] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Erik Selin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036015#comment-15036015 ] Erik Selin edited comment on SPARK-12089 at 12/2/15 4:15 PM: -

[jira] [Comment Edited] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Erik Selin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036015#comment-15036015 ] Erik Selin edited comment on SPARK-12089 at 12/2/15 4:07 PM: -

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036004#comment-15036004 ] Wenchen Fan commented on SPARK-12089: - yea, I think we should be more conservative to

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Erik Selin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036015#comment-15036015 ] Erik Selin commented on SPARK-12089: I can make that change if it is that easy. I'm j

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Erik Selin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Selin updated SPARK-12089: --- Description: When running a large spark sql query including multiple joins I see tasks failing with

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Erik Selin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Selin updated SPARK-12089: --- Description: When running a large spark sql query including multiple joins I see tasks failing with

[jira] [Comment Edited] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2015-12-02 Thread Brian London (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035963#comment-15035963 ] Brian London edited comment on SPARK-10969 at 12/2/15 3:31 PM:

[jira] [Commented] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2015-12-02 Thread Brian London (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035963#comment-15035963 ] Brian London commented on SPARK-10969: -- I'm not sure why it needs to be an object as

[jira] [Commented] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2015-12-02 Thread Christoph Pirkl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035873#comment-15035873 ] Christoph Pirkl commented on SPARK-10969: - While this commit is useful it does no

[jira] [Commented] (SPARK-12096) remove the old constraint in word2vec

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035864#comment-15035864 ] Apache Spark commented on SPARK-12096: -- User 'hhbyyh' has created a pull request for

[jira] [Assigned] (SPARK-12096) remove the old constraint in word2vec

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12096: Assignee: (was: Apache Spark) > remove the old constraint in word2vec > --

[jira] [Assigned] (SPARK-12096) remove the old constraint in word2vec

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12096: Assignee: Apache Spark > remove the old constraint in word2vec > -

[jira] [Created] (SPARK-12096) remove the old constraint in word2vec

2015-12-02 Thread yuhao yang (JIRA)
yuhao yang created SPARK-12096: -- Summary: remove the old constraint in word2vec Key: SPARK-12096 URL: https://issues.apache.org/jira/browse/SPARK-12096 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-11944) Python API for mllib.clustering.BisectingKMeans

2015-12-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035844#comment-15035844 ] holdenk commented on SPARK-11944: - I'll start working on this. > Python API for mllib.cl

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2015-12-02 Thread Rares Mirica (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035823#comment-15035823 ] Rares Mirica commented on SPARK-12072: -- My set is in the millions of parameters. I b

[jira] [Created] (SPARK-12095) Window function rowsBetween throws exception

2015-12-02 Thread Irakli Machabeli (JIRA)
Irakli Machabeli created SPARK-12095: Summary: Window function rowsBetween throws exception Key: SPARK-12095 URL: https://issues.apache.org/jira/browse/SPARK-12095 Project: Spark Issue Ty

[jira] [Reopened] (SPARK-11065) IOException thrown at job submit shutdown

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-11065: --- Assignee: Jean-Baptiste Onofré > IOException thrown at job submit shutdown > --

[jira] [Resolved] (SPARK-11065) IOException thrown at job submit shutdown

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11065. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.6.0) > IOException thrown at job submi

[jira] [Resolved] (SPARK-11065) IOException thrown at job submit shutdown

2015-12-02 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved SPARK-11065. -- Resolution: Fixed Fix Version/s: 1.6.0 > IOException thrown at job submi

[jira] [Commented] (SPARK-11065) IOException thrown at job submit shutdown

2015-12-02 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035773#comment-15035773 ] Jean-Baptiste Onofré commented on SPARK-11065: -- I just tested and it's now f

[jira] [Comment Edited] (SPARK-10911) Executors should System.exit on clean shutdown

2015-12-02 Thread Jaromir Vanek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035752#comment-15035752 ] Jaromir Vanek edited comment on SPARK-10911 at 12/2/15 1:04 PM: ---

[jira] [Commented] (SPARK-10911) Executors should System.exit on clean shutdown

2015-12-02 Thread Jaromir Vanek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035752#comment-15035752 ] Jaromir Vanek commented on SPARK-10911: --- {{quote}} why isn't YARN killing the execu

[jira] [Commented] (SPARK-4117) Spark on Yarn handle AM being told command from RM

2015-12-02 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035721#comment-15035721 ] Devaraj K commented on SPARK-4117: -- Thanks [~tgraves] for the pointer. I will provide PR

[jira] [Comment Edited] (SPARK-8360) Streaming DataFrames

2015-12-02 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035335#comment-15035335 ] Cheng Hao edited comment on SPARK-8360 at 12/2/15 12:14 PM: Re

[jira] [Updated] (SPARK-8360) Streaming DataFrames

2015-12-02 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-8360: - Attachment: StreamingDataFrameProposal.pdf This is a proposal for streaming dataframes that we were trying

[jira] [Commented] (SPARK-11596) SQL execution very slow for nested query plans because of DataFrame.withNewExecutionId

2015-12-02 Thread Cristian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035700#comment-15035700 ] Cristian commented on SPARK-11596: -- That's great, thank you > SQL execution very slow f

[jira] [Commented] (SPARK-7889) Jobs progress of apps on complete page of HistoryServer shows uncompleted

2015-12-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035678#comment-15035678 ] Steve Loughran commented on SPARK-7889: --- While I work on this, I suspect one of the

[jira] [Commented] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-12-02 Thread Radoslaw Gruchalski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035632#comment-15035632 ] Radoslaw Gruchalski commented on SPARK-11638: - No problem, wasn't aware. "New

[jira] [Updated] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9972: - Target Version/s: (was: 1.6.0) > Add `struct`, `encode` and `decode` function in SparkR > --

[jira] [Updated] (SPARK-11822) Add docs for new Netty RPC configuration

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11822: -- Target Version/s: (was: 1.6.0) Priority: Minor (was: Major) > Add docs for new Netty RPC

[jira] [Updated] (SPARK-10043) Add window functions into SparkR

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10043: -- Target Version/s: (was: 1.6.0) > Add window functions into SparkR >

[jira] [Updated] (SPARK-9857) Add expression functions into SparkR which conflict with the existing R's generic

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9857: - Target Version/s: (was: 1.6.0) > Add expression functions into SparkR which conflict with the existing R

[jira] [Updated] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11638: -- Target Version/s: (was: 1.4.0, 1.4.1, 1.5.0, 1.5.1, 1.5.2, 1.6.0) [~radekg] don't set Target version

[jira] [Updated] (SPARK-10436) spark-submit overwrites spark.files defaults with the job script filename

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10436: -- Target Version/s: (was: 1.6.0) > spark-submit overwrites spark.files defaults with the job script fil

[jira] [Updated] (SPARK-11905) [SQL] Support Persist/Cache and Unpersist in Dataset APIs

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11905: -- Assignee: Xiao Li > [SQL] Support Persist/Cache and Unpersist in Dataset APIs > ---

[jira] [Updated] (SPARK-12084) Fix codes that uses ByteBuffer.array incorrectly

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12084: -- Component/s: Spark Core > Fix codes that uses ByteBuffer.array incorrectly > --

[jira] [Updated] (SPARK-12068) use a single column in Dataset.groupBy and count will fail

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12068: -- Assignee: Wenchen Fan > use a single column in Dataset.groupBy and count will fail > --

[jira] [Commented] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035604#comment-15035604 ] Apache Spark commented on SPARK-12048: -- User 'rh99' has created a pull request for t

[jira] [Assigned] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12048: Assignee: Apache Spark > JDBCRDD calls close() twice - SQLite then throws an exception > -

[jira] [Assigned] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11605: Assignee: yuhao yang (was: Apache Spark) > ML 1.6 QA: API: Java compatibility, docs > ---

[jira] [Commented] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035605#comment-15035605 ] Apache Spark commented on SPARK-11605: -- User 'hhbyyh' has created a pull request for

[jira] [Assigned] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11605: Assignee: Apache Spark (was: yuhao yang) > ML 1.6 QA: API: Java compatibility, docs > ---

[jira] [Assigned] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12048: Assignee: (was: Apache Spark) > JDBCRDD calls close() twice - SQLite then throws an ex

[jira] [Commented] (SPARK-11939) PySpark support model export/import for Pipeline API

2015-12-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035600#comment-15035600 ] Yanbo Liang commented on SPARK-11939: - OK, I will make an umbrella for this feature.

[jira] [Commented] (SPARK-12016) word2vec load model can't use findSynonyms to get words

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035580#comment-15035580 ] Apache Spark commented on SPARK-12016: -- User 'viirya' has created a pull request for

[jira] [Resolved] (SPARK-3580) Add Consistent Method To Get Number of RDD Partitions Across Different Languages

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3580. -- Resolution: Fixed Assignee: Jeroen Schot Fix Version/s: 1.6.0 Resolved by https://github

[jira] [Commented] (SPARK-12094) Better format for query plan tree string

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035539#comment-15035539 ] Apache Spark commented on SPARK-12094: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-12094) Better format for query plan tree string

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12094: Assignee: Apache Spark (was: Cheng Lian) > Better format for query plan tree string > ---

[jira] [Assigned] (SPARK-12094) Better format for query plan tree string

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12094: Assignee: Cheng Lian (was: Apache Spark) > Better format for query plan tree string > ---

[jira] [Updated] (SPARK-12080) Kryo - Support multiple user registrators

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12080: -- Affects Version/s: (was: 1.6.1) 1.5.2 > Kryo - Support multiple user registr

[jira] [Updated] (SPARK-12094) Better format for query plan tree string

2015-12-02 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12094: --- Description: When examine plans of complex queries with multiple joins, a pain point of mine is that

[jira] [Updated] (SPARK-12093) Fix the error of comment in DDLParser

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12093: -- Priority: Trivial (was: Major) Component/s: Documentation [~waterman] This probably isn't worth

[jira] [Updated] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column

2015-12-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12067: Summary: Fix usage of isnan, isnull, isnotnull of Column (was: Fix usage of isnan, isnull, isnotnu

[jira] [Updated] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column and DataFrame

2015-12-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12067: Description: * -SPARK-11947 has deprecated DataFrame.isNaN, DataFrame.isNull and replaced by DataF

[jira] [Updated] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column and DataFrame

2015-12-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12067: Description: -* SPARK-11947 has deprecated DataFrame.isNaN, DataFrame.isNull and replaced by DataF

[jira] [Updated] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column and DataFrame

2015-12-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12067: Description: * -SPARK-11947 has deprecated DataFrame.isNaN, DataFrame.isNull and replaced by DataF

[jira] [Commented] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035521#comment-15035521 ] Sean Owen commented on SPARK-12048: --- You need to read https://cwiki.apache.org/conflue

[jira] [Created] (SPARK-12094) Better format for query plan tree string

2015-12-02 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12094: -- Summary: Better format for query plan tree string Key: SPARK-12094 URL: https://issues.apache.org/jira/browse/SPARK-12094 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column and DataFrame

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035496#comment-15035496 ] Apache Spark commented on SPARK-12067: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-02 Thread R. H. (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035486#comment-15035486 ] R. H. commented on SPARK-12048: --- I have added the missing line, built a distribution, and t

[jira] [Comment Edited] (SPARK-11964) Create user guide section explaining export/import

2015-12-02 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035480#comment-15035480 ] Bill Chambers edited comment on SPARK-11964 at 12/2/15 8:52 AM: ---

[jira] [Commented] (SPARK-11964) Create user guide section explaining export/import

2015-12-02 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035480#comment-15035480 ] Bill Chambers commented on SPARK-11964: --- quick question, am I to assume that all pi

[jira] [Assigned] (SPARK-12093) Fix the error of comment in DDLParser

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12093: Assignee: (was: Apache Spark) > Fix the error of comment in DDLParser > --

[jira] [Assigned] (SPARK-12093) Fix the error of comment in DDLParser

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12093: Assignee: Apache Spark > Fix the error of comment in DDLParser > -

[jira] [Commented] (SPARK-12093) Fix the error of comment in DDLParser

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035462#comment-15035462 ] Apache Spark commented on SPARK-12093: -- User 'watermen' has created a pull request f

[jira] [Created] (SPARK-12093) Fix the error of comment in DDLParser

2015-12-02 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-12093: - Summary: Fix the error of comment in DDLParser Key: SPARK-12093 URL: https://issues.apache.org/jira/browse/SPARK-12093 Project: Spark Issue Type: Documentation

[jira] [Assigned] (SPARK-12088) check connection.isClose before connection.getAutoCommit in JDBCRDD.close

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12088: Assignee: (was: Apache Spark) > check connection.isClose before connection.getAutoComm

[jira] [Assigned] (SPARK-12088) check connection.isClose before connection.getAutoCommit in JDBCRDD.close

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12088: Assignee: Apache Spark > check connection.isClose before connection.getAutoCommit in JDBCR

[jira] [Commented] (SPARK-12088) check connection.isClose before connection.getAutoCommit in JDBCRDD.close

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035455#comment-15035455 ] Apache Spark commented on SPARK-12088: -- User 'huaxingao' has created a pull request

<    1   2   3