[jira] [Commented] (SPARK-21366) Add sql test for window functions

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080720#comment-16080720 ] Apache Spark commented on SPARK-21366: -- User 'jiangxb1987' has created a pull reques

[jira] [Updated] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21367: - Description: Getting this message from a recent build. https://amplab.cs.berkeley.edu/jenkins/jo

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080728#comment-16080728 ] Felix Cheung edited comment on SPARK-21367 at 7/10/17 5:45 PM:

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080728#comment-16080728 ] Felix Cheung commented on SPARK-21367: -- @shane knapp could you check? thanks! > R o

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080728#comment-16080728 ] Felix Cheung edited comment on SPARK-21367 at 7/10/17 5:44 PM:

[jira] [Created] (SPARK-21366) Add sql test for window functions

2017-07-10 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-21366: Summary: Add sql test for window functions Key: SPARK-21366 URL: https://issues.apache.org/jira/browse/SPARK-21366 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-21367) R older version of Roxygen2 on Jenkins

2017-07-10 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21367: Summary: R older version of Roxygen2 on Jenkins Key: SPARK-21367 URL: https://issues.apache.org/jira/browse/SPARK-21367 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-21266) Support schema a DDL-formatted string in dapply/gapply/from_json

2017-07-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21266. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0 Targe

[jira] [Assigned] (SPARK-21366) Add sql test for window functions

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21366: Assignee: Apache Spark > Add sql test for window functions > -

[jira] [Assigned] (SPARK-21365) Deduplicate logics parsing DDL-like type definition

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21365: Assignee: (was: Apache Spark) > Deduplicate logics parsing DDL-like type definition >

[jira] [Assigned] (SPARK-21365) Deduplicate logics parsing DDL-like type definition

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21365: Assignee: Apache Spark > Deduplicate logics parsing DDL-like type definition > ---

[jira] [Commented] (SPARK-21365) Deduplicate logics parsing DDL-like type definition

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080665#comment-16080665 ] Apache Spark commented on SPARK-21365: -- User 'HyukjinKwon' has created a pull reques

[jira] [Created] (SPARK-21365) Deduplicate logics parsing DDL-like type definition

2017-07-10 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-21365: Summary: Deduplicate logics parsing DDL-like type definition Key: SPARK-21365 URL: https://issues.apache.org/jira/browse/SPARK-21365 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-21272) SortMergeJoin LeftAnti does not update numOutputRows

2017-07-10 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21272. - Resolution: Fixed Assignee: Juliusz Sompolski Fix Version/s: 2.3.0 2.2.

[jira] [Created] (SPARK-21364) IndexOutOfBoundsException on equality check of two complex array elements

2017-07-10 Thread Vivek Patangiwar (JIRA)
Vivek Patangiwar created SPARK-21364: Summary: IndexOutOfBoundsException on equality check of two complex array elements Key: SPARK-21364 URL: https://issues.apache.org/jira/browse/SPARK-21364 Pro

[jira] [Comment Edited] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2017-07-10 Thread Dominic Ricard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080503#comment-16080503 ] Dominic Ricard edited comment on SPARK-21067 at 7/10/17 3:43 PM: --

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2017-07-10 Thread Dominic Ricard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080503#comment-16080503 ] Dominic Ricard commented on SPARK-21067: Interesting findings today. - Open Sess

[jira] [Commented] (SPARK-20928) Continuous Processing Mode for Structured Streaming

2017-07-10 Thread Ihor Bobak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080485#comment-16080485 ] Ihor Bobak commented on SPARK-20928: Dear All, on this video https://www.youtube.com

[jira] [Created] (SPARK-21363) Prevent column name duplication in temporary view

2017-07-10 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-21363: Summary: Prevent column name duplication in temporary view Key: SPARK-21363 URL: https://issues.apache.org/jira/browse/SPARK-21363 Project: Spark Iss

[jira] [Created] (SPARK-21362) Add JDBCDialect for Apache Drill

2017-07-10 Thread David Radford (JIRA)
David Radford created SPARK-21362: - Summary: Add JDBCDialect for Apache Drill Key: SPARK-21362 URL: https://issues.apache.org/jira/browse/SPARK-21362 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2017-07-10 Thread Dominic Ricard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080399#comment-16080399 ] Dominic Ricard commented on SPARK-21067: [~q79969786] Using the setting proposed,

[jira] [Commented] (SPARK-19659) Fetch big blocks to disk when shuffle-read

2017-07-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080351#comment-16080351 ] Wenchen Fan commented on SPARK-19659: - I think spark 1.6 client can talk to spark 2.2

[jira] [Commented] (SPARK-21359) frequency discretizer

2017-07-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080339#comment-16080339 ] Sean Owen commented on SPARK-21359: --- No, what you are describing is pretty much the def

[jira] [Commented] (SPARK-19659) Fetch big blocks to disk when shuffle-read

2017-07-10 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080340#comment-16080340 ] Thomas Graves commented on SPARK-19659: --- can you be more specific here, do you mean

[jira] [Updated] (SPARK-21342) Fix DownloadCallback to work well with RetryingBlockFetcher

2017-07-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-21342: Affects Version/s: (was: 2.1.1) 2.2.0 > Fix DownloadCallback to work wel

[jira] [Assigned] (SPARK-21342) Fix DownloadCallback to work well with RetryingBlockFetcher

2017-07-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21342: --- Assignee: jin xing > Fix DownloadCallback to work well with RetryingBlockFetcher > -

[jira] [Resolved] (SPARK-21342) Fix DownloadCallback to work well with RetryingBlockFetcher

2017-07-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21342. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull req

[jira] [Updated] (SPARK-21360) Spark failing to query SQL Server. Query contains a column having space in where clause

2017-07-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21360: -- Priority: Major (was: Blocker) [~ferozkhan] please back up and read http://spark.apache.org/contributi

[jira] [Resolved] (SPARK-21361) Spark failing to query SQL Server. Query contains a column having space in where clause

2017-07-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21361. --- Resolution: Duplicate > Spark failing to query SQL Server. Query contains a column having space in

[jira] [Commented] (SPARK-21359) frequency discretizer

2017-07-10 Thread Fu Shanshan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080235#comment-16080235 ] Fu Shanshan commented on SPARK-21359: - so the the difference between QuantileDiscreti

[jira] [Created] (SPARK-21361) Spark failing to query SQL Server. Query contains a column having space in where clause

2017-07-10 Thread feroz khan (JIRA)
feroz khan created SPARK-21361: -- Summary: Spark failing to query SQL Server. Query contains a column having space in where clause Key: SPARK-21361 URL: https://issues.apache.org/jira/browse/SPARK-21361

[jira] [Created] (SPARK-21360) Spark failing to query SQL Server. Query contains a column having space in where clause

2017-07-10 Thread feroz khan (JIRA)
feroz khan created SPARK-21360: -- Summary: Spark failing to query SQL Server. Query contains a column having space in where clause Key: SPARK-21360 URL: https://issues.apache.org/jira/browse/SPARK-21360

[jira] [Commented] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080200#comment-16080200 ] Apache Spark commented on SPARK-16872: -- User 'zhengruifeng' has created a pull reque

[jira] [Commented] (SPARK-21359) frequency discretizer

2017-07-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080080#comment-16080080 ] Sean Owen commented on SPARK-21359: --- I can't understand from this code what the functio

[jira] [Commented] (SPARK-12559) Cluster mode doesn't work with --packages

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080101#comment-16080101 ] Apache Spark commented on SPARK-12559: -- User 'skonto' has created a pull request for

[jira] [Assigned] (SPARK-21358) Argument of repartitionandsortwithinpartitions at pyspark

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21358: Assignee: Apache Spark > Argument of repartitionandsortwithinpartitions at pyspark > -

[jira] [Assigned] (SPARK-21358) Argument of repartitionandsortwithinpartitions at pyspark

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21358: Assignee: (was: Apache Spark) > Argument of repartitionandsortwithinpartitions at pysp

[jira] [Commented] (SPARK-21358) Argument of repartitionandsortwithinpartitions at pyspark

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080099#comment-16080099 ] Apache Spark commented on SPARK-21358: -- User 'chie8842' has created a pull request f

[jira] [Assigned] (SPARK-21359) frequency discretizer

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21359: Assignee: (was: Apache Spark) > frequency discretizer > - > >

[jira] [Assigned] (SPARK-21359) frequency discretizer

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21359: Assignee: Apache Spark > frequency discretizer > - > >

[jira] [Commented] (SPARK-21359) frequency discretizer

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080060#comment-16080060 ] Apache Spark commented on SPARK-21359: -- User 'Shanshan-IC' has created a pull reques

[jira] [Created] (SPARK-21359) frequency discretizer

2017-07-10 Thread Fu Shanshan (JIRA)
Fu Shanshan created SPARK-21359: --- Summary: frequency discretizer Key: SPARK-21359 URL: https://issues.apache.org/jira/browse/SPARK-21359 Project: Spark Issue Type: New JIRA Project Co

[jira] [Commented] (SPARK-15526) Shade JPMML

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080038#comment-16080038 ] Apache Spark commented on SPARK-15526: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-21332) Incorrect result type inferred for some decimal expressions

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21332: Assignee: Apache Spark > Incorrect result type inferred for some decimal expressions > ---

[jira] [Assigned] (SPARK-15526) Shade JPMML

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15526: Assignee: (was: Apache Spark) > Shade JPMML > --- > > Key: SPA

[jira] [Assigned] (SPARK-15526) Shade JPMML

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15526: Assignee: Apache Spark > Shade JPMML > --- > > Key: SPARK-15526 >

[jira] [Issue Comment Deleted] (SPARK-21337) SQL which has large ‘case when’ expressions may cause code generation beyond 64KB

2017-07-10 Thread fengchaoge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-21337: --- Comment: was deleted (was: thank you very much, what should i do for next? Thank you for your guidan

[jira] [Issue Comment Deleted] (SPARK-21337) SQL which has large ‘case when’ expressions may cause code generation beyond 64KB

2017-07-10 Thread fengchaoge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengchaoge updated SPARK-21337: --- Comment: was deleted (was: 1. create database GBD_DM_PAC_SAFE; 2. use GBD_DM_PAC_SAFE; 3. create tab

[jira] [Commented] (SPARK-21332) Incorrect result type inferred for some decimal expressions

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080029#comment-16080029 ] Apache Spark commented on SPARK-21332: -- User 'aokolnychyi' has created a pull reques

[jira] [Assigned] (SPARK-21332) Incorrect result type inferred for some decimal expressions

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21332: Assignee: (was: Apache Spark) > Incorrect result type inferred for some decimal expres

[jira] [Assigned] (SPARK-20460) Make it more consistent to handle column name duplication

2017-07-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20460: --- Assignee: Takeshi Yamamuro > Make it more consistent to handle column name duplication > ---

[jira] [Resolved] (SPARK-20460) Make it more consistent to handle column name duplication

2017-07-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20460. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 17758 [https://githu

[jira] [Commented] (SPARK-19938) java.lang.ClassCastException: cannot assign instance of scala.collection.immutable.List$SerializationProxy to field

2017-07-10 Thread Siarhei Navatski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16079985#comment-16079985 ] Siarhei Navatski commented on SPARK-19938: -- [~sthallam] Have you resolve your is

[jira] [Commented] (SPARK-17742) Spark Launcher does not get failed state in Listener

2017-07-10 Thread slee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16079959#comment-16079959 ] slee commented on SPARK-17742: -- Is anybody working on this? If no, I can help. > Spark Laun

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

2017-07-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16079954#comment-16079954 ] Wenchen Fan commented on SPARK-21190: - [~bryanc] You example works because Python is

[jira] [Assigned] (SPARK-18619) Make QuantileDiscretizer/Bucketizer/StringIndexer inherit from HasHandleInvalid

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18619: Assignee: Apache Spark > Make QuantileDiscretizer/Bucketizer/StringIndexer inherit from >

[jira] [Commented] (SPARK-18619) Make QuantileDiscretizer/Bucketizer/StringIndexer inherit from HasHandleInvalid

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16079963#comment-16079963 ] Apache Spark commented on SPARK-18619: -- User 'zhengruifeng' has created a pull reque

[jira] [Assigned] (SPARK-18619) Make QuantileDiscretizer/Bucketizer/StringIndexer inherit from HasHandleInvalid

2017-07-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18619: Assignee: (was: Apache Spark) > Make QuantileDiscretizer/Bucketizer/StringIndexer inhe

<    1   2