[jira] [Created] (SPARK-9166) Hide JVM stack trace for IllegalArgumentException in Python

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9166: -- Summary: Hide JVM stack trace for IllegalArgumentException in Python Key: SPARK-9166 URL: https://issues.apache.org/jira/browse/SPARK-9166 Project: Spark Issue

[jira] [Closed] (SPARK-7981) Improve DataFrame Python exception

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-7981. -- Resolution: Duplicate Assignee: Davies Liu Fix Version/s: 1.5.0 Improve DataFrame

[jira] [Commented] (SPARK-8240) string function: concat

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632292#comment-14632292 ] Apache Spark commented on SPARK-8240: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8240) string function: concat

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-8240: -- Assignee: Reynold Xin (was: Cheng Hao) string function: concat ---

[jira] [Commented] (SPARK-8240) string function: concat

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632294#comment-14632294 ] Reynold Xin commented on SPARK-8240: [~adrian-wang] I had some time tonight and wrote

[jira] [Created] (SPARK-9151) Implement code generation for Abs

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9151: -- Summary: Implement code generation for Abs Key: SPARK-9151 URL: https://issues.apache.org/jira/browse/SPARK-9151 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9169) Improve unit test coverage for null expressions

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632342#comment-14632342 ] Apache Spark commented on SPARK-9169: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-9169) Improve unit test coverage for null expressions

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9169: -- Summary: Improve unit test coverage for null expressions Key: SPARK-9169 URL: https://issues.apache.org/jira/browse/SPARK-9169 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9169) Improve unit test coverage for null expressions

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9169: --- Assignee: Apache Spark (was: Reynold Xin) Improve unit test coverage for null expressions

[jira] [Updated] (SPARK-7218) Create a real iterator with open/close for Spark SQL

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7218: --- Target Version/s: 1.6.0 Create a real iterator with open/close for Spark SQL

[jira] [Commented] (SPARK-9150) Create a trait to track code generation for expressions

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632311#comment-14632311 ] Apache Spark commented on SPARK-9150: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-9150) Create a trait to track code generation for expressions

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9150: --- Summary: Create a trait to track code generation for expressions (was: Create a trait to track lack

[jira] [Created] (SPARK-9150) Create a trait to track lack of code generation for expressions

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9150: -- Summary: Create a trait to track lack of code generation for expressions Key: SPARK-9150 URL: https://issues.apache.org/jira/browse/SPARK-9150 Project: Spark

[jira] [Comment Edited] (SPARK-4867) UDF clean up

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632319#comment-14632319 ] Reynold Xin edited comment on SPARK-4867 at 7/18/15 7:37 AM: -

[jira] [Resolved] (SPARK-4867) UDF clean up

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4867. Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.5.0 I believe this is done

[jira] [Assigned] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9019: --- Assignee: Apache Spark spark-submit fails on yarn with kerberos enabled

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-18 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632341#comment-14632341 ] Bolke de Bruin commented on SPARK-9019: --- I have created PR-#7489 for this issue.

[jira] [Assigned] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9019: --- Assignee: (was: Apache Spark) spark-submit fails on yarn with kerberos enabled

[jira] [Issue Comment Deleted] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-18 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-9019: -- Comment: was deleted (was: I have created PR-#7489 for this issue. ) spark-submit fails on

[jira] [Created] (SPARK-9161) Implement code generation for FormatNumber

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9161: -- Summary: Implement code generation for FormatNumber Key: SPARK-9161 URL: https://issues.apache.org/jira/browse/SPARK-9161 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9163) Implement code generation for Conv

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9163: -- Summary: Implement code generation for Conv Key: SPARK-9163 URL: https://issues.apache.org/jira/browse/SPARK-9163 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9159) Implement code generation for Ascii, Base64, and UnBase64

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9159: -- Summary: Implement code generation for Ascii, Base64, and UnBase64 Key: SPARK-9159 URL: https://issues.apache.org/jira/browse/SPARK-9159 Project: Spark Issue

[jira] [Created] (SPARK-9158) PyLint should only fail on error

2015-07-18 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9158: - Summary: PyLint should only fail on error Key: SPARK-9158 URL: https://issues.apache.org/jira/browse/SPARK-9158 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9160) Implement code generation for Encode and Decode

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9160: -- Summary: Implement code generation for Encode and Decode Key: SPARK-9160 URL: https://issues.apache.org/jira/browse/SPARK-9160 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-5288) Stabilize Spark SQL data type API followup

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5288. Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.5.0 I think everything

[jira] [Updated] (SPARK-8829) Improve expression performance

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8829: --- Description: This is an umbrella ticket for various improvements to DataFrame and SQL expression

[jira] [Resolved] (SPARK-5295) Stabilize data types

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5295. Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.5.0 I believe the

[jira] [Updated] (SPARK-9081) fillna/dropna should also fill/drop NaN values in addition to null values

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9081: --- Priority: Blocker (was: Major) fillna/dropna should also fill/drop NaN values in addition to null

[jira] [Assigned] (SPARK-9167) call `millisToDays` in `stringToDate`

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9167: --- Assignee: (was: Apache Spark) call `millisToDays` in `stringToDate`

[jira] [Commented] (SPARK-9167) call `millisToDays` in `stringToDate`

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632328#comment-14632328 ] Apache Spark commented on SPARK-9167: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9167) call `millisToDays` in `stringToDate`

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9167: --- Assignee: Apache Spark call `millisToDays` in `stringToDate`

[jira] [Updated] (SPARK-9167) use UTC Calendar in `stringToDate`

2015-07-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9167: --- Summary: use UTC Calendar in `stringToDate` (was: call `millisToDays` in `stringToDate`) use UTC

[jira] [Assigned] (SPARK-9055) WidenTypes should also support Intersect and Except

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9055: --- Assignee: Apache Spark WidenTypes should also support Intersect and Except

[jira] [Commented] (SPARK-9055) WidenTypes should also support Intersect and Except

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632344#comment-14632344 ] Apache Spark commented on SPARK-9055: - User 'yijieshen' has created a pull request for

[jira] [Assigned] (SPARK-9055) WidenTypes should also support Intersect and Except

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9055: --- Assignee: (was: Apache Spark) WidenTypes should also support Intersect and Except

[jira] [Assigned] (SPARK-9150) Create a trait to track code generation for expressions

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9150: --- Assignee: Reynold Xin (was: Apache Spark) Create a trait to track code generation for

[jira] [Updated] (SPARK-9150) Create CodegenFallback and Unevaluable trait

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9150: --- Description: It is very hard to track which expression supports code generation or not. This patch

[jira] [Assigned] (SPARK-9150) Create a trait to track code generation for expressions

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9150: --- Assignee: Apache Spark (was: Reynold Xin) Create a trait to track code generation for

[jira] [Updated] (SPARK-9150) Create CodegenFallback and Unevaluable trait

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9150: --- Summary: Create CodegenFallback and Unevaluable trait (was: Create a trait to track code generation

[jira] [Created] (SPARK-9164) Implement code generation for Hex and Unhex

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9164: -- Summary: Implement code generation for Hex and Unhex Key: SPARK-9164 URL: https://issues.apache.org/jira/browse/SPARK-9164 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9162) Implement code generation for ScalaUDF

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9162: -- Summary: Implement code generation for ScalaUDF Key: SPARK-9162 URL: https://issues.apache.org/jira/browse/SPARK-9162 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9165) Implement code generation for CreateArray, CreateStruct, and CreateNamedStruct

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9165: -- Summary: Implement code generation for CreateArray, CreateStruct, and CreateNamedStruct Key: SPARK-9165 URL: https://issues.apache.org/jira/browse/SPARK-9165 Project:

[jira] [Created] (SPARK-9167) call `millisToDays` in `stringToDate`

2015-07-18 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-9167: -- Summary: call `millisToDays` in `stringToDate` Key: SPARK-9167 URL: https://issues.apache.org/jira/browse/SPARK-9167 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9156) Implement code generation for StringSplit

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9156: -- Summary: Implement code generation for StringSplit Key: SPARK-9156 URL: https://issues.apache.org/jira/browse/SPARK-9156 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9153) Implement code generation for StringLPad and StringRPad

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9153: -- Summary: Implement code generation for StringLPad and StringRPad Key: SPARK-9153 URL: https://issues.apache.org/jira/browse/SPARK-9153 Project: Spark Issue

[jira] [Created] (SPARK-9152) Implement code generation for Like and RLike

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9152: -- Summary: Implement code generation for Like and RLike Key: SPARK-9152 URL: https://issues.apache.org/jira/browse/SPARK-9152 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9154) Implement code generation for StringFormat

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9154: -- Summary: Implement code generation for StringFormat Key: SPARK-9154 URL: https://issues.apache.org/jira/browse/SPARK-9154 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9155) Implement code generation for StringSpace

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9155: -- Summary: Implement code generation for StringSpace Key: SPARK-9155 URL: https://issues.apache.org/jira/browse/SPARK-9155 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9168) Add nanvl expression

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9168: -- Summary: Add nanvl expression Key: SPARK-9168 URL: https://issues.apache.org/jira/browse/SPARK-9168 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632340#comment-14632340 ] Apache Spark commented on SPARK-9019: - User 'bolkedebruin' has created a pull request

[jira] [Assigned] (SPARK-9169) Improve unit test coverage for null expressions

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9169: --- Assignee: Reynold Xin (was: Apache Spark) Improve unit test coverage for null expressions

[jira] [Created] (SPARK-9170) ORC data source creates a schema with lowercase table names

2015-07-18 Thread Peter Rudenko (JIRA)
Peter Rudenko created SPARK-9170: Summary: ORC data source creates a schema with lowercase table names Key: SPARK-9170 URL: https://issues.apache.org/jira/browse/SPARK-9170 Project: Spark

[jira] [Updated] (SPARK-9170) ORC data source creates a schema with lowercase table names

2015-07-18 Thread Peter Rudenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Rudenko updated SPARK-9170: - Description: Steps to reproduce: {code} sqlContext.range(0, 10).select('id as

[jira] [Commented] (SPARK-9059) Update Direct Kafka Word count examples to show the use of HasOffsetRanges

2015-07-18 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632476#comment-14632476 ] Cody Koeninger commented on SPARK-9059: --- How is this different from SPARK-8390 ? I

[jira] [Assigned] (SPARK-9094) Increase io.dropwizard.metrics dependency to 3.1.2

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9094: --- Assignee: (was: Apache Spark) Increase io.dropwizard.metrics dependency to 3.1.2

[jira] [Updated] (SPARK-9094) Increase io.dropwizard.metrics dependency to 3.1.2

2015-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Anders Düvel updated SPARK-9094: - Description: This change is described in pull request:

[jira] [Assigned] (SPARK-9094) Increase io.dropwizard.metrics dependency to 3.1.2

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9094: --- Assignee: Apache Spark Increase io.dropwizard.metrics dependency to 3.1.2

[jira] [Commented] (SPARK-9094) Increase io.dropwizard.metrics dependency to 3.1.2

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632377#comment-14632377 ] Apache Spark commented on SPARK-9094: - User 'hackbert' has created a pull request for

[jira] [Commented] (SPARK-9171) add and improve tests for nondeterministic expressions

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632425#comment-14632425 ] Apache Spark commented on SPARK-9171: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9171) add and improve tests for nondeterministic expressions

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9171: --- Assignee: (was: Apache Spark) add and improve tests for nondeterministic expressions

[jira] [Updated] (SPARK-9094) Increase io.dropwizard.metrics dependency to 3.1.2

2015-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Anders Düvel updated SPARK-9094: - External issue URL: https://github.com/apache/spark/pull/7493 (was:

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632373#comment-14632373 ] Apache Spark commented on SPARK-6910: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8951) support CJK characters in collect()

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8951: --- Assignee: Apache Spark support CJK characters in collect()

[jira] [Commented] (SPARK-8951) support CJK characters in collect()

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632408#comment-14632408 ] Apache Spark commented on SPARK-8951: - User 'CHOIJAEHONG1' has created a pull request

[jira] [Assigned] (SPARK-8951) support CJK characters in collect()

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8951: --- Assignee: (was: Apache Spark) support CJK characters in collect()

[jira] [Created] (SPARK-9171) add and improve tests for nondeterministic expressions

2015-07-18 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-9171: -- Summary: add and improve tests for nondeterministic expressions Key: SPARK-9171 URL: https://issues.apache.org/jira/browse/SPARK-9171 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9171) add and improve tests for nondeterministic expressions

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9171: --- Assignee: Apache Spark add and improve tests for nondeterministic expressions

[jira] [Commented] (SPARK-9081) fillna/dropna should also fill/drop NaN values in addition to null values

2015-07-18 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632469#comment-14632469 ] Yijie Shen commented on SPARK-9081: --- OK, I'll take this fillna/dropna should also

[jira] [Commented] (SPARK-9142) Removing unnecessary self types in Catalyst

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632422#comment-14632422 ] Apache Spark commented on SPARK-9142: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-9059) Update Direct Kafka Word count examples to show the use of HasOffsetRanges

2015-07-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632528#comment-14632528 ] Sean Owen commented on SPARK-9059: -- Yeah closing this as a duplicate unless someone can

[jira] [Resolved] (SPARK-8390) Update DirectKafkaWordCount examples to show how offset ranges can be used

2015-07-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8390. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 Target Version/s:

[jira] [Assigned] (SPARK-9151) Implement code generation for Abs

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9151: --- Assignee: (was: Apache Spark) Implement code generation for Abs

[jira] [Assigned] (SPARK-9151) Implement code generation for Abs

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9151: --- Assignee: Apache Spark Implement code generation for Abs -

[jira] [Updated] (SPARK-9151) Implement code generation for Abs

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9151: --- Assignee: Liang-Chi Hsieh Implement code generation for Abs -

[jira] [Updated] (SPARK-8159) Improve expression function coverage

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8159: --- Summary: Improve expression function coverage (was: Improve SQL/DataFrame expression coverage)

[jira] [Updated] (SPARK-9171) add and improve tests for nondeterministic expressions

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9171: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-8159 add and improve tests for

[jira] [Resolved] (SPARK-9151) Implement code generation for Abs

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9151. Resolution: Fixed Fix Version/s: 1.5.0 Implement code generation for Abs

[jira] [Assigned] (SPARK-9101) Can't use null in selectExpr

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9101: --- Assignee: Apache Spark Can't use null in selectExpr

[jira] [Commented] (SPARK-9101) Can't use null in selectExpr

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632571#comment-14632571 ] Apache Spark commented on SPARK-9101: - User 'sixers' has created a pull request for

[jira] [Resolved] (SPARK-8240) string function: concat

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8240. Resolution: Fixed Fix Version/s: 1.5.0 string function: concat ---

[jira] [Closed] (SPARK-9109) Unpersist a graph object does not work properly

2015-07-18 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE closed SPARK-9109. --- Resolution: Fixed The change has been merged at https://github.com/apache/spark/pull/7469

[jira] [Commented] (SPARK-7961) Redesign SQLConf for better error message reporting

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632593#comment-14632593 ] Reynold Xin commented on SPARK-7961: [~zsxwing] I tried this today, and it looks like

[jira] [Created] (SPARK-9174) Add documentation for all public SQLConfs

2015-07-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9174: -- Summary: Add documentation for all public SQLConfs Key: SPARK-9174 URL: https://issues.apache.org/jira/browse/SPARK-9174 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-9174) Add documentation for all public SQLConfs

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9174. Resolution: Fixed Fix Version/s: 1.5.0 Add documentation for all public SQLConfs

[jira] [Resolved] (SPARK-9055) WidenTypes should also support Intersect and Except in addition to Union

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9055. Resolution: Fixed Assignee: Yijie Shen Fix Version/s: 1.5.0 WidenTypes should also

[jira] [Commented] (SPARK-9174) Add documentation for all public SQLConfs

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632595#comment-14632595 ] Apache Spark commented on SPARK-9174: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9174) Add documentation for all public SQLConfs

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9174: --- Assignee: Apache Spark (was: Reynold Xin) Add documentation for all public SQLConfs

[jira] [Assigned] (SPARK-9174) Add documentation for all public SQLConfs

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9174: --- Assignee: Reynold Xin (was: Apache Spark) Add documentation for all public SQLConfs

[jira] [Commented] (SPARK-8278) Remove deprecated JsonRDD functionality in Spark SQL

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632596#comment-14632596 ] Apache Spark commented on SPARK-8278: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-6793) Implement perplexity for LDA

2015-07-18 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632598#comment-14632598 ] Feynman Liang commented on SPARK-6793: -- I'm working on this. Implement perplexity

[jira] [Commented] (SPARK-5567) Add prediction methods to LDA

2015-07-18 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632597#comment-14632597 ] Feynman Liang commented on SPARK-5567: -- I'm working on this. Add prediction methods

[jira] [Updated] (SPARK-7690) MulticlassClassificationEvaluator for tuning Multiclass Classifiers

2015-07-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7690: - Shepherd: Joseph K. Bradley (was: Ram Sriharsha) MulticlassClassificationEvaluator for tuning

[jira] [Updated] (SPARK-7690) MulticlassClassificationEvaluator for tuning Multiclass Classifiers

2015-07-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7690: - Issue Type: New Feature (was: Improvement) MulticlassClassificationEvaluator for tuning

[jira] [Commented] (SPARK-9151) Implement code generation for Abs

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632533#comment-14632533 ] Apache Spark commented on SPARK-9151: - User 'viirya' has created a pull request for

[jira] [Resolved] (SPARK-9169) Improve unit test coverage for null expressions

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9169. Resolution: Fixed Fix Version/s: 1.5.0 Improve unit test coverage for null expressions

[jira] [Resolved] (SPARK-9171) add and improve tests for nondeterministic expressions

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9171. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 add and improve tests

[jira] [Commented] (SPARK-9166) Hide JVM stack trace for IllegalArgumentException in Python

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632494#comment-14632494 ] Apache Spark commented on SPARK-9166: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-9166) Hide JVM stack trace for IllegalArgumentException in Python

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9166: --- Assignee: (was: Apache Spark) Hide JVM stack trace for IllegalArgumentException in

[jira] [Assigned] (SPARK-9166) Hide JVM stack trace for IllegalArgumentException in Python

2015-07-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9166: --- Assignee: Apache Spark Hide JVM stack trace for IllegalArgumentException in Python

[jira] [Resolved] (SPARK-9167) use UTC Calendar in `stringToDate`

2015-07-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9167. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 use UTC Calendar in

  1   2   >