[jira] [Commented] (SPARK-24581) Design: BarrierTaskContext.barrier()

[ https://issues.apache.org/jira/browse/SPARK-24581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577893#comment-16577893 ] zhengruifeng commented on SPARK-24581: -- It maybe meaningful to support resettable i

[jira] [Commented] (SPARK-10697) Lift Calculation in Association Rule mining

[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577886#comment-16577886 ] Akhil Sakarwal commented on SPARK-10697: Is there any update on this issue . By

[jira] [Assigned] (SPARK-25097) Support prediction on single instance in KMeans/BiKMeans/GMM

[ https://issues.apache.org/jira/browse/SPARK-25097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25097: Assignee: Apache Spark > Support prediction on single instance in KMeans/BiKMeans/GMM > -

[jira] [Commented] (SPARK-25097) Support prediction on single instance in KMeans/BiKMeans/GMM

[ https://issues.apache.org/jira/browse/SPARK-25097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577872#comment-16577872 ] Apache Spark commented on SPARK-25097: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-25097) Support prediction on single instance in KMeans/BiKMeans/GMM

[ https://issues.apache.org/jira/browse/SPARK-25097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25097: Assignee: (was: Apache Spark) > Support prediction on single instance in KMeans/BiKMe

[jira] [Created] (SPARK-25097) Support prediction on single instance in KMeans/BiKMeans/GMM

zhengruifeng created SPARK-25097: Summary: Support prediction on single instance in KMeans/BiKMeans/GMM Key: SPARK-25097 URL: https://issues.apache.org/jira/browse/SPARK-25097 Project: Spark

[jira] [Commented] (SPARK-25020) Unable to Perform Graceful Shutdown in Spark Streaming with Hadoop 2.8

[ https://issues.apache.org/jira/browse/SPARK-25020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577846#comment-16577846 ] Saisai Shao commented on SPARK-25020: - Yes, we also met the same issue. This is more

[jira] [Assigned] (SPARK-25096) Loosen nullability if the cast is force-nullable.

[ https://issues.apache.org/jira/browse/SPARK-25096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25096: Assignee: Apache Spark > Loosen nullability if the cast is force-nullable. >

[jira] [Assigned] (SPARK-25096) Loosen nullability if the cast is force-nullable.

[ https://issues.apache.org/jira/browse/SPARK-25096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25096: Assignee: (was: Apache Spark) > Loosen nullability if the cast is force-nullable. > -

[jira] [Commented] (SPARK-25096) Loosen nullability if the cast is force-nullable.

[ https://issues.apache.org/jira/browse/SPARK-25096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577793#comment-16577793 ] Apache Spark commented on SPARK-25096: -- User 'ueshin' has created a pull request fo

[jira] [Created] (SPARK-25096) Loosen nullability if the cast is force-nullable.

Takuya Ueshin created SPARK-25096: - Summary: Loosen nullability if the cast is force-nullable. Key: SPARK-25096 URL: https://issues.apache.org/jira/browse/SPARK-25096 Project: Spark Issue Typ

[jira] [Commented] (SPARK-25094) proccesNext() failed to compile size is over 64kb

[ https://issues.apache.org/jira/browse/SPARK-25094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577763#comment-16577763 ] Hyukjin Kwon commented on SPARK-25094: -- [~igreenfi], mind adding a reproducer so th

[jira] [Updated] (SPARK-25086) Incorrect Default Value For "escape" For CSV Files

[ https://issues.apache.org/jira/browse/SPARK-25086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25086: - Component/s: (was: Spark Core) SQL > Incorrect Default Value For "escape" F

[jira] [Commented] (SPARK-25086) Incorrect Default Value For "escape" For CSV Files

[ https://issues.apache.org/jira/browse/SPARK-25086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577761#comment-16577761 ] Hyukjin Kwon commented on SPARK-25086: -- I think this is a duplicate of SPARK-22236

[jira] [Assigned] (SPARK-25033) Bump Apache commons.{httpclient, httpcore}

[ https://issues.apache.org/jira/browse/SPARK-25033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25033: Assignee: Fokko Driesprong > Bump Apache commons.{httpclient, httpcore} > ---

[jira] [Resolved] (SPARK-25033) Bump Apache commons.{httpclient, httpcore}

[ https://issues.apache.org/jira/browse/SPARK-25033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25033. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22007 [https://gi

[jira] [Assigned] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

[ https://issues.apache.org/jira/browse/SPARK-25090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25090: Assignee: Marco Gaido > java.lang.ClassCastException when using a CrossValidator > --

[jira] [Resolved] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

[ https://issues.apache.org/jira/browse/SPARK-25090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25090. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22076 [https://gi

[jira] [Assigned] (SPARK-25069) Using UnsafeAlignedOffset to make the entire record of 8 byte Items aligned like which is used in UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-25069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25069: --- Assignee: eaton > Using UnsafeAlignedOffset to make the entire record of 8 byte Items align

[jira] [Resolved] (SPARK-25069) Using UnsafeAlignedOffset to make the entire record of 8 byte Items aligned like which is used in UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-25069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25069. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22053 [https://gith

[jira] [Updated] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-25084: Fix Version/s: 2.3.2 > "distribute by" on multiple columns may lead to codegen issue > ---

[jira] [Resolved] (SPARK-24774) support reading AVRO logical types - Decimal

[ https://issues.apache.org/jira/browse/SPARK-24774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24774. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22037 [https://gith

[jira] [Assigned] (SPARK-24774) support reading AVRO logical types - Decimal

[ https://issues.apache.org/jira/browse/SPARK-24774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24774: --- Assignee: Gengliang Wang > support reading AVRO logical types - Decimal > -

[jira] [Commented] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results

[ https://issues.apache.org/jira/browse/SPARK-23298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577741#comment-16577741 ] Mateusz Jukiewicz commented on SPARK-23298: --- [~tgraves] I edited the issue de

[jira] [Updated] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results

[ https://issues.apache.org/jira/browse/SPARK-23298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz Jukiewicz updated SPARK-23298: -- Description: This is what happens (EDIT - managed to get a reproducible example): {cod

[jira] [Commented] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results

[ https://issues.apache.org/jira/browse/SPARK-23298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577734#comment-16577734 ] Mateusz Jukiewicz commented on SPARK-23298: --- [~tgraves] I have not yet tried

[jira] [Assigned] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules

[ https://issues.apache.org/jira/browse/SPARK-25026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25026: Assignee: Apache Spark (was: Sean Owen) > Binary releases should contain some copy of co

[jira] [Commented] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules

[ https://issues.apache.org/jira/browse/SPARK-25026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577685#comment-16577685 ] Apache Spark commented on SPARK-25026: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules

[ https://issues.apache.org/jira/browse/SPARK-25026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25026: Assignee: Sean Owen (was: Apache Spark) > Binary releases should contain some copy of co

[jira] [Issue Comment Deleted] (SPARK-25025) Remove the default value of isAll in INTERSECT/EXCEPT

[ https://issues.apache.org/jira/browse/SPARK-25025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25025: -- Comment: was deleted (was: User 'srowen' has created a pull request for this issue: https://github.com

[jira] [Assigned] (SPARK-25095) Python support for BarrierTaskContext

[ https://issues.apache.org/jira/browse/SPARK-25095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25095: Assignee: Apache Spark > Python support for BarrierTaskContext >

[jira] [Assigned] (SPARK-25095) Python support for BarrierTaskContext

[ https://issues.apache.org/jira/browse/SPARK-25095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25095: Assignee: (was: Apache Spark) > Python support for BarrierTaskContext > -

[jira] [Commented] (SPARK-25095) Python support for BarrierTaskContext

[ https://issues.apache.org/jira/browse/SPARK-25095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577639#comment-16577639 ] Apache Spark commented on SPARK-25095: -- User 'jiangxb1987' has created a pull reque

[jira] [Commented] (SPARK-25025) Remove the default value of isAll in INTERSECT/EXCEPT

[ https://issues.apache.org/jira/browse/SPARK-25025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577623#comment-16577623 ] Apache Spark commented on SPARK-25025: -- User 'srowen' has created a pull request fo

[jira] [Commented] (SPARK-25094) proccesNext() failed to compile size is over 64kb

[ https://issues.apache.org/jira/browse/SPARK-25094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577593#comment-16577593 ] Marco Gaido commented on SPARK-25094: - This is a duplicate of many. Unfortunately th

[jira] [Created] (SPARK-25095) Python support for BarrierTaskContext

Jiang Xingbo created SPARK-25095: Summary: Python support for BarrierTaskContext Key: SPARK-25095 URL: https://issues.apache.org/jira/browse/SPARK-25095 Project: Spark Issue Type: Task

[jira] [Comment Edited] (SPARK-24631) Cannot up cast column from bigint to smallint as it may truncate

[ https://issues.apache.org/jira/browse/SPARK-24631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577502#comment-16577502 ] Yuming Wang edited comment on SPARK-24631 at 8/12/18 11:18 AM: ---

[jira] [Commented] (SPARK-24631) Cannot up cast column from bigint to smallint as it may truncate

[ https://issues.apache.org/jira/browse/SPARK-24631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577502#comment-16577502 ] Yuming Wang commented on SPARK-24631: - I hit this issue. fixed it by recreate table/

[jira] [Comment Edited] (SPARK-25051) where clause on dataset gives AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577401#comment-16577401 ] Yuming Wang edited comment on SPARK-25051 at 8/12/18 10:51 AM: ---

[jira] [Comment Edited] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577449#comment-16577449 ] Minh Thai edited comment on SPARK-17368 at 8/12/18 8:22 AM:

[jira] [Comment Edited] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577449#comment-16577449 ] Minh Thai edited comment on SPARK-17368 at 8/12/18 8:21 AM:

[jira] [Comment Edited] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577449#comment-16577449 ] Minh Thai edited comment on SPARK-17368 at 8/12/18 8:21 AM:

[jira] [Commented] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577449#comment-16577449 ] Minh Thai commented on SPARK-17368: --- [~jodersky] I know that this is an old ticket but

[jira] [Created] (SPARK-25094) proccesNext() failed to compile size is over 64kb

Izek Greenfield created SPARK-25094: --- Summary: proccesNext() failed to compile size is over 64kb Key: SPARK-25094 URL: https://issues.apache.org/jira/browse/SPARK-25094 Project: Spark Issue