[jira] [Commented] (SPARK-18627) Cannot fetch Hive delegation tokens in client mode with proxy user

[ https://issues.apache.org/jira/browse/SPARK-18627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825600#comment-15825600 ] Mubashir Kazia commented on SPARK-18627: Spark connects to and uses HMS not HS2.

[jira] [Created] (SPARK-19258) Spark DataFrame saveAsTable not working properly after Sentry turned on

zhangqw created SPARK-19258: --- Summary: Spark DataFrame saveAsTable not working properly after Sentry turned on Key: SPARK-19258 URL: https://issues.apache.org/jira/browse/SPARK-19258 Project: Spark

[jira] [Updated] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-19257: Description: Currently we treat `CatalogStorageFormat.locationUri` as URI string and always conver

[jira] [Updated] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-19257: Description: Currently we treat `CatalogStorageFormat.locationUri` as URI string and always conver

[jira] [Updated] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-19257: Description: Currently we treat CatalogStorageFormat.locationUri as URI string and always convert i

[jira] [Updated] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-19257: Description: Currently we treat > The type of CatalogStorageFormat.locationUri should be java.net.

[jira] [Created] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

Wenchen Fan created SPARK-19257: --- Summary: The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String Key: SPARK-19257 URL: https://issues.apache.org/jira/browse/SPARK-19257 P

[jira] [Updated] (SPARK-19240) add test for setting location for managed table

[ https://issues.apache.org/jira/browse/SPARK-19240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-19240: Summary: add test for setting location for managed table (was: SET LOCATION is not allowed for tab

[jira] [Updated] (SPARK-19240) add test for setting location for managed table

[ https://issues.apache.org/jira/browse/SPARK-19240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-19240: Labels: (was: release_notes) > add test for setting location for managed table >

[jira] [Commented] (SPARK-19255) SQL Listener is causing out of memory, in case of large no of shuffle partition

[ https://issues.apache.org/jira/browse/SPARK-19255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825552#comment-15825552 ] Takeshi Yamamuro commented on SPARK-19255: -- You mean not `_stageIdToStageMetrics

[jira] [Updated] (SPARK-17654) Propagate bucketing information for Hive tables to / from Catalog

[ https://issues.apache.org/jira/browse/SPARK-17654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-17654: Issue Type: Sub-task (was: Bug) Parent: SPARK-19256 > Propagate bucketing information for

[jira] [Updated] (SPARK-17487) Configurable bucketing info extraction

[ https://issues.apache.org/jira/browse/SPARK-17487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-17487: Issue Type: Sub-task (was: Improvement) Parent: SPARK-19256 > Configurable bucketing info

[jira] [Updated] (SPARK-17570) Avoid Hash and Exchange in Sort Merge join if bucketing factor is multiple for tables

[ https://issues.apache.org/jira/browse/SPARK-17570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-17570: Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-18245) > Avoid Hash and Ex

[jira] [Updated] (SPARK-17487) Configurable bucketing info extraction

[ https://issues.apache.org/jira/browse/SPARK-17487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-17487: Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-18245) > Configurable buck

[jira] [Updated] (SPARK-17570) Avoid Hash and Exchange in Sort Merge join if bucketing factor is multiple for tables

[ https://issues.apache.org/jira/browse/SPARK-17570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-17570: Issue Type: Sub-task (was: Improvement) Parent: SPARK-19256 > Avoid Hash and Exchange in S

[jira] [Updated] (SPARK-17729) Enable creating hive bucketed tables

[ https://issues.apache.org/jira/browse/SPARK-17729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-17729: Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-18245) > Enable creating h

[jira] [Updated] (SPARK-17729) Enable creating hive bucketed tables

[ https://issues.apache.org/jira/browse/SPARK-17729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-17729: Issue Type: Sub-task (was: Improvement) Parent: SPARK-19256 > Enable creating hive buckete

[jira] [Updated] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-17495: Issue Type: Sub-task (was: Improvement) Parent: SPARK-19256 > Hive hash implementation > -

[jira] [Updated] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-17495: Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-18245) > Hive hash impleme

[jira] [Commented] (SPARK-19256) Hive bucketing support

[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825494#comment-15825494 ] Tejas Patil commented on SPARK-19256: - cc [~cloud_fan] [~hvanhovell] for comments ove

[jira] [Created] (SPARK-19256) Hive bucketing support

Tejas Patil created SPARK-19256: --- Summary: Hive bucketing support Key: SPARK-19256 URL: https://issues.apache.org/jira/browse/SPARK-19256 Project: Spark Issue Type: Umbrella Component

[jira] [Commented] (SPARK-19255) SQL Listener is causing out of memory, in case of large no of shuffle partition

[ https://issues.apache.org/jira/browse/SPARK-19255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825476#comment-15825476 ] Ashok Kumar commented on SPARK-19255: - Due to issue, i am not able to attach screensh

[jira] [Created] (SPARK-19255) SQL Listener is causing out of memory, in case of large no of shuffle partition

Ashok Kumar created SPARK-19255: --- Summary: SQL Listener is causing out of memory, in case of large no of shuffle partition Key: SPARK-19255 URL: https://issues.apache.org/jira/browse/SPARK-19255 Project

[jira] [Assigned] (SPARK-19254) Support Seq, Map, and Struct in functions.lit

[ https://issues.apache.org/jira/browse/SPARK-19254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19254: Assignee: Apache Spark > Support Seq, Map, and Struct in functions.lit > -

[jira] [Commented] (SPARK-19254) Support Seq, Map, and Struct in functions.lit

[ https://issues.apache.org/jira/browse/SPARK-19254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825469#comment-15825469 ] Apache Spark commented on SPARK-19254: -- User 'maropu' has created a pull request for

[jira] [Assigned] (SPARK-19254) Support Seq, Map, and Struct in functions.lit

[ https://issues.apache.org/jira/browse/SPARK-19254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19254: Assignee: (was: Apache Spark) > Support Seq, Map, and Struct in functions.lit > --

[jira] [Resolved] (SPARK-19148) do not expose the external table concept in Catalog

[ https://issues.apache.org/jira/browse/SPARK-19148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19148. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16528 [https://githu

[jira] [Commented] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825173#comment-15825173 ] Hyukjin Kwon commented on SPARK-19248: -- I just looked into this for my curiosity. Th

[jira] [Created] (SPARK-19254) Support Seq, Map, and Struct in functions.lit

Takeshi Yamamuro created SPARK-19254: Summary: Support Seq, Map, and Struct in functions.lit Key: SPARK-19254 URL: https://issues.apache.org/jira/browse/SPARK-19254 Project: Spark Issue T

[jira] [Commented] (SPARK-19153) DataFrameWriter.saveAsTable should work with hive format to create partitioned table

[ https://issues.apache.org/jira/browse/SPARK-19153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824935#comment-15824935 ] Shuai Lin commented on SPARK-19153: --- Never mind. I can help review it instead. > DataF

[jira] [Commented] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824917#comment-15824917 ] Takeshi Yamamuro commented on SPARK-19217: -- In spite loading/writing to data sou

[jira] [Comment Edited] (SPARK-19250) In security cluster, spark beeline connect to hive metastore failed

[ https://issues.apache.org/jira/browse/SPARK-19250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824896#comment-15824896 ] meiyoula edited comment on SPARK-19250 at 1/17/17 3:47 AM: --- [~v

[jira] [Commented] (SPARK-19250) In security cluster, spark beeline connect to hive metastore failed

[ https://issues.apache.org/jira/browse/SPARK-19250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824896#comment-15824896 ] meiyoula commented on SPARK-19250: -- [~vanzin] I found SPARK-13478 is a similar bug, you

[jira] [Closed] (SPARK-19253) remove unused imports and outdated comments in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-19253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu closed SPARK-19253. - Resolution: Invalid > remove unused imports and outdated comments in Spark Streaming > --

[jira] [Closed] (SPARK-19252) remove unused imports and outdated comments in Spark-Core

[ https://issues.apache.org/jira/browse/SPARK-19252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu closed SPARK-19252. - Resolution: Invalid > remove unused imports and outdated comments in Spark-Core > ---

[jira] [Created] (SPARK-19253) remove unused imports and outdated comments in Spark Streaming

Genmao Yu created SPARK-19253: - Summary: remove unused imports and outdated comments in Spark Streaming Key: SPARK-19253 URL: https://issues.apache.org/jira/browse/SPARK-19253 Project: Spark Iss

[jira] [Assigned] (SPARK-19251) remove unused imports and outdated comments

[ https://issues.apache.org/jira/browse/SPARK-19251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19251: Assignee: (was: Apache Spark) > remove unused imports and outdated comments >

[jira] [Assigned] (SPARK-19251) remove unused imports and outdated comments

[ https://issues.apache.org/jira/browse/SPARK-19251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19251: Assignee: Apache Spark > remove unused imports and outdated comments > ---

[jira] [Created] (SPARK-19252) remove unused imports and outdated comments in Spark-Core

Genmao Yu created SPARK-19252: - Summary: remove unused imports and outdated comments in Spark-Core Key: SPARK-19252 URL: https://issues.apache.org/jira/browse/SPARK-19252 Project: Spark Issue Typ

[jira] [Commented] (SPARK-19251) remove unused imports and outdated comments

[ https://issues.apache.org/jira/browse/SPARK-19251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824873#comment-15824873 ] Apache Spark commented on SPARK-19251: -- User 'uncleGen' has created a pull request f

[jira] [Created] (SPARK-19251) remove unused imports and outdated comments

Genmao Yu created SPARK-19251: - Summary: remove unused imports and outdated comments Key: SPARK-19251 URL: https://issues.apache.org/jira/browse/SPARK-19251 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-19227) Typo in `org.apache.spark.internal.config.ConfigEntry`

[ https://issues.apache.org/jira/browse/SPARK-19227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824872#comment-15824872 ] Genmao Yu commented on SPARK-19227: --- [~F7753] Sorry, I will open another JIRA to fix un

[jira] [Updated] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-18905: - Affects Version/s: 1.5.2 1.6.1 1.6.2 > Potential Is

[jira] [Updated] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-18905: - Affects Version/s: 1.5.1 1.6.3 > Potential Issue of Semantics of BatchComp

[jira] [Resolved] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-18905. -- Resolution: Fixed Assignee: Nan Zhu Fix Version/s: 2.2.0 2.1.

[jira] [Commented] (SPARK-18893) Not support "alter table .. add columns .."

[ https://issues.apache.org/jira/browse/SPARK-18893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824848#comment-15824848 ] Hong Shen commented on SPARK-18893: --- +1, "alter table add/replace columns" is a very im

[jira] [Updated] (SPARK-19250) In security cluster, spark beeline connect to hive metastore failed

[ https://issues.apache.org/jira/browse/SPARK-19250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-19250: - Description: 1. starting thriftserver in security mode, set hive.metastore.uris to hive metastore uri, a

[jira] [Updated] (SPARK-19250) In security cluster, spark beeline connect to hive metastore failed

[ https://issues.apache.org/jira/browse/SPARK-19250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-19250: - Description: 1. starting thriftserver in security mode, set hive.metastore.uris to hive metastore uri, al

[jira] [Updated] (SPARK-19250) In security cluster, spark beeline connect to hive metastore failed

[ https://issues.apache.org/jira/browse/SPARK-19250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-19250: - Environment: (was: 1. Security cluster 2.Set hive.metastore.uris to hivr metastore uri) > In security

[jira] [Created] (SPARK-19250) In security cluster, spark beeline connect to hive metastore failed

meiyoula created SPARK-19250: Summary: In security cluster, spark beeline connect to hive metastore failed Key: SPARK-19250 URL: https://issues.apache.org/jira/browse/SPARK-19250 Project: Spark

[jira] [Closed] (SPARK-19238) Ignore sorting the edges if edges are sorted when building edge partition

[ https://issues.apache.org/jira/browse/SPARK-19238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui closed SPARK-19238. --- Resolution: Invalid > Ignore sorting the edges if edges are sorted when building edge partition > ---

[jira] [Commented] (SPARK-19247) improve ml word2vec save/load

[ https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824820#comment-15824820 ] Asher Krim commented on SPARK-19247: Good question. I've seen it come up before (htt

[jira] [Commented] (SPARK-19247) improve ml word2vec save/load

[ https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824807#comment-15824807 ] Joseph K. Bradley commented on SPARK-19247: --- Is this an actual problem? If thi

[jira] [Commented] (SPARK-8480) Add setName for Dataframe

[ https://issues.apache.org/jira/browse/SPARK-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824785#comment-15824785 ] Apache Spark commented on SPARK-8480: - User 'emlyn' has created a pull request for thi

[jira] [Updated] (SPARK-19236) Add createOrReplaceGlobalTempView

[ https://issues.apache.org/jira/browse/SPARK-19236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arman Yazdani updated SPARK-19236: -- Component/s: (was: SQL) (was: Java API) > Add createOrReplaceGlobalTem

[jira] [Comment Edited] (SPARK-14409) Investigate adding a RankingEvaluator to ML

[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824774#comment-15824774 ] Roberto Mirizzi edited comment on SPARK-14409 at 1/17/17 12:43 AM:

[jira] [Commented] (SPARK-14409) Investigate adding a RankingEvaluator to ML

[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824774#comment-15824774 ] Roberto Mirizzi commented on SPARK-14409: - I implemented the RankingEvaluator to

[jira] [Commented] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824751#comment-15824751 ] Nicholas Chammas commented on SPARK-19217: -- Ah OK, good to know. I was testing w

[jira] [Updated] (SPARK-19234) AFTSurvivalRegression chokes silently or with confusing errors when any labels are zero

[ https://issues.apache.org/jira/browse/SPARK-19234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew MacKinlay updated SPARK-19234: - Priority: Minor (was: Major) > AFTSurvivalRegression chokes silently or with confusing e

[jira] [Commented] (SPARK-19234) AFTSurvivalRegression chokes silently or with confusing errors when any labels are zero

[ https://issues.apache.org/jira/browse/SPARK-19234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824710#comment-15824710 ] Andrew MacKinlay commented on SPARK-19234: -- Ah, I think you're probably right ab

[jira] [Comment Edited] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824677#comment-15824677 ] Hyukjin Kwon edited comment on SPARK-19217 at 1/16/17 11:05 PM: ---

[jira] [Commented] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824677#comment-15824677 ] Hyukjin Kwon commented on SPARK-19217: -- (That's fixed in SPARK-17765 for ORC up to m

[jira] [Resolved] (SPARK-18828) Refactor SparkR build and test scripts

[ https://issues.apache.org/jira/browse/SPARK-18828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-18828. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.2.0 Targe

[jira] [Resolved] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9487. -- Resolution: Won't Fix > Use the same num. worker threads in Scala/Python unit tests > --

[jira] [Resolved] (SPARK-17380) Spark streaming with a multi shard Kinesis freezes after several days (memory/resource leak?)

[ https://issues.apache.org/jira/browse/SPARK-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17380. --- Resolution: Not A Problem > Spark streaming with a multi shard Kinesis freezes after several days >

[jira] [Reopened] (SPARK-17380) Spark streaming with a multi shard Kinesis freezes after several days (memory/resource leak?)

[ https://issues.apache.org/jira/browse/SPARK-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-17380: --- > Spark streaming with a multi shard Kinesis freezes after several days > (memory/resource leak?) >

[jira] [Resolved] (SPARK-19245) Cannot build spark-assembly jar

[ https://issues.apache.org/jira/browse/SPARK-19245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19245. --- Resolution: Not A Problem There aren't assemblies anymore: https://issues.apache.org/jira/browse/SPA

[jira] [Commented] (SPARK-19234) AFTSurvivalRegression chokes silently or with confusing errors when any labels are zero

[ https://issues.apache.org/jira/browse/SPARK-19234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824577#comment-15824577 ] Sean Owen commented on SPARK-19234: --- I am not so familiar with AFT, but is it valid to

[jira] [Comment Edited] (SPARK-17380) Spark streaming with a multi shard Kinesis freezes after several days (memory/resource leak?)

[ https://issues.apache.org/jira/browse/SPARK-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824564#comment-15824564 ] Xeto edited comment on SPARK-17380 at 1/16/17 8:41 PM: --- Hi We switc

[jira] [Resolved] (SPARK-17380) Spark streaming with a multi shard Kinesis freezes after several days (memory/resource leak?)

[ https://issues.apache.org/jira/browse/SPARK-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xeto resolved SPARK-17380. -- Resolution: Fixed Fix Version/s: 2.0.2 > Spark streaming with a multi shard Kinesis freezes after severa

[jira] [Commented] (SPARK-17380) Spark streaming with a multi shard Kinesis freezes after several days (memory/resource leak?)

[ https://issues.apache.org/jira/browse/SPARK-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824564#comment-15824564 ] Xeto commented on SPARK-17380: -- Hi We switched to using StorageLevel.MEMORY_AND_DISK_SER on

[jira] [Created] (SPARK-19249) Update Download page to describe how to download archived releases

Luciano Resende created SPARK-19249: --- Summary: Update Download page to describe how to download archived releases Key: SPARK-19249 URL: https://issues.apache.org/jira/browse/SPARK-19249 Project: Spa

[jira] [Commented] (SPARK-10057) Faill to load class org.slf4j.impl.StaticLoggerBinder

[ https://issues.apache.org/jira/browse/SPARK-10057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824363#comment-15824363 ] Ravi Raghav commented on SPARK-10057: - Issue is due to slf4j-simple is included in th

[jira] [Reopened] (SPARK-2141) Add sc.getPersistentRDDs() to PySpark

[ https://issues.apache.org/jira/browse/SPARK-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas reopened SPARK-2141: - > Add sc.getPersistentRDDs() to PySpark > - > >

[jira] [Commented] (SPARK-2141) Add sc.getPersistentRDDs() to PySpark

[ https://issues.apache.org/jira/browse/SPARK-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824360#comment-15824360 ] Nicholas Chammas commented on SPARK-2141: - I'd like to reopen this issue given the

[jira] [Resolved] (SPARK-19232) SparkR distribution cache location is wrong on Windows

[ https://issues.apache.org/jira/browse/SPARK-19232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-19232. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue

[jira] [Commented] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824334#comment-15824334 ] Nicholas Chammas commented on SPARK-19248: -- Testing this out, it looks like 2.1

[jira] [Assigned] (SPARK-13721) Add support for LATERAL VIEW OUTER explode()

[ https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13721: Assignee: (was: Apache Spark) > Add support for LATERAL VIEW OUTER explode() > ---

[jira] [Assigned] (SPARK-13721) Add support for LATERAL VIEW OUTER explode()

[ https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13721: Assignee: Apache Spark > Add support for LATERAL VIEW OUTER explode() > --

[jira] [Commented] (SPARK-13721) Add support for LATERAL VIEW OUTER explode()

[ https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824308#comment-15824308 ] Apache Spark commented on SPARK-13721: -- User 'bogdanrdc' has created a pull request

[jira] [Updated] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Tittmann updated SPARK-19248: --- Description: We found an error in Spark 2.0.2 execution of Regex. Using PySpark In 1.6.2, we

[jira] [Created] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

Lucas Tittmann created SPARK-19248: -- Summary: Regex_replace works in 1.6 but not in 2.0 Key: SPARK-19248 URL: https://issues.apache.org/jira/browse/SPARK-19248 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-19247) improve ml word2vec save/load

[ https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19247: Assignee: Apache Spark > improve ml word2vec save/load > - > >

[jira] [Commented] (SPARK-19247) improve ml word2vec save/load

[ https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824231#comment-15824231 ] Apache Spark commented on SPARK-19247: -- User 'Krimit' has created a pull request for

[jira] [Assigned] (SPARK-19247) improve ml word2vec save/load

[ https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19247: Assignee: (was: Apache Spark) > improve ml word2vec save/load > --

[jira] [Comment Edited] (SPARK-19209) "No suitable driver" on first try

[ https://issues.apache.org/jira/browse/SPARK-19209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824224#comment-15824224 ] Daniel Darabos edited comment on SPARK-19209 at 1/16/17 4:26 PM: --

[jira] [Commented] (SPARK-19209) "No suitable driver" on first try

[ https://issues.apache.org/jira/browse/SPARK-19209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824224#comment-15824224 ] Daniel Darabos commented on SPARK-19209: Sorry, Jira had some issues when I was t

[jira] [Created] (SPARK-19247) improve ml word2vec save/load

Asher Krim created SPARK-19247: -- Summary: improve ml word2vec save/load Key: SPARK-19247 URL: https://issues.apache.org/jira/browse/SPARK-19247 Project: Spark Issue Type: Bug Reporte

[jira] [Commented] (SPARK-18874) First phase: Deferring the correlated predicate pull up to Optimizer phase

[ https://issues.apache.org/jira/browse/SPARK-18874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824182#comment-15824182 ] Nattavut Sutyanyong commented on SPARK-18874: - [~hvanhovell] [~rxin], Have yo

[jira] [Updated] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-19217: - Description: Working with ML often means working with DataFrames with vector columns. You

[jira] [Commented] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824175#comment-15824175 ] Nicholas Chammas commented on SPARK-19217: -- [~mlnick] - I'm seeing this when I t

[jira] [Comment Edited] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824175#comment-15824175 ] Nicholas Chammas edited comment on SPARK-19217 at 1/16/17 3:41 PM:

issues@spark.apache.org

[ https://issues.apache.org/jira/browse/SPARK-19246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19246: Assignee: (was: Apache Spark) > CataLogTable's partitionSchema should check order&exis

issues@spark.apache.org

[ https://issues.apache.org/jira/browse/SPARK-19246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824124#comment-15824124 ] Apache Spark commented on SPARK-19246: -- User 'windpiger' has created a pull request

issues@spark.apache.org

[ https://issues.apache.org/jira/browse/SPARK-19246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19246: Assignee: Apache Spark > CataLogTable's partitionSchema should check order&exist > ---

issues@spark.apache.org

[ https://issues.apache.org/jira/browse/SPARK-19246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Song Jun updated SPARK-19246: - Summary: CataLogTable's partitionSchema should check order&exist (was: CataLogTable's partitionSchema sh

[jira] [Updated] (SPARK-19246) CataLogTable's partitionSchema should check if each column name in partitionColumnNames must match one and only one field in schema, and keep order with partitionColumnN

[ https://issues.apache.org/jira/browse/SPARK-19246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Song Jun updated SPARK-19246: - Summary: CataLogTable's partitionSchema should check if each column name in partitionColumnNames must mat

[jira] [Updated] (SPARK-19246) CataLogTable's partitionSchema should check if each column name in partitionColumnNames must match one and only one field in schema, and keep order with partitionColumnN

[ https://issues.apache.org/jira/browse/SPARK-19246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Song Jun updated SPARK-19246: - Description: get CataLogTable's partitionSchema should check if each column name in partitionColumnNames

[jira] [Commented] (SPARK-18781) Allow MatrixFactorizationModel.predict to skip user/product approximation count

[ https://issues.apache.org/jira/browse/SPARK-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824111#comment-15824111 ] Eyal Allweil commented on SPARK-18781: -- It seems like the approximation count is tak

[jira] [Created] (SPARK-19246) CataLogTable's partitionSchema should check if each column name in partitionColumnNames must match one and only one field in schema

Song Jun created SPARK-19246: Summary: CataLogTable's partitionSchema should check if each column name in partitionColumnNames must match one and only one field in schema Key: SPARK-19246 URL: https://issues.apache.or

  1   2   >