[jira] [Commented] (SPARK-12157) Support numpy types as return values of Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832907#comment-15832907 ] Maciej Szymkiewicz commented on SPARK-12157: I've been looking at this in con

[jira] [Commented] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832935#comment-15832935 ] Song Jun commented on SPARK-19257: -- I found it than `CatalogTablePartition` and `Catalog

[jira] [Comment Edited] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832935#comment-15832935 ] Song Jun edited comment on SPARK-19257 at 1/21/17 11:09 AM: I

[jira] [Resolved] (SPARK-19321) Support Hive 2.x's metastore

[ https://issues.apache.org/jira/browse/SPARK-19321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19321. --- Resolution: Duplicate > Support Hive 2.x's metastore > > >

[jira] [Resolved] (SPARK-17724) Unevaluated new lines in tooltip in DAG Visualization of a job

[ https://issues.apache.org/jira/browse/SPARK-17724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17724. --- Resolution: Fixed Assignee: Xin Ren Fix Version/s: 2.2.0 Resolved by https://github.c

[jira] [Updated] (SPARK-17912) Refactor code generation to get data for ColumnVector/ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17912: -- Assignee: Kazuaki Ishizaki > Refactor code generation to get data for ColumnVector/ColumnarBatch >

[jira] [Resolved] (SPARK-8273) Driver hangs up when yarn shutdown in client mode

[ https://issues.apache.org/jira/browse/SPARK-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8273. -- Resolution: Fixed > Driver hangs up when yarn shutdown in client mode >

[jira] [Resolved] (SPARK-19316) Spark event logs are huge compared to 1.5.2

[ https://issues.apache.org/jira/browse/SPARK-19316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19316. --- Resolution: Duplicate Please search JIRA first > Spark event logs are huge compared to 1.5.2 > -

[jira] [Commented] (SPARK-16101) Refactoring CSV data source to be consistent with JSON data source

[ https://issues.apache.org/jira/browse/SPARK-16101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833043#comment-15833043 ] Apache Spark commented on SPARK-16101: -- User 'HyukjinKwon' has created a pull reques

[jira] [Created] (SPARK-19322) Allow customizable column name in ScalaReflection.schemaFor

Wei Liu created SPARK-19322: --- Summary: Allow customizable column name in ScalaReflection.schemaFor Key: SPARK-19322 URL: https://issues.apache.org/jira/browse/SPARK-19322 Project: Spark Issue Type

[jira] [Created] (SPARK-19323) Upgrade breeze to 0.13

koert kuipers created SPARK-19323: - Summary: Upgrade breeze to 0.13 Key: SPARK-19323 URL: https://issues.apache.org/jira/browse/SPARK-19323 Project: Spark Issue Type: Improvement Co

[jira] [Resolved] (SPARK-13478) Fetching delegation tokens for Hive fails when using proxy users

[ https://issues.apache.org/jira/browse/SPARK-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-13478. Resolution: Fixed Fix Version/s: 1.6.4 > Fetching delegation tokens for Hive fails w

[jira] [Issue Comment Deleted] (SPARK-19296) Awkward changes for JdbcUtils.saveTable in Spark 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-19296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19296: -- Comment: was deleted (was: Hi, [~zwu@gmail.com] It looks like a question. Could you ask to

[jira] [Commented] (SPARK-19296) Awkward changes for JdbcUtils.saveTable in Spark 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-19296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833205#comment-15833205 ] Dongjoon Hyun commented on SPARK-19296: --- Hi, [~zwu@gmail.com] It looks like a

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833206#comment-15833206 ] Felix Cheung commented on SPARK-16693: -- I want to bring this up again and potentiall

[jira] [Created] (SPARK-19324) JVM stdout output is dropped in SparkR

Felix Cheung created SPARK-19324: Summary: JVM stdout output is dropped in SparkR Key: SPARK-19324 URL: https://issues.apache.org/jira/browse/SPARK-19324 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-19324) JVM stdout output is dropped in SparkR

[ https://issues.apache.org/jira/browse/SPARK-19324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-19324: Assignee: Felix Cheung > JVM stdout output is dropped in SparkR >

[jira] [Updated] (SPARK-19324) JVM stdout output is dropped in SparkR

[ https://issues.apache.org/jira/browse/SPARK-19324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19324: - Description: Whenever there are stdout outputs from Spark in JVM (typically when calling println

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833216#comment-15833216 ] Reynold Xin commented on SPARK-16693: - We should absolutely remove the RDD methods.

[jira] [Commented] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833217#comment-15833217 ] zuotingbing commented on SPARK-19260: - Yes it is a invaild URI but the err msg " Log

[jira] [Created] (SPARK-19325) Running query hang-up 5min

Weizhong created SPARK-19325: Summary: Running query hang-up 5min Key: SPARK-19325 URL: https://issues.apache.org/jira/browse/SPARK-19325 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-19300) Executor is waiting for lock

[ https://issues.apache.org/jira/browse/SPARK-19300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-19300: Attachment: WAITING.jpg stderr.jpg [~zsxwing], There are 4 blocks to fetch, but onl

[jira] [Comment Edited] (SPARK-19300) Executor is waiting for lock

[ https://issues.apache.org/jira/browse/SPARK-19300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833224#comment-15833224 ] Yuming Wang edited comment on SPARK-19300 at 1/22/17 2:02 AM: -

[jira] [Comment Edited] (SPARK-19300) Executor is waiting for lock

[ https://issues.apache.org/jira/browse/SPARK-19300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833224#comment-15833224 ] Yuming Wang edited comment on SPARK-19300 at 1/22/17 2:04 AM: -

[jira] [Comment Edited] (SPARK-19300) Executor is waiting for lock

[ https://issues.apache.org/jira/browse/SPARK-19300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833224#comment-15833224 ] Yuming Wang edited comment on SPARK-19300 at 1/22/17 2:04 AM: -

[jira] [Assigned] (SPARK-19324) JVM stdout output is dropped in SparkR

[ https://issues.apache.org/jira/browse/SPARK-19324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19324: Assignee: Felix Cheung (was: Apache Spark) > JVM stdout output is dropped in SparkR > ---

[jira] [Assigned] (SPARK-19324) JVM stdout output is dropped in SparkR

[ https://issues.apache.org/jira/browse/SPARK-19324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19324: Assignee: Apache Spark (was: Felix Cheung) > JVM stdout output is dropped in SparkR > ---

[jira] [Commented] (SPARK-19324) JVM stdout output is dropped in SparkR

[ https://issues.apache.org/jira/browse/SPARK-19324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833233#comment-15833233 ] Apache Spark commented on SPARK-19324: -- User 'felixcheung' has created a pull reques

[jira] [Commented] (SPARK-19015) SQL request with transformation cannot be eecuted if not run first a scan table

[ https://issues.apache.org/jira/browse/SPARK-19015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833241#comment-15833241 ] Hyukjin Kwon commented on SPARK-19015: -- If it is a question, I believe you could get

[jira] [Updated] (SPARK-19308) Unable to write to Hive table where column names contains period (.)

[ https://issues.apache.org/jira/browse/SPARK-19308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19308: -- Affects Version/s: 2.1.0 > Unable to write to Hive table where column names contains period (.)

[jira] [Commented] (SPARK-19300) Executor is waiting for lock

[ https://issues.apache.org/jira/browse/SPARK-19300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833244#comment-15833244 ] Shixiong Zhu commented on SPARK-19300: -- Could you check if there is any thread havin

[jira] [Updated] (SPARK-19255) SQL Listener is causing out of memory, in case of data size is in petabytes.

[ https://issues.apache.org/jira/browse/SPARK-19255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashok Kumar updated SPARK-19255: Summary: SQL Listener is causing out of memory, in case of data size is in petabytes. (was: SQL L

[jira] [Commented] (SPARK-19308) Unable to write to Hive table where column names contains period (.)

[ https://issues.apache.org/jira/browse/SPARK-19308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833246#comment-15833246 ] Dongjoon Hyun commented on SPARK-19308: --- Hi, [~vapira]. Thank you for reporting. T

[jira] [Updated] (SPARK-19255) SQL Listener is causing out of memory, in case of data size is in petabytes.

[ https://issues.apache.org/jira/browse/SPARK-19255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashok Kumar updated SPARK-19255: Description: Since its difficult to load huge dataset, below steps will help in reproducing the is

[jira] [Comment Edited] (SPARK-19308) Unable to write to Hive table where column names contains period (.)

[ https://issues.apache.org/jira/browse/SPARK-19308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833246#comment-15833246 ] Dongjoon Hyun edited comment on SPARK-19308 at 1/22/17 2:50 AM: ---

[jira] [Commented] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833251#comment-15833251 ] zuotingbing commented on SPARK-19260: - i have tested these cases successfully which f

[jira] [Comment Edited] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833251#comment-15833251 ] zuotingbing edited comment on SPARK-19260 at 1/22/17 3:14 AM: -

[jira] [Comment Edited] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833251#comment-15833251 ] zuotingbing edited comment on SPARK-19260 at 1/22/17 3:40 AM: -

[jira] [Resolved] (SPARK-19153) DataFrameWriter.saveAsTable should work with hive format to create partitioned table

[ https://issues.apache.org/jira/browse/SPARK-19153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19153. - Resolution: Fixed Assignee: Song Jun Fix Version/s: 2.2.0 > DataFrameWriter.saveA

[jira] [Created] (SPARK-19326) Speculated task attempts do not get launched in few scenarios

Tejas Patil created SPARK-19326: --- Summary: Speculated task attempts do not get launched in few scenarios Key: SPARK-19326 URL: https://issues.apache.org/jira/browse/SPARK-19326 Project: Spark

[jira] [Commented] (SPARK-19326) Speculated task attempts do not get launched in few scenarios

[ https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833270#comment-15833270 ] Tejas Patil commented on SPARK-19326: - cc [~kayousterhout], [~irashid] [~vanzin] `E

[jira] [Comment Edited] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833217#comment-15833217 ] zuotingbing edited comment on SPARK-19260 at 1/22/17 4:22 AM: -

[jira] [Updated] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-19260: Description: run .sbin/start-history-server.sh "file:/a b" And you get the error: Caused by: java.l

[jira] [Updated] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-19260: Description: run .sbin/start-history-server.sh "file:/a b" And you get the error: Caused by: java.

[jira] [Created] (SPARK-19327) Improve the partition method when read data from jdbc

DjvuLee created SPARK-19327: --- Summary: Improve the partition method when read data from jdbc Key: SPARK-19327 URL: https://issues.apache.org/jira/browse/SPARK-19327 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-19155) MLlib GeneralizedLinearRegression family and link should case insensitive

[ https://issues.apache.org/jira/browse/SPARK-19155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-19155: Issue Type: Bug (was: Improvement) > MLlib GeneralizedLinearRegression family and link should case

[jira] [Resolved] (SPARK-19155) MLlib GeneralizedLinearRegression family and link should case insensitive

[ https://issues.apache.org/jira/browse/SPARK-19155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-19155. - Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 2.0.3 >

[jira] [Commented] (SPARK-19327) Improve the partition method when read data from jdbc

[ https://issues.apache.org/jira/browse/SPARK-19327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833293#comment-15833293 ] Apache Spark commented on SPARK-19327: -- User 'djvulee' has created a pull request fo

[jira] [Assigned] (SPARK-19327) Improve the partition method when read data from jdbc

[ https://issues.apache.org/jira/browse/SPARK-19327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19327: Assignee: Apache Spark > Improve the partition method when read data from jdbc > -

[jira] [Assigned] (SPARK-19327) Improve the partition method when read data from jdbc

[ https://issues.apache.org/jira/browse/SPARK-19327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19327: Assignee: (was: Apache Spark) > Improve the partition method when read data from jdbc

[jira] [Resolved] (SPARK-19291) spark.gaussianMixture supports output log-likelihood

[ https://issues.apache.org/jira/browse/SPARK-19291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-19291. - Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.2.0 > spark.gaussianMixt

[jira] [Updated] (SPARK-19326) Speculated task attempts do not get launched in few scenarios

[ https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-19326: Description: Speculated copies of tasks do not get launched in some cases. Examples: - All the run

[jira] [Comment Edited] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833251#comment-15833251 ] zuotingbing edited comment on SPARK-19260 at 1/22/17 5:59 AM: -

[jira] [Comment Edited] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832935#comment-15832935 ] Song Jun edited comment on SPARK-19257 at 1/22/17 6:00 AM: --- I f

[jira] [Resolved] (SPARK-18819) Double alignment on ARM71 platform

[ https://issues.apache.org/jira/browse/SPARK-18819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Kamprath resolved SPARK-18819. -- Resolution: Won't Fix Per the discussion in this ticket's associated pull request, this

[jira] [Comment Edited] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833310#comment-15833310 ] zuotingbing edited comment on SPARK-19260 at 1/22/17 6:20 AM: -

[jira] [Commented] (SPARK-19300) Executor is waiting for lock

[ https://issues.apache.org/jira/browse/SPARK-19300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833311#comment-15833311 ] cen yuhai commented on SPARK-19300: --- yes > Executor is waiting for lock >

[jira] [Commented] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833310#comment-15833310 ] zuotingbing commented on SPARK-19260: - + vanzin > Spaces in path parameter are not

[jira] [Comment Edited] (SPARK-19300) Executor is waiting for lock

[ https://issues.apache.org/jira/browse/SPARK-19300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833311#comment-15833311 ] cen yuhai edited comment on SPARK-19300 at 1/22/17 6:21 AM: [

[jira] [Comment Edited] (SPARK-19300) Executor is waiting for lock

[ https://issues.apache.org/jira/browse/SPARK-19300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833311#comment-15833311 ] cen yuhai edited comment on SPARK-19300 at 1/22/17 6:22 AM: [

[jira] [Issue Comment Deleted] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-19260: Comment: was deleted (was: @vanzin ) > Spaces in path parameter are not correctly handled with Hi

[jira] [Resolved] (SPARK-19300) Executor is waiting for lock

[ https://issues.apache.org/jira/browse/SPARK-19300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-19300. -- Resolution: Duplicate Thanks for confirming it. Closing this one as it's a duplicated issue. >

[jira] [Comment Edited] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832935#comment-15832935 ] Song Jun edited comment on SPARK-19257 at 1/22/17 6:42 AM: --- I f

[jira] [Comment Edited] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832935#comment-15832935 ] Song Jun edited comment on SPARK-19257 at 1/22/17 6:41 AM: --- I f

[jira] [Commented] (SPARK-19208) MultivariateOnlineSummarizer perfermence optimization

[ https://issues.apache.org/jira/browse/SPARK-19208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833345#comment-15833345 ] zhengruifeng commented on SPARK-19208: -- After diving into sparksql's udaf, I design