[jira] [Resolved] (SPARK-20567) Failure to bind when using explode and collect_set in streaming

[ https://issues.apache.org/jira/browse/SPARK-20567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20567. --- Resolution: Fixed Fix Version/s: 2.2.0 > Failure to bind when using explode

[jira] [Created] (SPARK-20573) --packages fails when transitive dependency can only be resolved from repository specified in POM's tag

Josh Rosen created SPARK-20573: -- Summary: --packages fails when transitive dependency can only be resolved from repository specified in POM's tag Key: SPARK-20573 URL:

[jira] [Commented] (SPARK-4836) Web UI should display separate information for all stage attempts

[ https://issues.apache.org/jira/browse/SPARK-4836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994213#comment-15994213 ] Josh Rosen commented on SPARK-4836: --- [~ckadner], I'm pretty sure that this is still a problem.

[jira] [Created] (SPARK-20572) Spark Streaming fail to read file on Hdfs

LvDongrong created SPARK-20572: -- Summary: Spark Streaming fail to read file on Hdfs Key: SPARK-20572 URL: https://issues.apache.org/jira/browse/SPARK-20572 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994199#comment-15994199 ] Ethan Xu commented on SPARK-12009: -- I'm getting similar error message in with Spark 2.1.0. I can't

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994192#comment-15994192 ] Supriya Pasham edited comment on SPARK-12216 at 5/3/17 2:46 AM: Hi Team,

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994192#comment-15994192 ] Supriya Pasham commented on SPARK-12216: Hi Team, I am executing 'spark-submit' with a jar and

[jira] [Commented] (SPARK-20571) Flaky SparkR StructuredStreaming tests

[ https://issues.apache.org/jira/browse/SPARK-20571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994185#comment-15994185 ] Burak Yavuz commented on SPARK-20571: - cc [~felixcheung] > Flaky SparkR StructuredStreaming tests >

[jira] [Created] (SPARK-20571) Flaky SparkR StructuredStreaming tests

Burak Yavuz created SPARK-20571: --- Summary: Flaky SparkR StructuredStreaming tests Key: SPARK-20571 URL: https://issues.apache.org/jira/browse/SPARK-20571 Project: Spark Issue Type: Test

[jira] [Resolved] (SPARK-20558) clear InheritableThreadLocal variables in SparkContext when stopping it

[ https://issues.apache.org/jira/browse/SPARK-20558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20558. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 2.1.2

[jira] [Created] (SPARK-20570) The main version number on docs/latest/index.html

liucht-inspur created SPARK-20570: - Summary: The main version number on docs/latest/index.html Key: SPARK-20570 URL: https://issues.apache.org/jira/browse/SPARK-20570 Project: Spark Issue

[jira] [Created] (SPARK-20569) In spark-sql,Some functions can execute successfully, when the number of input parameter is wrong

liuxian created SPARK-20569: --- Summary: In spark-sql,Some functions can execute successfully, when the number of input parameter is wrong Key: SPARK-20569 URL: https://issues.apache.org/jira/browse/SPARK-20569

[jira] [Updated] (SPARK-20568) Delete files after processing

[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saul Shanabrook updated SPARK-20568: Description: It would be great to be able to delete files after processing them with

[jira] [Created] (SPARK-20568) Delete files after processing

Saul Shanabrook created SPARK-20568: --- Summary: Delete files after processing Key: SPARK-20568 URL: https://issues.apache.org/jira/browse/SPARK-20568 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-20567) Failure to bind when using explode and collect_set in streaming

[ https://issues.apache.org/jira/browse/SPARK-20567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20567: Assignee: Michael Armbrust (was: Apache Spark) > Failure to bind when using explode and

[jira] [Assigned] (SPARK-20567) Failure to bind when using explode and collect_set in streaming

[ https://issues.apache.org/jira/browse/SPARK-20567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20567: Assignee: Apache Spark (was: Michael Armbrust) > Failure to bind when using explode and

[jira] [Commented] (SPARK-20567) Failure to bind when using explode and collect_set in streaming

[ https://issues.apache.org/jira/browse/SPARK-20567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994085#comment-15994085 ] Apache Spark commented on SPARK-20567: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Created] (SPARK-20567) Failure to bind when using explode and collect_set in streaming

Michael Armbrust created SPARK-20567: Summary: Failure to bind when using explode and collect_set in streaming Key: SPARK-20567 URL: https://issues.apache.org/jira/browse/SPARK-20567 Project:

[jira] [Commented] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993888#comment-15993888 ] Josh Rosen commented on SPARK-10878: [~jeeyoungk], my understanding is that there are two possible

[jira] [Assigned] (SPARK-20566) ColumnVector should support `appendFloats` for array

[ https://issues.apache.org/jira/browse/SPARK-20566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20566: Assignee: (was: Apache Spark) > ColumnVector should support `appendFloats` for array

[jira] [Assigned] (SPARK-20566) ColumnVector should support `appendFloats` for array

[ https://issues.apache.org/jira/browse/SPARK-20566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20566: Assignee: Apache Spark > ColumnVector should support `appendFloats` for array >

[jira] [Commented] (SPARK-20566) ColumnVector should support `appendFloats` for array

[ https://issues.apache.org/jira/browse/SPARK-20566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993753#comment-15993753 ] Apache Spark commented on SPARK-20566: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-20566) ColumnVector should support `appendFloats` for array

[ https://issues.apache.org/jira/browse/SPARK-20566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20566: -- Description: This issue aims to add a missing `appendFloats` API for array into ColumnVector

[jira] [Commented] (SPARK-20557) JdbcUtils doesn't support java.sql.Types.TIMESTAMP_WITH_TIMEZONE

[ https://issues.apache.org/jira/browse/SPARK-20557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993745#comment-15993745 ] Apache Spark commented on SPARK-20557: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-20566) ColumnVector should support `appendFloats` for array

Dongjoon Hyun created SPARK-20566: - Summary: ColumnVector should support `appendFloats` for array Key: SPARK-20566 URL: https://issues.apache.org/jira/browse/SPARK-20566 Project: Spark Issue

[jira] [Updated] (SPARK-20565) Improve the error message for unsupported JDBC types

[ https://issues.apache.org/jira/browse/SPARK-20565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20565: Description: For unsupported data types, we simply output the type number instead of the type name.

[jira] [Created] (SPARK-20565) Improve the error message for unsupported JDBC types

Xiao Li created SPARK-20565: --- Summary: Improve the error message for unsupported JDBC types Key: SPARK-20565 URL: https://issues.apache.org/jira/browse/SPARK-20565 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-20529) Worker should not use the received Master address

[ https://issues.apache.org/jira/browse/SPARK-20529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-20529: Assignee: Shixiong Zhu > Worker should not use the received Master address >

[jira] [Updated] (SPARK-20529) Worker should not use the received Master address

[ https://issues.apache.org/jira/browse/SPARK-20529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20529: - Affects Version/s: 2.2.0 1.6.3 2.0.2 > Worker

[jira] [Resolved] (SPARK-20531) Spark master shouldn't send its address back to the workers over proxied connections

[ https://issues.apache.org/jira/browse/SPARK-20531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-20531. -- Resolution: Duplicate > Spark master shouldn't send its address back to the workers over

[jira] [Updated] (SPARK-20436) NullPointerException when restart from checkpoint file

[ https://issues.apache.org/jira/browse/SPARK-20436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20436: - Issue Type: Question (was: Bug) > NullPointerException when restart from checkpoint file >

[jira] [Commented] (SPARK-20436) NullPointerException when restart from checkpoint file

[ https://issues.apache.org/jira/browse/SPARK-20436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993663#comment-15993663 ] Shixiong Zhu commented on SPARK-20436: -- [~ffbin] the issue is this line {{val words2 =

[jira] [Resolved] (SPARK-20436) NullPointerException when restart from checkpoint file

[ https://issues.apache.org/jira/browse/SPARK-20436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-20436. -- Resolution: Not A Problem > NullPointerException when restart from checkpoint file >

[jira] [Updated] (SPARK-20547) ExecutorClassLoader's findClass may not work correctly when a task is cancelled.

[ https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20547: - Target Version/s: (was: 2.2.0) > ExecutorClassLoader's findClass may not work correctly when a

[jira] [Updated] (SPARK-20547) ExecutorClassLoader's findClass may not work correctly when a task is cancelled.

[ https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20547: - Priority: Minor (was: Blocker) > ExecutorClassLoader's findClass may not work correctly when a

[jira] [Created] (SPARK-20564) a lot of executor failures when the executor number is more than 2000

Hua Liu created SPARK-20564: --- Summary: a lot of executor failures when the executor number is more than 2000 Key: SPARK-20564 URL: https://issues.apache.org/jira/browse/SPARK-20564 Project: Spark

[jira] [Comment Edited] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993464#comment-15993464 ] Herman van Hovell edited comment on SPARK-20556 at 5/2/17 6:34 PM: ---

[jira] [Commented] (SPARK-7481) Add spark-hadoop-cloud module to pull in object store support

[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993465#comment-15993465 ] Apache Spark commented on SPARK-7481: - User 'steveloughran' has created a pull request for this issue:

[jira] [Commented] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993464#comment-15993464 ] Herman van Hovell commented on SPARK-20556: --- [~vlyubin] This was fixed in SPARK-18952, lets

[jira] [Closed] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-20556. - Resolution: Duplicate Fix Version/s: 2.2.0 > codehaus fails to generate code

[jira] [Updated] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-20556: -- Component/s: (was: Optimizer) SQL > codehaus fails to generate

[jira] [Commented] (SPARK-20547) ExecutorClassLoader's findClass may not work correctly when a task is cancelled.

[ https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993426#comment-15993426 ] Shixiong Zhu commented on SPARK-20547: -- Did some investigation using the reproducer. Looks like it’s

[jira] [Commented] (SPARK-20370) create external table on read only location fails

[ https://issues.apache.org/jira/browse/SPARK-20370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993405#comment-15993405 ] Steve Loughran commented on SPARK-20370: Is this the bit under the PR tagged "!! HACK ALERT !!"

[jira] [Commented] (SPARK-20560) Review Spark's handling of filesystems returning "localhost" in getFileBlockLocations

[ https://issues.apache.org/jira/browse/SPARK-20560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993323#comment-15993323 ] Steve Loughran commented on SPARK-20560: To follow this up, I've now got a test which verifies

[jira] [Created] (SPARK-20563) going to DataFrame to RDD and back changes the schema, if the schema is not explicitly provided

Danil Kirsanov created SPARK-20563: -- Summary: going to DataFrame to RDD and back changes the schema, if the schema is not explicitly provided Key: SPARK-20563 URL:

[jira] [Updated] (SPARK-20562) Support Maintenance by having a threshold for unavailability

[ https://issues.apache.org/jira/browse/SPARK-20562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamal Gurala updated SPARK-20562: - Description: Make Spark be aware of offers that have an unavailability period set because of a

[jira] [Created] (SPARK-20562) Support Maintenance by having a threshold for unavailability

Kamal Gurala created SPARK-20562: Summary: Support Maintenance by having a threshold for unavailability Key: SPARK-20562 URL: https://issues.apache.org/jira/browse/SPARK-20562 Project: Spark

[jira] [Resolved] (SPARK-20560) Review Spark's handling of filesystems returning "localhost" in getFileBlockLocations

[ https://issues.apache.org/jira/browse/SPARK-20560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-20560. Resolution: Invalid "localhost" is filtered, been done in

[jira] [Commented] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993023#comment-15993023 ] Volodymyr Lyubinets commented on SPARK-20556: - Here's an edited code that produces this:

[jira] [Created] (SPARK-20561) Running SparkR with no RHive installed in secured environment

Natalie created SPARK-20561: --- Summary: Running SparkR with no RHive installed in secured environment Key: SPARK-20561 URL: https://issues.apache.org/jira/browse/SPARK-20561 Project: Spark Issue

[jira] [Commented] (SPARK-20560) Review Spark's handling of filesystems returning "localhost" in getFileBlockLocations

[ https://issues.apache.org/jira/browse/SPARK-20560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993008#comment-15993008 ] Steve Loughran commented on SPARK-20560: {{FileSystem.getFileBlockLocations(path)}} is only

[jira] [Created] (SPARK-20560) Review Spark's handling of filesystems returning "localhost" in getFileBlockLocations

Steve Loughran created SPARK-20560: -- Summary: Review Spark's handling of filesystems returning "localhost" in getFileBlockLocations Key: SPARK-20560 URL: https://issues.apache.org/jira/browse/SPARK-20560

[jira] [Resolved] (SPARK-20559) Refreshing a cached RDD without restarting the Spark application

[ https://issues.apache.org/jira/browse/SPARK-20559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20559. --- Resolution: Invalid This should go to u...@spark.apache.org > Refreshing a cached RDD without

[jira] [Created] (SPARK-20559) Refreshing a cached RDD without restarting the Spark application

Jayesh lalwani created SPARK-20559: -- Summary: Refreshing a cached RDD without restarting the Spark application Key: SPARK-20559 URL: https://issues.apache.org/jira/browse/SPARK-20559 Project: Spark

[jira] [Commented] (SPARK-19582) DataFrameReader conceptually inadequate

[ https://issues.apache.org/jira/browse/SPARK-19582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992985#comment-15992985 ] Steve Loughran commented on SPARK-19582: All spark is doing is taking a URL To data, mapping that

[jira] [Commented] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992955#comment-15992955 ] Wenchen Fan commented on SPARK-20548: - I'll re-enable this test after

[jira] [Updated] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

[ https://issues.apache.org/jira/browse/SPARK-20555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Feher updated SPARK-20555: Description: When querying an Oracle database, Spark maps some Oracle numeric data types to

[jira] [Updated] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

[ https://issues.apache.org/jira/browse/SPARK-20555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Feher updated SPARK-20555: Description: When querying an Oracle database, Spark maps some Oracle numeric data types to

[jira] [Assigned] (SPARK-20558) clear InheritableThreadLocal variables in SparkContext when stopping it

[ https://issues.apache.org/jira/browse/SPARK-20558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20558: Assignee: Apache Spark (was: Wenchen Fan) > clear InheritableThreadLocal variables in

[jira] [Commented] (SPARK-20558) clear InheritableThreadLocal variables in SparkContext when stopping it

[ https://issues.apache.org/jira/browse/SPARK-20558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992941#comment-15992941 ] Apache Spark commented on SPARK-20558: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20558) clear InheritableThreadLocal variables in SparkContext when stopping it

[ https://issues.apache.org/jira/browse/SPARK-20558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20558: Assignee: Wenchen Fan (was: Apache Spark) > clear InheritableThreadLocal variables in

[jira] [Commented] (SPARK-20557) JdbcUtils doesn't support java.sql.Types.TIMESTAMP_WITH_TIMEZONE

[ https://issues.apache.org/jira/browse/SPARK-20557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992922#comment-15992922 ] Apache Spark commented on SPARK-20557: -- User 'JannikArndt' has created a pull request for this

[jira] [Assigned] (SPARK-20557) JdbcUtils doesn't support java.sql.Types.TIMESTAMP_WITH_TIMEZONE

[ https://issues.apache.org/jira/browse/SPARK-20557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20557: Assignee: (was: Apache Spark) > JdbcUtils doesn't support

[jira] [Assigned] (SPARK-20557) JdbcUtils doesn't support java.sql.Types.TIMESTAMP_WITH_TIMEZONE

[ https://issues.apache.org/jira/browse/SPARK-20557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20557: Assignee: Apache Spark > JdbcUtils doesn't support java.sql.Types.TIMESTAMP_WITH_TIMEZONE

[jira] [Created] (SPARK-20558) clear InheritableThreadLocal variables in SparkContext when stopping it

Wenchen Fan created SPARK-20558: --- Summary: clear InheritableThreadLocal variables in SparkContext when stopping it Key: SPARK-20558 URL: https://issues.apache.org/jira/browse/SPARK-20558 Project: Spark

[jira] [Commented] (SPARK-20546) spark-class gets syntax error in posix mode

[ https://issues.apache.org/jira/browse/SPARK-20546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992886#comment-15992886 ] Jessie Yu commented on SPARK-20546: --- Given the current code relies on posix mode being off, turning it

[jira] [Created] (SPARK-20557) JdbcUtils doesn't support java.sql.Types.TIMESTAMP_WITH_TIMEZONE

Jannik Arndt created SPARK-20557: Summary: JdbcUtils doesn't support java.sql.Types.TIMESTAMP_WITH_TIMEZONE Key: SPARK-20557 URL: https://issues.apache.org/jira/browse/SPARK-20557 Project: Spark

[jira] [Commented] (SPARK-20395) Upgrade to Scala 2.11.11

[ https://issues.apache.org/jira/browse/SPARK-20395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992814#comment-15992814 ] Sean Owen commented on SPARK-20395: --- [~jeremyrsmith] I tried updating to Scala 2.11.11 today and it

[jira] [Commented] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992813#comment-15992813 ] Sean Owen commented on SPARK-20556: --- Do you have a reproduction? > codehaus fails to generate code

[jira] [Assigned] (SPARK-18777) Return UDF objects when registering from Python

[ https://issues.apache.org/jira/browse/SPARK-18777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18777: Assignee: (was: Apache Spark) > Return UDF objects when registering from Python >

[jira] [Assigned] (SPARK-18777) Return UDF objects when registering from Python

[ https://issues.apache.org/jira/browse/SPARK-18777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18777: Assignee: Apache Spark > Return UDF objects when registering from Python >

[jira] [Commented] (SPARK-18777) Return UDF objects when registering from Python

[ https://issues.apache.org/jira/browse/SPARK-18777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992812#comment-15992812 ] Apache Spark commented on SPARK-18777: -- User 'zero323' has created a pull request for this issue:

[jira] [Updated] (SPARK-20556) codehaus fails to generate code because of unescaped strings

[ https://issues.apache.org/jira/browse/SPARK-20556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Volodymyr Lyubinets updated SPARK-20556: Description: I guess somewhere along the way Spark uses codehaus to generate

[jira] [Created] (SPARK-20556) codehaus fails to generate code because of unescaped strings

Volodymyr Lyubinets created SPARK-20556: --- Summary: codehaus fails to generate code because of unescaped strings Key: SPARK-20556 URL: https://issues.apache.org/jira/browse/SPARK-20556 Project:

[jira] [Commented] (SPARK-3528) Reading data from file:/// should be called NODE_LOCAL not PROCESS_LOCAL

[ https://issues.apache.org/jira/browse/SPARK-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992745#comment-15992745 ] Ramgopal N commented on SPARK-3528: --- I have spark running on Mesos. Mesos agents are running on

[jira] [Commented] (SPARK-19019) PySpark does not work with Python 3.6.0

[ https://issues.apache.org/jira/browse/SPARK-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992699#comment-15992699 ] Hyukjin Kwon commented on SPARK-19019: -- To solve this problem fully, I had to port cloudpickle

[jira] [Updated] (SPARK-19019) PySpark does not work with Python 3.6.0

[ https://issues.apache.org/jira/browse/SPARK-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-19019: - Fix Version/s: 2.0.3 1.6.4 > PySpark does not work with Python 3.6.0 >

[jira] [Assigned] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

[ https://issues.apache.org/jira/browse/SPARK-20555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20555: Assignee: (was: Apache Spark) > Incorrect handling of Oracle's decimal types via JDBC

[jira] [Assigned] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

[ https://issues.apache.org/jira/browse/SPARK-20555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20555: Assignee: Apache Spark > Incorrect handling of Oracle's decimal types via JDBC >

[jira] [Commented] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

[ https://issues.apache.org/jira/browse/SPARK-20555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992685#comment-15992685 ] Apache Spark commented on SPARK-20555: -- User 'gaborfeher' has created a pull request for this issue:

[jira] [Created] (SPARK-20555) Incorrect handling of Oracle's decimal types via JDBC

Gabor Feher created SPARK-20555: --- Summary: Incorrect handling of Oracle's decimal types via JDBC Key: SPARK-20555 URL: https://issues.apache.org/jira/browse/SPARK-20555 Project: Spark Issue

[jira] [Commented] (SPARK-18891) Support for specific collection types

[ https://issues.apache.org/jira/browse/SPARK-18891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992672#comment-15992672 ] Nils Grabbert commented on SPARK-18891: --- Example in SPARK-19104 still not working. > Support for

[jira] [Commented] (SPARK-20554) Remove usage of scala.language.reflectiveCalls

[ https://issues.apache.org/jira/browse/SPARK-20554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992614#comment-15992614 ] Umesh Chaudhary commented on SPARK-20554: - [~srowen] I can work on this. Currently seeing 15

[jira] [Created] (SPARK-20554) Remove usage of scala.language.reflectiveCalls

Sean Owen created SPARK-20554: - Summary: Remove usage of scala.language.reflectiveCalls Key: SPARK-20554 URL: https://issues.apache.org/jira/browse/SPARK-20554 Project: Spark Issue Type:

[jira] [Created] (SPARK-20553) Update ALS examples for ML to illustrate recommend all

Nick Pentreath created SPARK-20553: -- Summary: Update ALS examples for ML to illustrate recommend all Key: SPARK-20553 URL: https://issues.apache.org/jira/browse/SPARK-20553 Project: Spark

[jira] [Resolved] (SPARK-20300) Python API for ALSModel.recommendForAllUsers,Items

[ https://issues.apache.org/jira/browse/SPARK-20300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-20300. Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17622

[jira] [Commented] (SPARK-20411) New features for expression.scalalang.typed

[ https://issues.apache.org/jira/browse/SPARK-20411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992517#comment-15992517 ] Jason Moore commented on SPARK-20411: - And, ideally, anything else within

[jira] [Commented] (SPARK-20443) The blockSize of MLLIB ALS should be setting by the User

[ https://issues.apache.org/jira/browse/SPARK-20443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992497#comment-15992497 ] Nick Pentreath commented on SPARK-20443: Interesting - though it appears to me that {{2048}} is

[jira] [Commented] (SPARK-20443) The blockSize of MLLIB ALS should be setting by the User

[ https://issues.apache.org/jira/browse/SPARK-20443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992492#comment-15992492 ] Teng Jiang commented on SPARK-20443: All the tests above were did with SPARK-11968 / [PR #17742 |

[jira] [Commented] (SPARK-20551) ImportError adding custom class from jar in pyspark

[ https://issues.apache.org/jira/browse/SPARK-20551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992491#comment-15992491 ] Nick Pentreath commented on SPARK-20551: Yes I agree that it appears you're trying to import Java

[jira] [Closed] (SPARK-20551) ImportError adding custom class from jar in pyspark

[ https://issues.apache.org/jira/browse/SPARK-20551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath closed SPARK-20551. -- Resolution: Not A Problem > ImportError adding custom class from jar in pyspark >

[jira] [Resolved] (SPARK-20552) Add isNotDistinctFrom/isDistinctFrom for column APIs in Scala/Java and Python

[ https://issues.apache.org/jira/browse/SPARK-20552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20552. -- Resolution: Won't Fix I am resolving this. Please refer the discussion in the PR. > Add

[jira] [Commented] (SPARK-20443) The blockSize of MLLIB ALS should be setting by the User

[ https://issues.apache.org/jira/browse/SPARK-20443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992475#comment-15992475 ] Nick Pentreath commented on SPARK-20443: Were these tests against existing master? Because

[jira] [Commented] (SPARK-20443) The blockSize of MLLIB ALS should be setting by the User

[ https://issues.apache.org/jira/browse/SPARK-20443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992471#comment-15992471 ] Teng Jiang commented on SPARK-20443: I did some tests on the blockSize. The test environment is: 3

[jira] [Resolved] (SPARK-20549) java.io.CharConversionException: Invalid UTF-32 in JsonToStructs

[ https://issues.apache.org/jira/browse/SPARK-20549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20549. - Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.3.0