[jira] [Resolved] (SPARK-20549) java.io.CharConversionException: Invalid UTF-32 in JsonToStructs

2017-05-01 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20549. - Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.3.0 2.

[jira] [Resolved] (SPARK-20537) OffHeapColumnVector reallocation may not copy existing data

2017-05-01 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20537. - Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-20526) Load doesn't work in PCAModel

2017-05-01 Thread 颜发才
[ https://issues.apache.org/jira/browse/SPARK-20526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992367#comment-15992367 ] Yan Facai (颜发才) commented on SPARK-20526: - Can you give a sample code? > Load do

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

2017-05-01 Thread arpit bhatnagar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992363#comment-15992363 ] arpit bhatnagar commented on SPARK-12216: -- is there any work around for this is

[jira] [Commented] (SPARK-20047) Constrained Logistic Regression

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992330#comment-15992330 ] Apache Spark commented on SPARK-20047: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-20490) Add eqNullSafe, not and ! to SparkR

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992328#comment-15992328 ] Apache Spark commented on SPARK-20490: -- User 'felixcheung' has created a pull reques

[jira] [Resolved] (SPARK-20532) SparkR should provide grouping and grouping_id

2017-05-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20532. -- Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20192) SparkR 2.2.0 migration guide, release note

2017-05-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20192. -- Resolution: Fixed Fix Version/s: 2.3.0 2.2.0 Target Versi

[jira] [Commented] (SPARK-20192) SparkR 2.2.0 migration guide, release note

2017-05-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992306#comment-15992306 ] Felix Cheung commented on SPARK-20192: -- SPARK-20513 for release note instead > Spar

[jira] [Assigned] (SPARK-20552) Add isNotDistinctFrom/isDistinctFrom for column APIs in Scala/Java and Python

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20552: Assignee: (was: Apache Spark) > Add isNotDistinctFrom/isDistinctFrom for column APIs

[jira] [Assigned] (SPARK-20552) Add isNotDistinctFrom/isDistinctFrom for column APIs in Scala/Java and Python

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20552: Assignee: Apache Spark > Add isNotDistinctFrom/isDistinctFrom for column APIs in Scala/Ja

[jira] [Commented] (SPARK-20552) Add isNotDistinctFrom/isDistinctFrom for column APIs in Scala/Java and Python

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992295#comment-15992295 ] Apache Spark commented on SPARK-20552: -- User 'HyukjinKwon' has created a pull reques

[jira] [Commented] (SPARK-4899) Support Mesos features: roles and checkpoints

2017-05-01 Thread Kamal Gurala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992255#comment-15992255 ] Kamal Gurala commented on SPARK-4899: - Can one of the admins verify this patch? > Su

[jira] [Issue Comment Deleted] (SPARK-4899) Support Mesos features: roles and checkpoints

2017-05-01 Thread Kamal Gurala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamal Gurala updated SPARK-4899: Comment: was deleted (was: Can one of the admins verify this patch? ) > Support Mesos features: rol

[jira] [Issue Comment Deleted] (SPARK-20419) Support for Mesos Maintenance primitives

2017-05-01 Thread Kamal Gurala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamal Gurala updated SPARK-20419: - Comment: was deleted (was: Can one of the admins verify this patch?) > Support for Mesos Mainten

[jira] [Commented] (SPARK-20419) Support for Mesos Maintenance primitives

2017-05-01 Thread Kamal Gurala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992229#comment-15992229 ] Kamal Gurala commented on SPARK-20419: -- Can one of the admins verify this patch? >

[jira] [Updated] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

2017-05-01 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-17827: - Issue Type: Sub-task (was: Bug) Parent: SPARK-16026 > StatisticsColumnSuite failures on

[jira] [Commented] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991976#comment-15991976 ] Herman van Hovell commented on SPARK-20548: --- I jumped the gun on this one, the

[jira] [Reopened] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reopened SPARK-20548: --- > Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class > -

[jira] [Created] (SPARK-20552) Add isNotDistinctFrom/isDistinctFrom for column APIs in Scala/Java and Python

2017-05-01 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-20552: Summary: Add isNotDistinctFrom/isDistinctFrom for column APIs in Scala/Java and Python Key: SPARK-20552 URL: https://issues.apache.org/jira/browse/SPARK-20552 Projec

[jira] [Commented] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

2017-05-01 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991945#comment-15991945 ] Jo Desmet commented on SPARK-15343: --- So the issue is fixed by moving to at least Hadoop

[jira] [Commented] (SPARK-20551) ImportError adding custom class from jar in pyspark

2017-05-01 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991929#comment-15991929 ] Hyukjin Kwon commented on SPARK-20551: -- It sounds you are importing jars in Python w

[jira] [Resolved] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20548. --- Resolution: Fixed Assignee: Sameer Agarwal Fix Version/s: 2.2.0 > Fla

[jira] [Created] (SPARK-20551) ImportError adding custom class from jar in pyspark

2017-05-01 Thread Sergio Monteiro (JIRA)
Sergio Monteiro created SPARK-20551: --- Summary: ImportError adding custom class from jar in pyspark Key: SPARK-20551 URL: https://issues.apache.org/jira/browse/SPARK-20551 Project: Spark Iss

[jira] [Assigned] (SPARK-20463) Add support for IS [NOT] DISTINCT FROM to SPARK SQL

2017-05-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20463: --- Assignee: Michael Styles > Add support for IS [NOT] DISTINCT FROM to SPARK SQL > ---

[jira] [Resolved] (SPARK-20463) Add support for IS [NOT] DISTINCT FROM to SPARK SQL

2017-05-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20463. - Resolution: Fixed Fix Version/s: 2.3.0 > Add support for IS [NOT] DISTINCT FROM to SPARK SQL > ---

[jira] [Resolved] (SPARK-20459) JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException

2017-05-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20459. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > JdbcUtils throws IllegalStateExc

[jira] [Assigned] (SPARK-20459) JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException

2017-05-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20459: --- Assignee: Sean Owen > JdbcUtils throws IllegalStateException: Cause already initialized after > get

[jira] [Assigned] (SPARK-20549) java.io.CharConversionException: Invalid UTF-32 in JsonToStructs

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20549: Assignee: Apache Spark > java.io.CharConversionException: Invalid UTF-32 in JsonToStructs

[jira] [Commented] (SPARK-20549) java.io.CharConversionException: Invalid UTF-32 in JsonToStructs

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991809#comment-15991809 ] Apache Spark commented on SPARK-20549: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-20549) java.io.CharConversionException: Invalid UTF-32 in JsonToStructs

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20549: Assignee: (was: Apache Spark) > java.io.CharConversionException: Invalid UTF-32 in Jso

[jira] [Updated] (SPARK-20547) ExecutorClassLoader's findClass may not work correctly when a task is cancelled.

2017-05-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20547: - Component/s: (was: Spark Core) Spark Shell > ExecutorClassLoader's findClass

[jira] [Comment Edited] (SPARK-20547) ExecutorClassLoader's findClass may not work correctly when a task is cancelled.

2017-05-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991794#comment-15991794 ] Shixiong Zhu edited comment on SPARK-20547 at 5/1/17 11:37 PM:

[jira] [Commented] (SPARK-20547) ExecutorClassLoader's findClass may not work correctly when a task is cancelled.

2017-05-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991794#comment-15991794 ] Shixiong Zhu commented on SPARK-20547: -- This is a reproducer: https://github.com/ap

[jira] [Assigned] (SPARK-20550) R wrappers for Dataset.alias

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20550: Assignee: (was: Apache Spark) > R wrappers for Dataset.alias > ---

[jira] [Assigned] (SPARK-20550) R wrappers for Dataset.alias

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20550: Assignee: Apache Spark > R wrappers for Dataset.alias > > >

[jira] [Commented] (SPARK-20550) R wrappers for Dataset.alias

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991706#comment-15991706 ] Apache Spark commented on SPARK-20550: -- User 'zero323' has created a pull request fo

[jira] [Commented] (SPARK-20421) Mark JobProgressListener (and related classes) as deprecated

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991703#comment-15991703 ] Apache Spark commented on SPARK-20421: -- User 'vanzin' has created a pull request for

[jira] [Created] (SPARK-20550) R wrappers for Dataset.alias

2017-05-01 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-20550: -- Summary: R wrappers for Dataset.alias Key: SPARK-20550 URL: https://issues.apache.org/jira/browse/SPARK-20550 Project: Spark Issue Type: Improvem

[jira] [Created] (SPARK-20549) java.io.CharConversionException: Invalid UTF-32 in JsonToStructs

2017-05-01 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-20549: --- Summary: java.io.CharConversionException: Invalid UTF-32 in JsonToStructs Key: SPARK-20549 URL: https://issues.apache.org/jira/browse/SPARK-20549 Project: Spark

[jira] [Commented] (SPARK-20546) spark-class gets syntax error in posix mode

2017-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991678#comment-15991678 ] Sean Owen commented on SPARK-20546: --- Are there downsides to turning off posix mode? It

[jira] [Assigned] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20548: Assignee: Apache Spark > Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined cla

[jira] [Assigned] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20548: Assignee: (was: Apache Spark) > Flaky Test: ReplSuite.newProductSeqEncoder with REPL

[jira] [Updated] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-20548: --- Description: {{newProductSeqEncoder with REPL defined class}} in {{ReplSuite}} has been fail

[jira] [Commented] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991633#comment-15991633 ] Apache Spark commented on SPARK-20548: -- User 'sameeragarwal' has created a pull requ

[jira] [Commented] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991626#comment-15991626 ] Sameer Agarwal commented on SPARK-20548: I'm going to disable this test in the sh

[jira] [Resolved] (SPARK-20540) Dynamic allocation constantly requests and kills executors

2017-05-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20540. Resolution: Fixed Assignee: Ryan Blue Fix Version/s: 2.2.0

[jira] [Updated] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-20548: --- Description: {{newProductSeqEncoder with REPL defined class}} in {{ReplSuite}} has been faili

[jira] [Created] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-20548: -- Summary: Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class Key: SPARK-20548 URL: https://issues.apache.org/jira/browse/SPARK-20548 Project: Spar

[jira] [Assigned] (SPARK-20454) Improvement of ShortestPaths in Spark GraphX

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20454: Assignee: Apache Spark > Improvement of ShortestPaths in Spark GraphX > --

[jira] [Assigned] (SPARK-20454) Improvement of ShortestPaths in Spark GraphX

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20454: Assignee: (was: Apache Spark) > Improvement of ShortestPaths in Spark GraphX > ---

[jira] [Commented] (SPARK-20454) Improvement of ShortestPaths in Spark GraphX

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991590#comment-15991590 ] Apache Spark commented on SPARK-20454: -- User 'daijidj' has created a pull request fo

[jira] [Updated] (SPARK-20547) ExecutorClassLoader's findClass may not work correctly when a task is cancelled.

2017-05-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-20547: - Affects Version/s: 2.2.0 Target Version/s: 2.2.0 > ExecutorClassLoader's findClass m

[jira] [Updated] (SPARK-20547) ExecutorClassLoader's findClass may not work correctly when a task is cancelled.

2017-05-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20547: - Description: ExecutorClassLoader's findClass may throw some transient exception. For example, wh

[jira] [Updated] (SPARK-20547) ExecutorClassLoader's findClass may not work correctly when a task is cancelled.

2017-05-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20547: - Priority: Blocker (was: Major) > ExecutorClassLoader's findClass may not work correctly when a t

[jira] [Created] (SPARK-20547) ExecutorClassLoader's findClass may not work correctly when a task is cancelled.

2017-05-01 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-20547: Summary: ExecutorClassLoader's findClass may not work correctly when a task is cancelled. Key: SPARK-20547 URL: https://issues.apache.org/jira/browse/SPARK-20547 Proj

[jira] [Created] (SPARK-20546) spark-class gets syntax error in posix mode

2017-05-01 Thread Jessie Yu (JIRA)
Jessie Yu created SPARK-20546: - Summary: spark-class gets syntax error in posix mode Key: SPARK-20546 URL: https://issues.apache.org/jira/browse/SPARK-20546 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-20464) Add a job group and an informative description for streaming queries

2017-05-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-20464. -- Resolution: Fixed Assignee: Kunal Khamar Fix Version/s: 2.2.0 > Add a job group

[jira] [Assigned] (SPARK-20529) Worker should not use the received Master address

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20529: Assignee: (was: Apache Spark) > Worker should not use the received Master address > --

[jira] [Assigned] (SPARK-20529) Worker should not use the received Master address

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20529: Assignee: Apache Spark > Worker should not use the received Master address > -

[jira] [Commented] (SPARK-20529) Worker should not use the received Master address

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991197#comment-15991197 ] Apache Spark commented on SPARK-20529: -- User 'zsxwing' has created a pull request fo

[jira] [Resolved] (SPARK-20517) Download link in history server UI is not correct

2017-05-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20517. Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 2.2.1

[jira] [Commented] (SPARK-20429) [GRAPHX] Strange results for personalized pagerank if node is involved in a cycle

2017-05-01 Thread Andrew Ray (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991099#comment-15991099 ] Andrew Ray commented on SPARK-20429: Can you retest your example with Spark 2.2/maste

[jira] [Resolved] (SPARK-20534) Outer generators skip missing records if used alone

2017-05-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20534. - Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s: 2.3.0 2.2

[jira] [Updated] (SPARK-20534) Outer generators skip missing records if used alone

2017-05-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20534: Labels: (was: correctness) > Outer generators skip missing records if used alone > --

[jira] [Resolved] (SPARK-20290) PySpark Column should provide eqNullSafe

2017-05-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20290. - Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s: 2.3.0 > PySpark Column shou

[jira] [Commented] (SPARK-19697) NoSuchMethodError: org.apache.avro.Schema.getLogicalType()

2017-05-01 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991022#comment-15991022 ] Michael Heuer commented on SPARK-19697: --- dongjoon: Wait a minute, if I understand c

[jira] [Commented] (SPARK-20501) ML, Graph 2.2 QA: API: New Scala APIs, docs

2017-05-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15990978#comment-15990978 ] Yanbo Liang commented on SPARK-20501: - I'm starting this work. Thanks. > ML, Graph 2

[jira] [Assigned] (SPARK-20501) ML, Graph 2.2 QA: API: New Scala APIs, docs

2017-05-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-20501: --- Assignee: Yanbo Liang > ML, Graph 2.2 QA: API: New Scala APIs, docs > --

[jira] [Commented] (SPARK-19697) NoSuchMethodError: org.apache.avro.Schema.getLogicalType()

2017-05-01 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15990972#comment-15990972 ] Michael Heuer commented on SPARK-19697: --- We currently declare our compile time depe

[jira] [Commented] (SPARK-19697) NoSuchMethodError: org.apache.avro.Schema.getLogicalType()

2017-05-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15990957#comment-15990957 ] Dongjoon Hyun commented on SPARK-19697: --- [~heuermh], Could you try to specify your

[jira] [Commented] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

2017-05-01 Thread N Campbell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15990849#comment-15990849 ] N Campbell commented on SPARK-9686: --- Is this likely to be fixed? current forces compan

[jira] [Assigned] (SPARK-20542) Add an API into Bucketizer that can bin a lot of columns all at once

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20542: Assignee: (was: Apache Spark) > Add an API into Bucketizer that can bin a lot of colum

[jira] [Assigned] (SPARK-20542) Add an API into Bucketizer that can bin a lot of columns all at once

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20542: Assignee: Apache Spark > Add an API into Bucketizer that can bin a lot of columns all at o

[jira] [Commented] (SPARK-20542) Add an API into Bucketizer that can bin a lot of columns all at once

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15990840#comment-15990840 ] Apache Spark commented on SPARK-20542: -- User 'viirya' has created a pull request for

[jira] [Created] (SPARK-20545) union set operator should default to DISTINCT and not ALL semantics

2017-05-01 Thread N Campbell (JIRA)
N Campbell created SPARK-20545: -- Summary: union set operator should default to DISTINCT and not ALL semantics Key: SPARK-20545 URL: https://issues.apache.org/jira/browse/SPARK-20545 Project: Spark

[jira] [Assigned] (SPARK-20544) R wrapper for input_file_name

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20544: Assignee: (was: Apache Spark) > R wrapper for input_file_name > --

[jira] [Assigned] (SPARK-20544) R wrapper for input_file_name

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20544: Assignee: Apache Spark > R wrapper for input_file_name > - > >

[jira] [Commented] (SPARK-20544) R wrapper for input_file_name

2017-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15990635#comment-15990635 ] Apache Spark commented on SPARK-20544: -- User 'zero323' has created a pull request fo

[jira] [Created] (SPARK-20544) R wrapper for input_file_name

2017-05-01 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-20544: -- Summary: R wrapper for input_file_name Key: SPARK-20544 URL: https://issues.apache.org/jira/browse/SPARK-20544 Project: Spark Issue Type: Improve