[jira] [Commented] (SPARK-17897) not isnotnull is converted to the always false condition isnotnull && not isnotnull

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862298#comment-15862298 ] Apache Spark commented on SPARK-17897: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-19555) Improve inefficient StringUtils.escapeLikeRegex() method

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862293#comment-15862293 ] Apache Spark commented on SPARK-19555: -- User 'lins05' has created a pull request for

[jira] [Assigned] (SPARK-19555) Improve inefficient StringUtils.escapeLikeRegex() method

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19555: Assignee: Apache Spark > Improve inefficient StringUtils.escapeLikeRegex() method > --

[jira] [Assigned] (SPARK-19555) Improve inefficient StringUtils.escapeLikeRegex() method

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19555: Assignee: (was: Apache Spark) > Improve inefficient StringUtils.escapeLikeRegex() meth

[jira] [Resolved] (SPARK-19537) Move the pendingPartitions variable from Stage to ShuffleMapStage

2017-02-10 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-19537. Resolution: Fixed Fix Version/s: 2.2.0 > Move the pendingPartitions variable from St

[jira] [Closed] (SPARK-19502) Remove unnecessary code to re-submit stages in the DAGScheduler

2017-02-10 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout closed SPARK-19502. -- Resolution: Not A Problem This code actually is currently needed to handle cases where a Shuffl

[jira] [Updated] (SPARK-19538) DAGScheduler and TaskSetManager can have an inconsistent view of whether a stage is complete.

2017-02-10 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-19538: --- Priority: Minor (was: Major) > DAGScheduler and TaskSetManager can have an inconsistent view

[jira] [Commented] (SPARK-19560) Improve tests for when DAGScheduler learns of "successful" ShuffleMapTask from a failed executor

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862248#comment-15862248 ] Apache Spark commented on SPARK-19560: -- User 'kayousterhout' has created a pull requ

[jira] [Assigned] (SPARK-19560) Improve tests for when DAGScheduler learns of "successful" ShuffleMapTask from a failed executor

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19560: Assignee: Apache Spark (was: Kay Ousterhout) > Improve tests for when DAGScheduler learns

[jira] [Assigned] (SPARK-19560) Improve tests for when DAGScheduler learns of "successful" ShuffleMapTask from a failed executor

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19560: Assignee: Kay Ousterhout (was: Apache Spark) > Improve tests for when DAGScheduler learns

[jira] [Created] (SPARK-19560) Improve tests for when DAGScheduler learns of "successful" ShuffleMapTask from a failed executor

2017-02-10 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-19560: -- Summary: Improve tests for when DAGScheduler learns of "successful" ShuffleMapTask from a failed executor Key: SPARK-19560 URL: https://issues.apache.org/jira/browse/SPARK-195

[jira] [Commented] (SPARK-19318) Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle`

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862207#comment-15862207 ] Apache Spark commented on SPARK-19318: -- User 'sureshthalamati' has created a pull re

[jira] [Updated] (SPARK-19559) Fix flaky KafkaSourceSuite.subscribing topic by pattern with topic deletions

2017-02-10 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-19559: --- Description: This test has started failing frequently recently; e.g., https://amplab.cs.berk

[jira] [Created] (SPARK-19559) Fix flaky KafkaSourceSuite.subscribing topic by pattern with topic deletions

2017-02-10 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-19559: -- Summary: Fix flaky KafkaSourceSuite.subscribing topic by pattern with topic deletions Key: SPARK-19559 URL: https://issues.apache.org/jira/browse/SPARK-19559 Proj

[jira] [Created] (SPARK-19558) Provide a config option to attach QueryExecutionListener to SparkSession

2017-02-10 Thread Salil Surendran (JIRA)
Salil Surendran created SPARK-19558: --- Summary: Provide a config option to attach QueryExecutionListener to SparkSession Key: SPARK-19558 URL: https://issues.apache.org/jira/browse/SPARK-19558 Projec

[jira] [Created] (SPARK-19557) Output parameters are not present in SQL Query Plan

2017-02-10 Thread Salil Surendran (JIRA)
Salil Surendran created SPARK-19557: --- Summary: Output parameters are not present in SQL Query Plan Key: SPARK-19557 URL: https://issues.apache.org/jira/browse/SPARK-19557 Project: Spark Iss

[jira] [Updated] (SPARK-18717) Datasets - crash (compile exception) when mapping to immutable scala map

2017-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-18717: --- Fix Version/s: 2.1.1 > Datasets - crash (compile exception) when mapping to immutable scala map > ---

[jira] [Updated] (SPARK-18717) Datasets - crash (compile exception) when mapping to immutable scala map

2017-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-18717: --- Affects Version/s: 2.1.0 > Datasets - crash (compile exception) when mapping to immutable scala map >

[jira] [Created] (SPARK-19556) Broadcast data is not encrypted when I/O encryption is on

2017-02-10 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-19556: -- Summary: Broadcast data is not encrypted when I/O encryption is on Key: SPARK-19556 URL: https://issues.apache.org/jira/browse/SPARK-19556 Project: Spark

[jira] [Created] (SPARK-19555) Improve inefficient StringUtils.escapeLikeRegex() method

2017-02-10 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-19555: -- Summary: Improve inefficient StringUtils.escapeLikeRegex() method Key: SPARK-19555 URL: https://issues.apache.org/jira/browse/SPARK-19555 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-19548) Hive UDF should support List and Map types

2017-02-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19548. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16886 [https://githu

[jira] [Created] (SPARK-19554) YARN backend should use history server URL for tracking when UI is disabled

2017-02-10 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-19554: -- Summary: YARN backend should use history server URL for tracking when UI is disabled Key: SPARK-19554 URL: https://issues.apache.org/jira/browse/SPARK-19554 Proje

[jira] [Assigned] (SPARK-17668) Support representing structs with case classes and tuples in spark sql udf inputs

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17668: Assignee: Apache Spark > Support representing structs with case classes and tuples in spar

[jira] [Commented] (SPARK-17668) Support representing structs with case classes and tuples in spark sql udf inputs

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861930#comment-15861930 ] Apache Spark commented on SPARK-17668: -- User 'koertkuipers' has created a pull reque

[jira] [Assigned] (SPARK-17668) Support representing structs with case classes and tuples in spark sql udf inputs

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17668: Assignee: (was: Apache Spark) > Support representing structs with case classes and tup

[jira] [Commented] (SPARK-19477) [SQL] Datasets created from a Dataframe with extra columns retain the extra columns

2017-02-10 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861918#comment-15861918 ] Michael Armbrust commented on SPARK-19477: -- If a lot of people are confused by t

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-10 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861869#comment-15861869 ] Egor Pahomov commented on SPARK-19524: -- [~sowen], probably yes. I don't know. "Shoul

[jira] [Updated] (SPARK-19540) Add ability to clone SparkSession wherein cloned session has a reference to SharedState and an identical copy of the SessionState

2017-02-10 Thread Kunal Khamar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kunal Khamar updated SPARK-19540: - Affects Version/s: (was: 2.1.1) 2.2.0 > Add ability to clone SparkSess

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861822#comment-15861822 ] Sean Owen commented on SPARK-19524: --- Ah, so you _don't_ want to only read new files. Th

[jira] [Resolved] (SPARK-19549) Allow providing reasons for stage/job cancelling

2017-02-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-19549. - Resolution: Fixed Assignee: Ala Luszczak Fix Version/s: 2.2.0 > Allow providing r

[jira] [Commented] (SPARK-14523) Feature parity for Statistics ML with MLlib

2017-02-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861789#comment-15861789 ] Joseph K. Bradley commented on SPARK-14523: --- I'd like to keep this open until w

[jira] [Reopened] (SPARK-14523) Feature parity for Statistics ML with MLlib

2017-02-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-14523: --- > Feature parity for Statistics ML with MLlib > -

[jira] [Resolved] (SPARK-18613) spark.ml LDA classes should not expose spark.mllib in APIs

2017-02-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-18613. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16860 [h

[jira] [Commented] (SPARK-19553) Add GroupedData.countApprox()

2017-02-10 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861735#comment-15861735 ] Nicholas Chammas commented on SPARK-19553: -- I needed something like this today.

[jira] [Created] (SPARK-19553) Add GroupedData.countApprox()

2017-02-10 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-19553: Summary: Add GroupedData.countApprox() Key: SPARK-19553 URL: https://issues.apache.org/jira/browse/SPARK-19553 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9478) Add sample weights to Random Forest

2017-02-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861714#comment-15861714 ] Joseph K. Bradley commented on SPARK-9478: -- [~sethah] Thanks for researching this

[jira] [Resolved] (SPARK-19459) ORC tables cannot be read when they contain char/varchar columns

2017-02-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19459. - Resolution: Fixed Fix Version/s: 2.2.0 > ORC tables cannot be read when they contain char/

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-10 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861600#comment-15861600 ] Egor Pahomov commented on SPARK-19524: -- [~sowen], Folder, which connect my streamin

[jira] [Commented] (SPARK-19493) Remove Java 7 support

2017-02-10 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861576#comment-15861576 ] Andrew Ash commented on SPARK-19493: +1 -- we're removing Java 7 compatibility from c

[jira] [Commented] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861525#comment-15861525 ] Sean Owen commented on SPARK-19552: --- The question you should focus on before proceeding

[jira] [Commented] (SPARK-19551) Theme for PySpark documenation could do with improving

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861522#comment-15861522 ] Sean Owen commented on SPARK-19551: --- How do you apply the theme? I don't think it's som

[jira] [Assigned] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19552: Assignee: (was: Apache Spark) > Upgrade Netty version to 4.1.8 final > ---

[jira] [Assigned] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19552: Assignee: Apache Spark > Upgrade Netty version to 4.1.8 final > --

[jira] [Commented] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861500#comment-15861500 ] Apache Spark commented on SPARK-19552: -- User 'a-roberts' has created a pull request

[jira] [Resolved] (SPARK-19466) Improve Fair Scheduler Logging

2017-02-10 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-19466. Resolution: Fixed Assignee: Eren Avsarogullari Fix Version/s: 2.2.0 > Impro

[jira] [Commented] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861494#comment-15861494 ] Adam Roberts commented on SPARK-19552: -- [~srowen] interested in your thoughts and no

[jira] [Created] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-19552: Summary: Upgrade Netty version to 4.1.8 final Key: SPARK-19552 URL: https://issues.apache.org/jira/browse/SPARK-19552 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-19551) Theme for PySpark documenation could do with improving

2017-02-10 Thread Arthur Tacca (JIRA)
Arthur Tacca created SPARK-19551: Summary: Theme for PySpark documenation could do with improving Key: SPARK-19551 URL: https://issues.apache.org/jira/browse/SPARK-19551 Project: Spark Issue

[jira] [Commented] (SPARK-4563) Allow spark driver to bind to different ip then advertise ip

2017-02-10 Thread Danny Robinson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861453#comment-15861453 ] Danny Robinson commented on SPARK-4563: --- I found one completely hacked way to allow

[jira] [Assigned] (SPARK-19550) Remove reflection, docs, build elements related to Java 7

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19550: Assignee: Apache Spark (was: Sean Owen) > Remove reflection, docs, build elements related

[jira] [Commented] (SPARK-19493) Remove Java 7 support

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861395#comment-15861395 ] Sean Owen commented on SPARK-19493: --- (I broke out the base change to core, docs and bui

[jira] [Commented] (SPARK-19550) Remove reflection, docs, build elements related to Java 7

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861396#comment-15861396 ] Apache Spark commented on SPARK-19550: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-19550) Remove reflection, docs, build elements related to Java 7

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19550: Assignee: Sean Owen (was: Apache Spark) > Remove reflection, docs, build elements related

[jira] [Updated] (SPARK-19550) Remove reflection, docs, build elements related to Java 7

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19550: -- Issue Type: Sub-task (was: Task) Parent: SPARK-19493 > Remove reflection, docs, build elements

[jira] [Created] (SPARK-19550) Remove reflection, docs, build elements related to Java 7

2017-02-10 Thread Sean Owen (JIRA)
Sean Owen created SPARK-19550: - Summary: Remove reflection, docs, build elements related to Java 7 Key: SPARK-19550 URL: https://issues.apache.org/jira/browse/SPARK-19550 Project: Spark Issue Typ

[jira] [Commented] (SPARK-19549) Allow providing reasons for stage/job cancelling

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861374#comment-15861374 ] Apache Spark commented on SPARK-19549: -- User 'ala' has created a pull request for th

[jira] [Assigned] (SPARK-19549) Allow providing reasons for stage/job cancelling

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19549: Assignee: Apache Spark > Allow providing reasons for stage/job cancelling > --

[jira] [Assigned] (SPARK-19549) Allow providing reasons for stage/job cancelling

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19549: Assignee: (was: Apache Spark) > Allow providing reasons for stage/job cancelling > ---

[jira] [Created] (SPARK-19549) Allow providing reasons for stage/job cancelling

2017-02-10 Thread Ala Luszczak (JIRA)
Ala Luszczak created SPARK-19549: Summary: Allow providing reasons for stage/job cancelling Key: SPARK-19549 URL: https://issues.apache.org/jira/browse/SPARK-19549 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-10748) Log error instead of crashing Spark Mesos dispatcher when a job is misconfigured

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-10748: - Assignee: Devaraj K Affects Version/s: 2.1.0 Priority: Minor (was: Maj

[jira] [Resolved] (SPARK-10748) Log error instead of crashing Spark Mesos dispatcher when a job is misconfigured

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10748. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 13077 [https://github.co

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861319#comment-15861319 ] Sean Owen commented on SPARK-19524: --- It's based on modification time by the way. Are th

[jira] [Resolved] (SPARK-19546) Every mail to u...@spark.apache.org is getting blocked

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19546. --- Resolution: Invalid This isn't what JIRA is for, but could you ask dev@ who has mailing list admin r

[jira] [Resolved] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19545. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16884 [https://github.co

[jira] [Assigned] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-19545: - Assignee: Saisai Shao > Compilation error with method not found when build against Hadoop 2.6.0.

[jira] [Resolved] (SPARK-19543) from_json fails when the input row is empty

2017-02-10 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19543. --- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-19548) Hive UDF should support List and Map types

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861148#comment-15861148 ] Apache Spark commented on SPARK-19548: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-19548) Hive UDF should support List and Map types

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19548: Assignee: Herman van Hovell (was: Apache Spark) > Hive UDF should support List and Map ty

[jira] [Assigned] (SPARK-19548) Hive UDF should support List and Map types

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19548: Assignee: Apache Spark (was: Herman van Hovell) > Hive UDF should support List and Map ty

[jira] [Updated] (SPARK-19546) Every mail to u...@spark.apache.org is getting blocked

2017-02-10 Thread Shivam Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivam Sharma updated SPARK-19546: -- Priority: Major (was: Minor) > Every mail to u...@spark.apache.org is getting blocked > --

[jira] [Created] (SPARK-19548) Hive UDF should support List and Map types

2017-02-10 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-19548: - Summary: Hive UDF should support List and Map types Key: SPARK-19548 URL: https://issues.apache.org/jira/browse/SPARK-19548 Project: Spark Issue Ty

[jira] [Updated] (SPARK-19547) KafkaUtil throw 'No current assignment for partition' Exception

2017-02-10 Thread wuchang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuchang updated SPARK-19547: Description: Below is my scala code to create spark kafka stream: val kafkaParams = Map[String, Object](

[jira] [Created] (SPARK-19547) KafkaUtil throw 'No current assignment for partition' Exception

2017-02-10 Thread wuchang (JIRA)
wuchang created SPARK-19547: --- Summary: KafkaUtil throw 'No current assignment for partition' Exception Key: SPARK-19547 URL: https://issues.apache.org/jira/browse/SPARK-19547 Project: Spark Issue

[jira] [Updated] (SPARK-19512) codegen for compare structs fails

2017-02-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-19512: Fix Version/s: 2.1.1 > codegen for compare structs fails > - > >

[jira] [Assigned] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19545: Assignee: Apache Spark > Compilation error with method not found when build against Hadoop

[jira] [Assigned] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19545: Assignee: (was: Apache Spark) > Compilation error with method not found when build aga

[jira] [Commented] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860994#comment-15860994 ] Apache Spark commented on SPARK-19545: -- User 'jerryshao' has created a pull request

[jira] [Updated] (SPARK-19546) Every mail to u...@spark.apache.org is getting blocked

2017-02-10 Thread Shivam Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivam Sharma updated SPARK-19546: -- Description: Each time I am sending mail to u...@spark.apache.org I am getting email from yah

[jira] [Created] (SPARK-19546) Every mail to u...@spark.apache.org is blocked

2017-02-10 Thread Shivam Sharma (JIRA)
Shivam Sharma created SPARK-19546: - Summary: Every mail to u...@spark.apache.org is blocked Key: SPARK-19546 URL: https://issues.apache.org/jira/browse/SPARK-19546 Project: Spark Issue Type:

[jira] [Closed] (SPARK-19473) Several DataFrame Methods still fail with dot in column names

2017-02-10 Thread Wayne Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wayne Zhang closed SPARK-19473. --- Resolution: Not A Problem > Several DataFrame Methods still fail with dot in column names >

[jira] [Created] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-19545: --- Summary: Compilation error with method not found when build against Hadoop 2.6.0. Key: SPARK-19545 URL: https://issues.apache.org/jira/browse/SPARK-19545 Project: Spark