[jira] [Commented] (SPARK-17897) not isnotnull is converted to the always false condition isnotnull && not isnotnull

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862298#comment-15862298 ] Apache Spark commented on SPARK-17897: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-19555) Improve inefficient StringUtils.escapeLikeRegex() method

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862293#comment-15862293 ] Apache Spark commented on SPARK-19555: -- User 'lins05' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19555) Improve inefficient StringUtils.escapeLikeRegex() method

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19555: Assignee: Apache Spark > Improve inefficient StringUtils.escapeLikeRegex() method >

[jira] [Assigned] (SPARK-19555) Improve inefficient StringUtils.escapeLikeRegex() method

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19555: Assignee: (was: Apache Spark) > Improve inefficient StringUtils.escapeLikeRegex()

[jira] [Resolved] (SPARK-19537) Move the pendingPartitions variable from Stage to ShuffleMapStage

2017-02-10 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-19537. Resolution: Fixed Fix Version/s: 2.2.0 > Move the pendingPartitions variable from

[jira] [Closed] (SPARK-19502) Remove unnecessary code to re-submit stages in the DAGScheduler

2017-02-10 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout closed SPARK-19502. -- Resolution: Not A Problem This code actually is currently needed to handle cases where a

[jira] [Updated] (SPARK-19538) DAGScheduler and TaskSetManager can have an inconsistent view of whether a stage is complete.

2017-02-10 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-19538: --- Priority: Minor (was: Major) > DAGScheduler and TaskSetManager can have an inconsistent

[jira] [Commented] (SPARK-19560) Improve tests for when DAGScheduler learns of "successful" ShuffleMapTask from a failed executor

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862248#comment-15862248 ] Apache Spark commented on SPARK-19560: -- User 'kayousterhout' has created a pull request for this

[jira] [Assigned] (SPARK-19560) Improve tests for when DAGScheduler learns of "successful" ShuffleMapTask from a failed executor

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19560: Assignee: Apache Spark (was: Kay Ousterhout) > Improve tests for when DAGScheduler

[jira] [Assigned] (SPARK-19560) Improve tests for when DAGScheduler learns of "successful" ShuffleMapTask from a failed executor

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19560: Assignee: Kay Ousterhout (was: Apache Spark) > Improve tests for when DAGScheduler

[jira] [Created] (SPARK-19560) Improve tests for when DAGScheduler learns of "successful" ShuffleMapTask from a failed executor

2017-02-10 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-19560: -- Summary: Improve tests for when DAGScheduler learns of "successful" ShuffleMapTask from a failed executor Key: SPARK-19560 URL:

[jira] [Commented] (SPARK-19318) Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle`

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862207#comment-15862207 ] Apache Spark commented on SPARK-19318: -- User 'sureshthalamati' has created a pull request for this

[jira] [Updated] (SPARK-19559) Fix flaky KafkaSourceSuite.subscribing topic by pattern with topic deletions

2017-02-10 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-19559: --- Description: This test has started failing frequently recently; e.g.,

[jira] [Created] (SPARK-19559) Fix flaky KafkaSourceSuite.subscribing topic by pattern with topic deletions

2017-02-10 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-19559: -- Summary: Fix flaky KafkaSourceSuite.subscribing topic by pattern with topic deletions Key: SPARK-19559 URL: https://issues.apache.org/jira/browse/SPARK-19559

[jira] [Created] (SPARK-19558) Provide a config option to attach QueryExecutionListener to SparkSession

2017-02-10 Thread Salil Surendran (JIRA)
Salil Surendran created SPARK-19558: --- Summary: Provide a config option to attach QueryExecutionListener to SparkSession Key: SPARK-19558 URL: https://issues.apache.org/jira/browse/SPARK-19558

[jira] [Created] (SPARK-19557) Output parameters are not present in SQL Query Plan

2017-02-10 Thread Salil Surendran (JIRA)
Salil Surendran created SPARK-19557: --- Summary: Output parameters are not present in SQL Query Plan Key: SPARK-19557 URL: https://issues.apache.org/jira/browse/SPARK-19557 Project: Spark

[jira] [Updated] (SPARK-18717) Datasets - crash (compile exception) when mapping to immutable scala map

2017-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-18717: --- Fix Version/s: 2.1.1 > Datasets - crash (compile exception) when mapping to immutable scala map >

[jira] [Updated] (SPARK-18717) Datasets - crash (compile exception) when mapping to immutable scala map

2017-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-18717: --- Affects Version/s: 2.1.0 > Datasets - crash (compile exception) when mapping to immutable scala map

[jira] [Created] (SPARK-19556) Broadcast data is not encrypted when I/O encryption is on

2017-02-10 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-19556: -- Summary: Broadcast data is not encrypted when I/O encryption is on Key: SPARK-19556 URL: https://issues.apache.org/jira/browse/SPARK-19556 Project: Spark

[jira] [Created] (SPARK-19555) Improve inefficient StringUtils.escapeLikeRegex() method

2017-02-10 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-19555: -- Summary: Improve inefficient StringUtils.escapeLikeRegex() method Key: SPARK-19555 URL: https://issues.apache.org/jira/browse/SPARK-19555 Project: Spark Issue

[jira] [Resolved] (SPARK-19548) Hive UDF should support List and Map types

2017-02-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19548. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16886

[jira] [Created] (SPARK-19554) YARN backend should use history server URL for tracking when UI is disabled

2017-02-10 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-19554: -- Summary: YARN backend should use history server URL for tracking when UI is disabled Key: SPARK-19554 URL: https://issues.apache.org/jira/browse/SPARK-19554

[jira] [Assigned] (SPARK-17668) Support representing structs with case classes and tuples in spark sql udf inputs

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17668: Assignee: Apache Spark > Support representing structs with case classes and tuples in

[jira] [Commented] (SPARK-17668) Support representing structs with case classes and tuples in spark sql udf inputs

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861930#comment-15861930 ] Apache Spark commented on SPARK-17668: -- User 'koertkuipers' has created a pull request for this

[jira] [Assigned] (SPARK-17668) Support representing structs with case classes and tuples in spark sql udf inputs

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17668: Assignee: (was: Apache Spark) > Support representing structs with case classes and

[jira] [Commented] (SPARK-19477) [SQL] Datasets created from a Dataframe with extra columns retain the extra columns

2017-02-10 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861918#comment-15861918 ] Michael Armbrust commented on SPARK-19477: -- If a lot of people are confused by this being lazy

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-10 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861869#comment-15861869 ] Egor Pahomov commented on SPARK-19524: -- [~sowen], probably yes. I don't know. "Should process only

[jira] [Updated] (SPARK-19540) Add ability to clone SparkSession wherein cloned session has a reference to SharedState and an identical copy of the SessionState

2017-02-10 Thread Kunal Khamar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kunal Khamar updated SPARK-19540: - Affects Version/s: (was: 2.1.1) 2.2.0 > Add ability to clone

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861822#comment-15861822 ] Sean Owen commented on SPARK-19524: --- Ah, so you _don't_ want to only read new files. The behavior of

[jira] [Resolved] (SPARK-19549) Allow providing reasons for stage/job cancelling

2017-02-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-19549. - Resolution: Fixed Assignee: Ala Luszczak Fix Version/s: 2.2.0 > Allow providing

[jira] [Commented] (SPARK-14523) Feature parity for Statistics ML with MLlib

2017-02-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861789#comment-15861789 ] Joseph K. Bradley commented on SPARK-14523: --- I'd like to keep this open until we have linked

[jira] [Reopened] (SPARK-14523) Feature parity for Statistics ML with MLlib

2017-02-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-14523: --- > Feature parity for Statistics ML with MLlib >

[jira] [Resolved] (SPARK-18613) spark.ml LDA classes should not expose spark.mllib in APIs

2017-02-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-18613. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16860

[jira] [Commented] (SPARK-19553) Add GroupedData.countApprox()

2017-02-10 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861735#comment-15861735 ] Nicholas Chammas commented on SPARK-19553: -- I needed something like this today. I was profiling

[jira] [Created] (SPARK-19553) Add GroupedData.countApprox()

2017-02-10 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-19553: Summary: Add GroupedData.countApprox() Key: SPARK-19553 URL: https://issues.apache.org/jira/browse/SPARK-19553 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9478) Add sample weights to Random Forest

2017-02-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861714#comment-15861714 ] Joseph K. Bradley commented on SPARK-9478: -- [~sethah] Thanks for researching this! +1 for not

[jira] [Resolved] (SPARK-19459) ORC tables cannot be read when they contain char/varchar columns

2017-02-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19459. - Resolution: Fixed Fix Version/s: 2.2.0 > ORC tables cannot be read when they contain

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-10 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861600#comment-15861600 ] Egor Pahomov commented on SPARK-19524: -- [~sowen], Folder, which connect my streaming to: {code}

[jira] [Commented] (SPARK-19493) Remove Java 7 support

2017-02-10 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861576#comment-15861576 ] Andrew Ash commented on SPARK-19493: +1 -- we're removing Java 7 compatibility from core internal

[jira] [Commented] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861525#comment-15861525 ] Sean Owen commented on SPARK-19552: --- The question you should focus on before proceeding is what the

[jira] [Commented] (SPARK-19551) Theme for PySpark documenation could do with improving

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861522#comment-15861522 ] Sean Owen commented on SPARK-19551: --- How do you apply the theme? I don't think it's something specific

[jira] [Assigned] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19552: Assignee: (was: Apache Spark) > Upgrade Netty version to 4.1.8 final >

[jira] [Assigned] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19552: Assignee: Apache Spark > Upgrade Netty version to 4.1.8 final >

[jira] [Commented] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861500#comment-15861500 ] Apache Spark commented on SPARK-19552: -- User 'a-roberts' has created a pull request for this issue:

[jira] [Resolved] (SPARK-19466) Improve Fair Scheduler Logging

2017-02-10 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-19466. Resolution: Fixed Assignee: Eren Avsarogullari Fix Version/s: 2.2.0 >

[jira] [Commented] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861494#comment-15861494 ] Adam Roberts commented on SPARK-19552: -- [~srowen] interested in your thoughts and noticed your work

[jira] [Created] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-19552: Summary: Upgrade Netty version to 4.1.8 final Key: SPARK-19552 URL: https://issues.apache.org/jira/browse/SPARK-19552 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-19551) Theme for PySpark documenation could do with improving

2017-02-10 Thread Arthur Tacca (JIRA)
Arthur Tacca created SPARK-19551: Summary: Theme for PySpark documenation could do with improving Key: SPARK-19551 URL: https://issues.apache.org/jira/browse/SPARK-19551 Project: Spark Issue

[jira] [Commented] (SPARK-4563) Allow spark driver to bind to different ip then advertise ip

2017-02-10 Thread Danny Robinson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861453#comment-15861453 ] Danny Robinson commented on SPARK-4563: --- I found one completely hacked way to allow my Spark Driver

[jira] [Assigned] (SPARK-19550) Remove reflection, docs, build elements related to Java 7

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19550: Assignee: Apache Spark (was: Sean Owen) > Remove reflection, docs, build elements

[jira] [Commented] (SPARK-19493) Remove Java 7 support

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861395#comment-15861395 ] Sean Owen commented on SPARK-19493: --- (I broke out the base change to core, docs and build into a

[jira] [Commented] (SPARK-19550) Remove reflection, docs, build elements related to Java 7

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861396#comment-15861396 ] Apache Spark commented on SPARK-19550: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19550) Remove reflection, docs, build elements related to Java 7

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19550: Assignee: Sean Owen (was: Apache Spark) > Remove reflection, docs, build elements

[jira] [Updated] (SPARK-19550) Remove reflection, docs, build elements related to Java 7

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19550: -- Issue Type: Sub-task (was: Task) Parent: SPARK-19493 > Remove reflection, docs, build

[jira] [Created] (SPARK-19550) Remove reflection, docs, build elements related to Java 7

2017-02-10 Thread Sean Owen (JIRA)
Sean Owen created SPARK-19550: - Summary: Remove reflection, docs, build elements related to Java 7 Key: SPARK-19550 URL: https://issues.apache.org/jira/browse/SPARK-19550 Project: Spark Issue

[jira] [Commented] (SPARK-19549) Allow providing reasons for stage/job cancelling

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861374#comment-15861374 ] Apache Spark commented on SPARK-19549: -- User 'ala' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19549) Allow providing reasons for stage/job cancelling

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19549: Assignee: Apache Spark > Allow providing reasons for stage/job cancelling >

[jira] [Assigned] (SPARK-19549) Allow providing reasons for stage/job cancelling

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19549: Assignee: (was: Apache Spark) > Allow providing reasons for stage/job cancelling >

[jira] [Created] (SPARK-19549) Allow providing reasons for stage/job cancelling

2017-02-10 Thread Ala Luszczak (JIRA)
Ala Luszczak created SPARK-19549: Summary: Allow providing reasons for stage/job cancelling Key: SPARK-19549 URL: https://issues.apache.org/jira/browse/SPARK-19549 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-10748) Log error instead of crashing Spark Mesos dispatcher when a job is misconfigured

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-10748: - Assignee: Devaraj K Affects Version/s: 2.1.0 Priority: Minor (was:

[jira] [Resolved] (SPARK-10748) Log error instead of crashing Spark Mesos dispatcher when a job is misconfigured

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10748. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 13077

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861319#comment-15861319 ] Sean Owen commented on SPARK-19524: --- It's based on modification time by the way. Are the files' mod

[jira] [Resolved] (SPARK-19546) Every mail to u...@spark.apache.org is getting blocked

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19546. --- Resolution: Invalid This isn't what JIRA is for, but could you ask dev@ who has mailing list admin

[jira] [Resolved] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19545. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16884

[jira] [Assigned] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-19545: - Assignee: Saisai Shao > Compilation error with method not found when build against Hadoop

[jira] [Resolved] (SPARK-19543) from_json fails when the input row is empty

2017-02-10 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-19543. --- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-19548) Hive UDF should support List and Map types

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861148#comment-15861148 ] Apache Spark commented on SPARK-19548: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19548) Hive UDF should support List and Map types

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19548: Assignee: Herman van Hovell (was: Apache Spark) > Hive UDF should support List and Map

[jira] [Assigned] (SPARK-19548) Hive UDF should support List and Map types

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19548: Assignee: Apache Spark (was: Herman van Hovell) > Hive UDF should support List and Map

[jira] [Updated] (SPARK-19546) Every mail to u...@spark.apache.org is getting blocked

2017-02-10 Thread Shivam Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivam Sharma updated SPARK-19546: -- Priority: Major (was: Minor) > Every mail to u...@spark.apache.org is getting blocked >

[jira] [Created] (SPARK-19548) Hive UDF should support List and Map types

2017-02-10 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-19548: - Summary: Hive UDF should support List and Map types Key: SPARK-19548 URL: https://issues.apache.org/jira/browse/SPARK-19548 Project: Spark Issue

[jira] [Updated] (SPARK-19547) KafkaUtil throw 'No current assignment for partition' Exception

2017-02-10 Thread wuchang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuchang updated SPARK-19547: Description: Below is my scala code to create spark kafka stream: val kafkaParams = Map[String, Object](

[jira] [Created] (SPARK-19547) KafkaUtil throw 'No current assignment for partition' Exception

2017-02-10 Thread wuchang (JIRA)
wuchang created SPARK-19547: --- Summary: KafkaUtil throw 'No current assignment for partition' Exception Key: SPARK-19547 URL: https://issues.apache.org/jira/browse/SPARK-19547 Project: Spark Issue

[jira] [Updated] (SPARK-19512) codegen for compare structs fails

2017-02-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-19512: Fix Version/s: 2.1.1 > codegen for compare structs fails > - > >

[jira] [Assigned] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19545: Assignee: Apache Spark > Compilation error with method not found when build against

[jira] [Assigned] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19545: Assignee: (was: Apache Spark) > Compilation error with method not found when build

[jira] [Commented] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860994#comment-15860994 ] Apache Spark commented on SPARK-19545: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Updated] (SPARK-19546) Every mail to u...@spark.apache.org is getting blocked

2017-02-10 Thread Shivam Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivam Sharma updated SPARK-19546: -- Description: Each time I am sending mail to u...@spark.apache.org I am getting email from

[jira] [Created] (SPARK-19546) Every mail to u...@spark.apache.org is blocked

2017-02-10 Thread Shivam Sharma (JIRA)
Shivam Sharma created SPARK-19546: - Summary: Every mail to u...@spark.apache.org is blocked Key: SPARK-19546 URL: https://issues.apache.org/jira/browse/SPARK-19546 Project: Spark Issue Type:

[jira] [Closed] (SPARK-19473) Several DataFrame Methods still fail with dot in column names

2017-02-10 Thread Wayne Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wayne Zhang closed SPARK-19473. --- Resolution: Not A Problem > Several DataFrame Methods still fail with dot in column names >

[jira] [Created] (SPARK-19545) Compilation error with method not found when build against Hadoop 2.6.0.

2017-02-10 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-19545: --- Summary: Compilation error with method not found when build against Hadoop 2.6.0. Key: SPARK-19545 URL: https://issues.apache.org/jira/browse/SPARK-19545 Project: