[jira] [Reopened] (SPARK-19883) Executor is waiting for lock

2017-03-09 Thread hustfxj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hustfxj reopened SPARK-19883: - I this it is a question, like that https://issues.apache.org/jira/browse/SPARK-19300 > Executor is waiting

[jira] [Commented] (SPARK-19883) Executor is waiting for lock

2017-03-09 Thread hustfxj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902972#comment-15902972 ] hustfxj commented on SPARK-19883: - [~srowen] A stage is still blocked because a task of this stage is

[jira] [Commented] (SPARK-19882) Pivot with null as the pivot value throws NPE

2017-03-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902965#comment-15902965 ] Hyukjin Kwon commented on SPARK-19882: -- Actually, there are two problems here. It should not throw

[jira] [Issue Comment Deleted] (SPARK-19883) Executor is waiting for lock

2017-03-09 Thread hustfxj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hustfxj updated SPARK-19883: Comment: was deleted (was: And the netty is netty from 4.0.43.Final) > Executor is waiting for lock >

[jira] [Commented] (SPARK-19883) Executor is waiting for lock

2017-03-09 Thread hustfxj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902962#comment-15902962 ] hustfxj commented on SPARK-19883: - And the netty is netty from 4.0.43.Final > Executor is waiting for

[jira] [Resolved] (SPARK-19883) Executor is waiting for lock

2017-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19883. --- Resolution: Invalid This is entirely normal. It's what you see whenever anything is waiting on a

[jira] [Updated] (SPARK-19883) Executor is waiting for lock

2017-03-09 Thread hustfxj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hustfxj updated SPARK-19883: Attachment: jstack the full thread dump > Executor is waiting for lock > > >

[jira] [Created] (SPARK-19883) Executor is waiting for lock

2017-03-09 Thread hustfxj (JIRA)
hustfxj created SPARK-19883: --- Summary: Executor is waiting for lock Key: SPARK-19883 URL: https://issues.apache.org/jira/browse/SPARK-19883 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-19882) Pivot with null as the pivot value throws NPE

2017-03-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-19882: - Description: This seems a regression. - Spark 1.6 {code} Seq(Tuple1(None),

[jira] [Created] (SPARK-19882) Pivot with null as the pivot value throws NPE

2017-03-09 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-19882: Summary: Pivot with null as the pivot value throws NPE Key: SPARK-19882 URL: https://issues.apache.org/jira/browse/SPARK-19882 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2017-03-09 Thread bruce xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902924#comment-15902924 ] bruce xu commented on SPARK-13983: -- spark 2.0.1 still has the bug... bin/beeline -f test.sql --hivevar

[jira] [Assigned] (SPARK-19763) qualified external datasource table location stored in catalog

2017-03-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-19763: --- Assignee: Song Jun > qualified external datasource table location stored in catalog >

[jira] [Resolved] (SPARK-19763) qualified external datasource table location stored in catalog

2017-03-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19763. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17095

[jira] [Commented] (SPARK-12694) The detailed rest API documentation for each field is missing

2017-03-09 Thread Ehsun Behravesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902692#comment-15902692 ] Ehsun Behravesh commented on SPARK-12694: - Thanks > The detailed rest API documentation for each

[jira] [Commented] (SPARK-12694) The detailed rest API documentation for each field is missing

2017-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902690#comment-15902690 ] Sean Owen commented on SPARK-12694: --- Already done, yes. > The detailed rest API documentation for each

[jira] [Issue Comment Deleted] (SPARK-12694) The detailed rest API documentation for each field is missing

2017-03-09 Thread Ehsun Behravesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ehsun Behravesh updated SPARK-12694: Comment: was deleted (was: So this JIRA ticket should be close?) > The detailed rest API

[jira] [Issue Comment Deleted] (SPARK-19862) In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted.

2017-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19862: -- Comment: was deleted (was: It's true, though I'm not sure this alone is worth changing, let alone a

[jira] [Resolved] (SPARK-19862) In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted.

2017-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19862. --- Resolution: Won't Fix > In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted. >

[jira] [Commented] (SPARK-12694) The detailed rest API documentation for each field is missing

2017-03-09 Thread Ehsun Behravesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902689#comment-15902689 ] Ehsun Behravesh commented on SPARK-12694: - So this JIRA ticket should be close? > The detailed

[jira] [Updated] (SPARK-19872) UnicodeDecodeError in Pyspark on sc.textFile read with repartition

2017-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19872: -- Priority: Major (was: Blocker) (Blocker is for committers to determine) > UnicodeDecodeError in

[jira] [Commented] (SPARK-19880) About spark2.0.2 and spark1.4.1 beeline to show the database, use the default operation such as dealing with different

2017-03-09 Thread guoxiaolong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902679#comment-15902679 ] guoxiaolong commented on SPARK-19880: - But When a job dispose time is very long,such as query

[jira] [Resolved] (SPARK-12694) The detailed rest API documentation for each field is missing

2017-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12694. --- Resolution: Duplicate Yes probably superseded by other changes > The detailed rest API

[jira] [Comment Edited] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

2017-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902668#comment-15902668 ] Sean Owen edited comment on SPARK-19875 at 3/9/17 8:32 AM: --- It's easier to

[jira] [Commented] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

2017-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902668#comment-15902668 ] Sean Owen commented on SPARK-19875: --- It's easier to inline the code in a comment: {code:scala} package

[jira] [Comment Edited] (SPARK-12694) The detailed rest API documentation for each field is missing

2017-03-09 Thread Ehsun Behravesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902657#comment-15902657 ] Ehsun Behravesh edited comment on SPARK-12694 at 3/9/17 8:31 AM: - Does

[jira] [Comment Edited] (SPARK-12694) The detailed rest API documentation for each field is missing

2017-03-09 Thread Ehsun Behravesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902657#comment-15902657 ] Ehsun Behravesh edited comment on SPARK-12694 at 3/9/17 8:31 AM: - Does

[jira] [Commented] (SPARK-12694) The detailed rest API documentation for each field is missing

2017-03-09 Thread Ehsun Behravesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902657#comment-15902657 ] Ehsun Behravesh commented on SPARK-12694: - Does this still need someone to work on? I checked it

[jira] [Resolved] (SPARK-19880) About spark2.0.2 and spark1.4.1 beeline to show the database, use the default operation such as dealing with different

2017-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19880. --- Resolution: Invalid I'm not clear what this means. It may be better to clarify and re-ask on the

[jira] [Commented] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2017-03-09 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902649#comment-15902649 ] Nick Pentreath commented on SPARK-14409: [~josephkb] in reference to your [PR

[jira] [Comment Edited] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2017-03-09 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902639#comment-15902639 ] Nick Pentreath edited comment on SPARK-14409 at 3/9/17 8:05 AM: I

[jira] [Commented] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2017-03-09 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902639#comment-15902639 ] Nick Pentreath commented on SPARK-14409: I commented on the [PR for

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2017-03-09 Thread Swaranga Sarma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902634#comment-15902634 ] Swaranga Sarma commented on SPARK-12009: The JIRA says that the issue is fixed but I still see

[jira] [Comment Edited] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2017-03-09 Thread Swaranga Sarma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902634#comment-15902634 ] Swaranga Sarma edited comment on SPARK-12009 at 3/9/17 7:59 AM: The JIRA

<    1   2