[jira] [Commented] (SPARK-26760) [Spark Incorrect display in SPARK UI Executor Tab when number of cores is 4 and Active Task display as 5 in Executor Tab of SPARK UI]

[ https://issues.apache.org/jira/browse/SPARK-26760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16760521#comment-16760521 ] shahid commented on SPARK-26760: After analyzing, following are the findings 1) Tasks re

[jira] [Comment Edited] (SPARK-26760) [Spark Incorrect display in SPARK UI Executor Tab when number of cores is 4 and Active Task display as 5 in Executor Tab of SPARK UI]

[ https://issues.apache.org/jira/browse/SPARK-26760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16760521#comment-16760521 ] shahid edited comment on SPARK-26760 at 2/5/19 7:12 AM: After an

[jira] [Commented] (SPARK-26760) [Spark Incorrect display in SPARK UI Executor Tab when number of cores is 4 and Active Task display as 5 in Executor Tab of SPARK UI]

[ https://issues.apache.org/jira/browse/SPARK-26760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16760539#comment-16760539 ] shahid commented on SPARK-26760: Can you try with time taking task? Also, see the job pa

[jira] [Updated] (SPARK-26760) [Spark Incorrect display in SPARK UI Executor Tab when number of cores is 4 and Active Task display as 5 in Executor Tab of SPARK UI]

[ https://issues.apache.org/jira/browse/SPARK-26760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-26760: --- Attachment: Screenshot from 2019-02-11 15-09-09.png > [Spark Incorrect display in SPARK UI Executor Tab when

[jira] [Commented] (SPARK-26760) [Spark Incorrect display in SPARK UI Executor Tab when number of cores is 4 and Active Task display as 5 in Executor Tab of SPARK UI]

[ https://issues.apache.org/jira/browse/SPARK-26760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16764803#comment-16764803 ] shahid commented on SPARK-26760: Yes. Writing store too frequently maybe a costly operat

[jira] [Commented] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

[ https://issues.apache.org/jira/browse/SPARK-27003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779341#comment-16779341 ] shahid commented on SPARK-27003: default value of spark.executor.instances=2 is applicab

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781588#comment-16781588 ] shahid commented on SPARK-27019: Hi [~peay] Could you please add test to reproduce it?

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781606#comment-16781606 ] shahid commented on SPARK-27019: Seems event reordering has happened. ie. JobStart event

[jira] [Issue Comment Deleted] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27019: --- Comment: was deleted (was: Seems event reordering has happened. ie. JobStart event came after SQLExecutionE

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781670#comment-16781670 ] shahid edited comment on SPARK-27019 at 3/1/19 1:29 PM: seems ev

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781670#comment-16781670 ] shahid edited comment on SPARK-27019 at 3/1/19 1:33 PM: seems ev

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781670#comment-16781670 ] shahid commented on SPARK-27019: seems event reordering has happened. Job start event ca

[jira] [Updated] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27019: --- Attachment: Screenshot from 2019-03-01 21-31-48.png > Spark UI's SQL tab shows inconsistent values > ---

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781826#comment-16781826 ] shahid commented on SPARK-27019: Yes. The issue happened because of the event reordering

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781826#comment-16781826 ] shahid edited comment on SPARK-27019 at 3/1/19 4:11 PM: Yes. The

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781670#comment-16781670 ] shahid edited comment on SPARK-27019 at 3/2/19 9:44 PM: seems ev

[jira] [Resolved] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-23134. Resolution: Duplicate > WebUI is showing the cache table details even after cache idle timeout > -

[jira] [Reopened] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid reopened SPARK-23134: Will resolve once the Jira SPARK-27012 merged > WebUI is showing the cache table details even after cache idl

[jira] [Resolved] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-23134. Resolution: Duplicate > WebUI is showing the cache table details even after cache idle timeout > -

[jira] [Reopened] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid reopened SPARK-23134: > WebUI is showing the cache table details even after cache idle timeout > ---

[jira] [Resolved] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-23134. Resolution: Duplicate > WebUI is showing the cache table details even after cache idle timeout > -

[jira] [Issue Comment Deleted] (SPARK-23134) WebUI is showing the cache table details even after cache idle timeout

[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-23134: --- Comment: was deleted (was: Will resolve once the Jira SPARK-27012 merged) > WebUI is showing the cache tabl

[jira] [Created] (SPARK-27145) Close store after test, in SQLAppStatusListenerSuite

shahid created SPARK-27145: -- Summary: Close store after test, in SQLAppStatusListenerSuite Key: SPARK-27145 URL: https://issues.apache.org/jira/browse/SPARK-27145 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-27145) Close store after test, in the SQLAppStatusListenerSuite

[ https://issues.apache.org/jira/browse/SPARK-27145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27145: --- Summary: Close store after test, in the SQLAppStatusListenerSuite (was: Close store after test, in SQLAppSt

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793675#comment-16793675 ] shahid commented on SPARK-27169: Seems event drop has happened. > number of active tas

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793675#comment-16793675 ] shahid edited comment on SPARK-27169 at 3/16/19 8:40 AM: - Seems

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794794#comment-16794794 ] shahid commented on SPARK-27169: Do you have eventlog corresponding to the application?

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795878#comment-16795878 ] shahid commented on SPARK-27169: Thank you. Could you please provide full event log if p

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795878#comment-16795878 ] shahid edited comment on SPARK-27169 at 3/19/19 9:38 AM: - Thank

[jira] [Commented] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

[ https://issues.apache.org/jira/browse/SPARK-27204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796110#comment-16796110 ] shahid commented on SPARK-27204: Thanks. I will analyze, > First time Loading applicati

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16797040#comment-16797040 ] shahid commented on SPARK-27169: Hi, It seems, from the above log we can't say that even

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16797066#comment-16797066 ] shahid edited comment on SPARK-27169 at 3/20/19 11:26 AM: -- Yes.

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16797066#comment-16797066 ] shahid commented on SPARK-27169: Yes. that means many event drops happens. Can you try i

[jira] [Commented] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

[ https://issues.apache.org/jira/browse/SPARK-27204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16797888#comment-16797888 ] shahid commented on SPARK-27204: Hi @HyukjinKwon, this is still an issue after SPARK-180

[jira] [Created] (SPARK-27231) Stack overflow error, when we increase the number of iteration in PIC

shahid created SPARK-27231: -- Summary: Stack overflow error, when we increase the number of iteration in PIC Key: SPARK-27231 URL: https://issues.apache.org/jira/browse/SPARK-27231 Project: Spark Is

[jira] [Commented] (SPARK-27231) Stack overflow error, when we increase the number of iteration in PIC

[ https://issues.apache.org/jira/browse/SPARK-27231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16798170#comment-16798170 ] shahid commented on SPARK-27231: I am analyzing the issue, > Stack overflow error, when

[jira] [Updated] (SPARK-27231) Stack overflow error, when we increase the number of iteration in PIC

[ https://issues.apache.org/jira/browse/SPARK-27231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27231: --- Description: val dataset = spark.createDataFrame(Seq( (0L, 1L, 1.0), (0L, 2L, 1.0),

[jira] [Commented] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

[ https://issues.apache.org/jira/browse/SPARK-27204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16798178#comment-16798178 ] shahid commented on SPARK-27204: Yes. actually, for loading the UI page, SHS need to rep

[jira] [Commented] (SPARK-20656) Incremental parsing of event logs in SHS

[ https://issues.apache.org/jira/browse/SPARK-20656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16802945#comment-16802945 ] shahid commented on SPARK-20656: I would like to work on it. > Incremental parsing of

[jira] [Commented] (SPARK-27068) Support failed jobs ui and completed jobs ui use different queue

[ https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815010#comment-16815010 ] shahid commented on SPARK-27068: Already failed jobs is in a single table right?. I mean

[jira] [Commented] (SPARK-27434) memory leak in spark driver

[ https://issues.apache.org/jira/browse/SPARK-27434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815424#comment-16815424 ] shahid commented on SPARK-27434: Could you please provide steps for reproducing the issu

[jira] [Commented] (SPARK-27068) Support failed jobs ui and completed jobs ui use different queue

[ https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815435#comment-16815435 ] shahid commented on SPARK-27068: Hi [~vanzin], Currently when cleaning up jobs when the

[jira] [Commented] (SPARK-27465) Kafka Client 0.11.0.0 is not Supporting the kafkatestutils package

[ https://issues.apache.org/jira/browse/SPARK-27465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818658#comment-16818658 ] shahid commented on SPARK-27465: I will analyze the issue. > Kafka Client 0.11.0.0 is n

[jira] [Commented] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818662#comment-16818662 ] shahid commented on SPARK-27468: I would like to analyze the issue. > "Storage Level" i

[jira] [Commented] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819662#comment-16819662 ] shahid commented on SPARK-16859: [~Hauer][~toopt4] Can you try enabling "spark.eventLog

[jira] [Comment Edited] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819662#comment-16819662 ] shahid edited comment on SPARK-16859 at 4/17/19 2:07 AM: - [~Haue

[jira] [Updated] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27468: --- Attachment: Screenshot from 2019-04-17 10-42-55.png > "Storage Level" in "RDD Storage Page" is not correct >

[jira] [Commented] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819679#comment-16819679 ] shahid commented on SPARK-27468: Hi [~srfnmnk], I tried to reproduce in the master branc

[jira] [Commented] (SPARK-27486) Enable History server storage information test

[ https://issues.apache.org/jira/browse/SPARK-27486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819759#comment-16819759 ] shahid commented on SPARK-27486: I will raise a PR > Enable History server storage info

[jira] [Created] (SPARK-27486) Enable History server storage information test

shahid created SPARK-27486: -- Summary: Enable History server storage information test Key: SPARK-27486 URL: https://issues.apache.org/jira/browse/SPARK-27486 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-27485) Certain query plans fail to run when autoBroadcastJoinThreshold is set to -1

[ https://issues.apache.org/jira/browse/SPARK-27485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820189#comment-16820189 ] shahid commented on SPARK-27485: Could you please share test to reproduce this? > Certa

[jira] [Commented] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820525#comment-16820525 ] shahid commented on SPARK-27468: [~zsxwing] Thanks > "Storage Level" in "RDD Storage Pa

[jira] [Commented] (SPARK-27068) Support failed jobs ui and completed jobs ui use different queue

[ https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821286#comment-16821286 ] shahid commented on SPARK-27068: cc [~srowen] Can we raise a PR for the issue?. The actu

[jira] [Comment Edited] (SPARK-27068) Support failed jobs ui and completed jobs ui use different queue

[ https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821286#comment-16821286 ] shahid edited comment on SPARK-27068 at 4/18/19 4:31 PM: - cc [~s

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471040#comment-16471040 ] shahid edited comment on SPARK-24217 at 5/10/18 9:11 PM: - Thanks

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471040#comment-16471040 ] shahid edited comment on SPARK-24217 at 5/10/18 9:15 PM: - Thanks

[jira] [Commented] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471128#comment-16471128 ] shahid commented on SPARK-24217: Thanks for the clarification Joseph K. Bradley Is it r

[jira] [Issue Comment Deleted] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-24217: --- Comment: was deleted (was: Thanks for the clarification.  Is it really required to append the result with th

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471128#comment-16471128 ] shahid edited comment on SPARK-24217 at 5/10/18 9:19 PM: - Thanks

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471128#comment-16471128 ] shahid edited comment on SPARK-24217 at 5/10/18 9:23 PM: - Thanks

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471128#comment-16471128 ] shahid edited comment on SPARK-24217 at 5/10/18 9:26 PM: - Thanks

[jira] [Comment Edited] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471128#comment-16471128 ] shahid edited comment on SPARK-24217 at 5/10/18 9:28 PM: - Thanks

[jira] [Issue Comment Deleted] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-24217: --- Comment: was deleted (was: Thanks for the clarification Joseph K. Bradley Is it really required to append th

[jira] [Commented] (SPARK-15784) Add Power Iteration Clustering to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471545#comment-16471545 ] shahid commented on SPARK-15784: Hi [~josephkb] , I can work on it. > Add Power Iteratio

[jira] [Created] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when mutiple leading eigen values.

shahid created SPARK-24484: -- Summary: Power Iteration Clustering is giving incorrect clustering results when mutiple leading eigen values. Key: SPARK-24484 URL: https://issues.apache.org/jira/browse/SPARK-24484

[jira] [Updated] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-24484: --- Summary: Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading ei

[jira] [Created] (SPARK-24489) No check for invalid input type of weight data in ml.PowerIterationClustering

shahid created SPARK-24489: -- Summary: No check for invalid input type of weight data in ml.PowerIterationClustering Key: SPARK-24489 URL: https://issues.apache.org/jira/browse/SPARK-24489 Project: Spark

[jira] [Resolved] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-24217. Resolution: Fixed > Power Iteration Clustering is not displaying cluster indices corresponding to > some

[jira] [Resolved] (SPARK-24213) Power Iteration Clustering in the SparkML throws exception, when the ID is IntType

[ https://issues.apache.org/jira/browse/SPARK-24213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-24213. Resolution: Fixed > Power Iteration Clustering in the SparkML throws exception, when the ID is > IntType

[jira] [Updated] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-24484: --- Priority: Major (was: Minor) > Power Iteration Clustering is giving incorrect clustering results when there

[jira] [Commented] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521847#comment-16521847 ] shahid commented on SPARK-24484: I have raised a PR, https://github.com/apache/spark/pul

[jira] [Updated] (SPARK-18230) MatrixFactorizationModel.recommendProducts throws NoSuchElement exception when the user does not exist

[ https://issues.apache.org/jira/browse/SPARK-18230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-18230: --- Fix Version/s: 2.4.0 > MatrixFactorizationModel.recommendProducts throws NoSuchElement exception > when the

[jira] [Comment Edited] (SPARK-25536) executorSource.METRIC read wrong record in Executor.scala Line444

[ https://issues.apache.org/jira/browse/SPARK-25536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16628267#comment-16628267 ] shahid edited comment on SPARK-25536 at 9/26/18 7:18 AM: - Thanks

[jira] [Commented] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16628588#comment-16628588 ] shahid commented on SPARK-25502: [~toopt4] No. please refer the PR, to see the fix > [S

[jira] [Commented] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631703#comment-16631703 ] shahid commented on SPARK-25566: Thanks for reporting. I am working on it. > [Spark Job

[jira] [Commented] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631711#comment-16631711 ] shahid commented on SPARK-25567: Thanks. I will raise a PR > [Spark Job History] Table

[jira] [Commented] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633082#comment-16633082 ] shahid commented on SPARK-25575: I will raise a PR > SQL tab in the spark UI doesn't ha

[jira] [Created] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

shahid created SPARK-25575: -- Summary: SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has. Key: SPARK-25575 URL: https://issues.apache.org/jira/browse/SPARK-25575 Pro

[jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25575: --- Attachment: Screenshot from 2018-09-29 23-26-45.png > SQL tab in the spark UI doesn't have option of hiding

[jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25575: --- Attachment: Screenshot from 2018-09-29 23-26-57.png > SQL tab in the spark UI doesn't have option of hiding

[jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25575: --- Description: Test tests: 1) bin/spark-shell {code:java} sql("create table a (id int)") for(i <- 1 to 100) s

[jira] [Created] (SPARK-25583) Add newly added History server related configurations in the documentation

shahid created SPARK-25583: -- Summary: Add newly added History server related configurations in the documentation Key: SPARK-25583 URL: https://issues.apache.org/jira/browse/SPARK-25583 Project: Spark

[jira] [Updated] (SPARK-25583) Add newly added History server related configurations in the documentation

[ https://issues.apache.org/jira/browse/SPARK-25583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25583: --- Priority: Minor (was: Trivial) > Add newly added History server related configurations in the documentation

[jira] [Updated] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25566: --- Attachment: Screenshot from 2018-10-06 09-46-11.png > [Spark Job History] SQL UI Page does not support Pagin

[jira] [Updated] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25566: --- Description: 1. configure spark.sql.ui.retainedExecutions = 5 ( In Job History Spark-default.conf ) 2.

[jira] [Commented] (SPARK-25695) Spark history server event log store problem

[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644503#comment-16644503 ] shahid commented on SPARK-25695: Hi, This error seems, eventLog directory doesn't exist

[jira] [Comment Edited] (SPARK-25695) Spark history server event log store problem

[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644503#comment-16644503 ] shahid edited comment on SPARK-25695 at 10/10/18 6:07 AM: -- Hi,

[jira] [Commented] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644545#comment-16644545 ] shahid commented on SPARK-25697: Thanks for reproting [~abhishek.akg]. I am working on i

[jira] [Comment Edited] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644545#comment-16644545 ] shahid edited comment on SPARK-25697 at 10/10/18 7:13 AM: -- Than

[jira] [Updated] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25697: --- Attachment: Screenshot from 2018-10-10 12-45-20.png > When zstd compression enabled in progress application

[jira] [Updated] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25697: --- Description: # In spark-default.conf of Job History enable below parameter spark.eventLog.compress=true spar

[jira] [Commented] (SPARK-25698) spark live UI shows wrong completed Job Message

[ https://issues.apache.org/jira/browse/SPARK-25698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644573#comment-16644573 ] shahid commented on SPARK-25698: Thank you [~abhishek.akg], I am working on  it > spark

[jira] [Updated] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25697: --- Description: # In spark-default.conf of Job History enable below parameter spark.eventLog.compress=true spar

[jira] [Commented] (SPARK-25695) Spark history server event log store problem

[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645819#comment-16645819 ] shahid commented on SPARK-25695: Hi [~Krypton], Is event log directory there in all the

[jira] [Commented] (SPARK-25720) Support auto refresh page for the WEBUI

[ https://issues.apache.org/jira/browse/SPARK-25720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16648410#comment-16648410 ] shahid commented on SPARK-25720: I am working on it. > Support auto refresh page for th

[jira] [Reopened] (SPARK-24213) Power Iteration Clustering in the SparkML throws exception, when the ID is IntType

[ https://issues.apache.org/jira/browse/SPARK-24213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid reopened SPARK-24213: > Power Iteration Clustering in the SparkML throws exception, when the ID is > IntType >

[jira] [Resolved] (SPARK-24213) Power Iteration Clustering in the SparkML throws exception, when the ID is IntType

[ https://issues.apache.org/jira/browse/SPARK-24213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-24213. Resolution: Done Target Version/s: (was: 2.4.0) > Power Iteration Clustering in the SparkML th

[jira] [Resolved] (SPARK-24213) Power Iteration Clustering in the SparkML throws exception, when the ID is IntType

[ https://issues.apache.org/jira/browse/SPARK-24213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-24213. Resolution: Done Fix Version/s: (was: 2.4.0) > Power Iteration Clustering in the SparkML throws

[jira] [Reopened] (SPARK-24213) Power Iteration Clustering in the SparkML throws exception, when the ID is IntType

[ https://issues.apache.org/jira/browse/SPARK-24213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid reopened SPARK-24213: > Power Iteration Clustering in the SparkML throws exception, when the ID is > IntType >

[jira] [Reopened] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid reopened SPARK-24217: > Power Iteration Clustering is not displaying cluster indices corresponding to > some vertices. > --

  1   2   3   >