[
https://issues.apache.org/jira/browse/SPARK-25642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446592#comment-17446592
]
Parth Gandhi commented on SPARK-25642:
--
Hello [~yzhangal] , ideally you are correct,
[
https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907551#comment-16907551
]
Parth Gandhi commented on SPARK-27361:
--
Makes sense, thank you.
> YARN support for GPU-aware
[
https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907391#comment-16907391
]
Parth Gandhi commented on SPARK-27361:
--
[~tgraves], I was just wondering whether
[
https://issues.apache.org/jira/browse/SPARK-26130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832846#comment-16832846
]
Parth Gandhi commented on SPARK-26130:
--
Will put up a PR soon.
> Change Event Timeline Display
Parth Gandhi created SPARK-27605:
Summary: Add new column "Partition ID" to the tasks table in
stages page
Key: SPARK-27605
URL: https://issues.apache.org/jira/browse/SPARK-27605
Project: Spark
Parth Gandhi created SPARK-27207:
Summary: There exists a bug with SortBasedAggregator where
merge()/update() operations get invoked on the aggregate buffer without calling
initialize
Key: SPARK-27207
URL:
[
https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-27112:
-
Description:
Recently, a few spark users in the organization have reported that their jobs
[
https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-27112:
-
Attachment: Screen Shot 2019-02-26 at 4.10.48 PM.png
> Spark Scheduler encounters two
[
https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-27112:
-
Attachment: Screen Shot 2019-02-26 at 4.11.26 PM.png
> Spark Scheduler encounters two
[
https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-27112:
-
Attachment: Screen Shot 2019-02-26 at 4.11.11 PM.png
> Spark Scheduler encounters two
[
https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-27112:
-
Attachment: Screen Shot 2019-02-26 at 4.10.26 PM.png
> Spark Scheduler encounters two
Parth Gandhi created SPARK-27112:
Summary: Spark Scheduler encounters two independent Deadlocks when
trying to kill executors either due to dynamic allocation or blacklisting
Key: SPARK-27112
URL:
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi resolved SPARK-26947.
--
Resolution: Invalid
> Pyspark KMeans Clustering job fails on large values of k
>
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784831#comment-16784831
]
Parth Gandhi commented on SPARK-26947:
--
[~srowen] Yes your suggestion to limit the vocab size
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783849#comment-16783849
]
Parth Gandhi commented on SPARK-26947:
--
[~srowen] for this particular case, k is set to 1.
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775188#comment-16775188
]
Parth Gandhi commented on SPARK-25250:
--
[~Ngone51] I understand that you had a proposal and we were
[
https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774170#comment-16774170
]
Parth Gandhi commented on SPARK-24935:
--
Thank you [~gavin_hu] for reporting the issue in the first
[
https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773541#comment-16773541
]
Parth Gandhi commented on SPARK-24935:
--
Hi [~zanderl], thank you for your comment. Will do my best
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773457#comment-16773457
]
Parth Gandhi edited comment on SPARK-26947 at 2/20/19 10:43 PM:
I am
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773457#comment-16773457
]
Parth Gandhi commented on SPARK-26947:
--
I am unable to attach the dummy dataset as the size of the
[
https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-26947:
-
Attachment: clustering_app.py
> Pyspark KMeans Clustering job fails on large values of k
>
Parth Gandhi created SPARK-26947:
Summary: Pyspark KMeans Clustering job fails on large values of k
Key: SPARK-26947
URL: https://issues.apache.org/jira/browse/SPARK-26947
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769692#comment-16769692
]
Parth Gandhi commented on SPARK-24935:
--
Have created a new pull request for this issue here:
[
https://issues.apache.org/jira/browse/SPARK-26755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-26755:
-
Attachment: Screen Shot 2019-01-28 at 11.21.05 AM.png
> Optimize Spark Scheduler to dequeue
[
https://issues.apache.org/jira/browse/SPARK-26755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-26755:
-
Attachment: Screen Shot 2019-01-28 at 11.22.42 AM.png
> Optimize Spark Scheduler to dequeue
Parth Gandhi created SPARK-26755:
Summary: Optimize Spark Scheduler to dequeue speculative tasks
more efficiently
Key: SPARK-26755
URL: https://issues.apache.org/jira/browse/SPARK-26755
Project:
[
https://issues.apache.org/jira/browse/SPARK-26755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-26755:
-
Attachment: Screen Shot 2019-01-28 at 11.21.25 AM.png
> Optimize Spark Scheduler to dequeue
[
https://issues.apache.org/jira/browse/SPARK-26658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-26658:
-
Description:
When a pyspark job using python 3 tries to serialize large objects, it throws a
[
https://issues.apache.org/jira/browse/SPARK-26658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-26658:
-
Description:
When a pyspark job using python 3 tries to serialize large objects, it throws a
Parth Gandhi created SPARK-26658:
Summary: Pyspark job is unable to serialize large objects
Key: SPARK-26658
URL: https://issues.apache.org/jira/browse/SPARK-26658
Project: Spark
Issue
Parth Gandhi created SPARK-26253:
Summary: Task Summary Metrics Table on Stage Page shows empty
table when no data is present
Key: SPARK-26253
URL: https://issues.apache.org/jira/browse/SPARK-26253
Parth Gandhi created SPARK-26130:
Summary: Change Event Timeline Display Functionality on the Stages
Page to use either REST API or data from other tables
Key: SPARK-26130
URL:
[
https://issues.apache.org/jira/browse/SPARK-25813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661172#comment-16661172
]
Parth Gandhi commented on SPARK-25813:
--
Duplicate JIRA, refer
[
https://issues.apache.org/jira/browse/SPARK-25813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi resolved SPARK-25813.
--
Resolution: Duplicate
> Unit Test "pageNavigation" for test suite PagedTableSuite.scala is
Parth Gandhi created SPARK-25813:
Summary: Unit Test "pageNavigation" for test suite
PagedTableSuite.scala is failing for Apache Spark master branch
Key: SPARK-25813
URL:
Parth Gandhi created SPARK-25719:
Summary: Search functionality in datatables in stages page should
search over formatted data rather than the raw data
Key: SPARK-25719
URL:
[
https://issues.apache.org/jira/browse/SPARK-25642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-25642:
-
Description: Recently, the ability to expose the metrics for YARN Shuffle
Service was added as
Parth Gandhi created SPARK-25642:
Summary: Add new Metrics in External Shuffle Service to help
determine Network performance and Connection Handling capabilities of the
Shuffle Service
Key: SPARK-25642
URL:
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625283#comment-16625283
]
Parth Gandhi commented on SPARK-25250:
--
Currently working on this issue, will file a pull request
[
https://issues.apache.org/jira/browse/SPARK-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622447#comment-16622447
]
Parth Gandhi commented on SPARK-18364:
--
I have put up a PR following up on Andrew Ash's work here:
Parth Gandhi created SPARK-25250:
Summary: Race condition with tasks running when new attempt for
same stage is created leads to other task in the next attempt running on the
same partition id retry multiple times
Key:
Parth Gandhi created SPARK-25231:
Summary: Running a Large Job with Speculation On Causes Executor
Heartbeats to Time Out on Driver
Key: SPARK-25231
URL: https://issues.apache.org/jira/browse/SPARK-25231
[
https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576467#comment-16576467
]
Parth Gandhi commented on SPARK-24935:
--
[~cloud_fan] [~lian cheng],
What do you think of my
[
https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561266#comment-16561266
]
Parth Gandhi commented on SPARK-24935:
--
[~cloud_fan] I too had the same doubt that maybe hive UDAF
Parth Gandhi created SPARK-24935:
Summary: Problem with Executing Hive UDF's from Spark 2.2 Onwards
Key: SPARK-24935
URL: https://issues.apache.org/jira/browse/SPARK-24935
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16548452#comment-16548452
]
Parth Gandhi edited comment on SPARK-18186 at 7/18/18 9:54 PM:
---
Hi [~lian
[
https://issues.apache.org/jira/browse/SPARK-18186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16548452#comment-16548452
]
Parth Gandhi commented on SPARK-18186:
--
Hi, there has been an issue lately with the library
Parth Gandhi created SPARK-24851:
Summary: Map a Stage ID to it's Associated Job ID in UI
Key: SPARK-24851
URL: https://issues.apache.org/jira/browse/SPARK-24851
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-22185:
-
Summary: Classpath cannot be set for jobs running on Spark Standalone Mode
(was: Jobs running
Parth Gandhi created SPARK-22185:
Summary: Jobs running on Spark Standalone Mode cannot access HDFS
Key: SPARK-22185
URL: https://issues.apache.org/jira/browse/SPARK-22185
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149350#comment-16149350
]
Parth Gandhi edited comment on SPARK-21888 at 8/31/17 6:01 PM:
---
The spark
[
https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149350#comment-16149350
]
Parth Gandhi commented on SPARK-21888:
--
The spark job runs successfully only if hbase-site.xml is
[
https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149263#comment-16149263
]
Parth Gandhi commented on SPARK-21888:
--
Sorry I forgot to mention that, --jars certainly adds jar
[
https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-21888:
-
Description: While running Spark on Yarn in cluster mode, currently there
is no way to add any
[
https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-21888:
-
Description: While running Spark on Yarn in cluster mode, currently there
is no way to add any
Parth Gandhi created SPARK-21888:
Summary: Cannot add stuff to Client Classpath for Yarn Cluster Mode
Key: SPARK-21888
URL: https://issues.apache.org/jira/browse/SPARK-21888
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140833#comment-16140833
]
Parth Gandhi commented on SPARK-21798:
--
Filed a pull request for this ticket:
[
https://issues.apache.org/jira/browse/SPARK-21585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107936#comment-16107936
]
Parth Gandhi commented on SPARK-21585:
--
Currently working on the fix, will file a pull request as
Parth Gandhi created SPARK-21585:
Summary: Application Master marking application status as Failed
for Client Mode
Key: SPARK-21585
URL: https://issues.apache.org/jira/browse/SPARK-21585
Project:
[
https://issues.apache.org/jira/browse/SPARK-21541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105116#comment-16105116
]
Parth Gandhi commented on SPARK-21541:
--
The change has been merged. Thank you.
> Spark Logs show
[
https://issues.apache.org/jira/browse/SPARK-21541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-21541:
-
Description:
If you run a spark job without creating the SparkSession or SparkContext, the
[
https://issues.apache.org/jira/browse/SPARK-21541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102308#comment-16102308
]
Parth Gandhi commented on SPARK-21541:
--
Currently working on the fix, will file a pull request as
Parth Gandhi created SPARK-21541:
Summary: Spark Logs show incorrect job status for a job that does
not create SparkContext
Key: SPARK-21541
URL: https://issues.apache.org/jira/browse/SPARK-21541
[
https://issues.apache.org/jira/browse/SPARK-21503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096846#comment-16096846
]
Parth Gandhi commented on SPARK-21503:
--
Currently working on the fix, will file a pull request as
Parth Gandhi created SPARK-21503:
Summary: Spark UI shows incorrect task status for a killed
Executor Process
Key: SPARK-21503
URL: https://issues.apache.org/jira/browse/SPARK-21503
Project: Spark
65 matches
Mail list logo