[jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version

[ https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364409#comment-17364409 ] Neelesh Srinivas Salian commented on SPARK-18673: - Hitting this in Spark

[jira] [Commented] (SPARK-27963) Allow dynamic allocation without an external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17273192#comment-17273192 ] Neelesh Srinivas Salian commented on SPARK-27963: - [~dongjoon] [~vanzin]

[jira] [Comment Edited] (SPARK-27872) Driver and executors use a different service account breaking pull secrets

[ https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194557#comment-17194557 ] Neelesh Srinivas Salian edited comment on SPARK-27872 at 9/23/20, 12:36 AM: --

[jira] [Comment Edited] (SPARK-27872) Driver and executors use a different service account breaking pull secrets

[ https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194557#comment-17194557 ] Neelesh Srinivas Salian edited comment on SPARK-27872 at 9/23/20, 12:36 AM: --

[jira] [Issue Comment Deleted] (SPARK-27872) Driver and executors use a different service account breaking pull secrets

[ https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-27872: Comment: was deleted (was: I have a patch to add this fix to the 2.4.x (cu

[jira] [Comment Edited] (SPARK-27872) Driver and executors use a different service account breaking pull secrets

[ https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194557#comment-17194557 ] Neelesh Srinivas Salian edited comment on SPARK-27872 at 9/23/20, 12:36 AM: --

[jira] [Commented] (SPARK-27872) Driver and executors use a different service account breaking pull secrets

[ https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194557#comment-17194557 ] Neelesh Srinivas Salian commented on SPARK-27872: - I have a patch to add

[jira] [Closed] (SPARK-4449) specify port range in spark

[ https://issues.apache.org/jira/browse/SPARK-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian closed SPARK-4449. -- Resolution: Won't Fix > specify port range in spark > --

[jira] [Commented] (SPARK-13216) Spark streaming application not honoring --num-executors in restarting of an application from a checkpoint

[ https://issues.apache.org/jira/browse/SPARK-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15347067#comment-15347067 ] Neelesh Srinivas Salian commented on SPARK-13216: - [~srowen] are we movin

[jira] [Created] (SPARK-16122) Spark History Server REST API missing an environment endpoint per application

Neelesh Srinivas Salian created SPARK-16122: --- Summary: Spark History Server REST API missing an environment endpoint per application Key: SPARK-16122 URL: https://issues.apache.org/jira/browse/SPARK-1612

[jira] [Commented] (SPARK-11441) HadoopFsRelation is not scalable in number of files read/written

[ https://issues.apache.org/jira/browse/SPARK-11441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15342503#comment-15342503 ] Neelesh Srinivas Salian commented on SPARK-11441: - [~koert] thank you for

[jira] [Commented] (SPARK-3210) Flume Polling Receiver must be more tolerant to connection failures.

[ https://issues.apache.org/jira/browse/SPARK-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267761#comment-15267761 ] Neelesh Srinivas Salian commented on SPARK-3210: Is this still valid [~tda

[jira] [Commented] (SPARK-8480) Add setName for Dataframe

[ https://issues.apache.org/jira/browse/SPARK-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15182262#comment-15182262 ] Neelesh Srinivas Salian commented on SPARK-8480: Looking into this. Will

[jira] [Commented] (SPARK-7505) Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

[ https://issues.apache.org/jira/browse/SPARK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181418#comment-15181418 ] Neelesh Srinivas Salian commented on SPARK-7505: Does this still apply ? [

[jira] [Commented] (SPARK-6043) Error when trying to rename table with alter table after using INSERT OVERWITE to populate the table

[ https://issues.apache.org/jira/browse/SPARK-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181416#comment-15181416 ] Neelesh Srinivas Salian commented on SPARK-6043: [~tleftwich] is this stil

[jira] [Commented] (SPARK-4549) Support BigInt -> Decimal in convertToCatalyst in SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-4549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181398#comment-15181398 ] Neelesh Srinivas Salian commented on SPARK-4549: [~huangjs] could you plea

[jira] [Updated] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-13241: Component/s: Web UI > add long--formatted timestamps to > org.apache.spark

[jira] [Created] (SPARK-13216) Spark streaming application not honoring --num-executors in restarting of an application from a checkpoint

Neelesh Srinivas Salian created SPARK-13216: --- Summary: Spark streaming application not honoring --num-executors in restarting of an application from a checkpoint Key: SPARK-13216 URL: https://issues.apac

[jira] [Commented] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

[ https://issues.apache.org/jira/browse/SPARK-12263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058429#comment-15058429 ] Neelesh Srinivas Salian commented on SPARK-12263: - I would like to work o

[jira] [Commented] (SPARK-12303) Configuration parameter by which can choose if we want the REPL generated class directory name to be random or fixed name.

[ https://issues.apache.org/jira/browse/SPARK-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15054515#comment-15054515 ] Neelesh Srinivas Salian commented on SPARK-12303: - Hi piyush, Thanks for

[jira] [Closed] (SPARK-12047) Unhelpful error messages generated by JavaDoc while doing sbt unidoc

[ https://issues.apache.org/jira/browse/SPARK-12047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian closed SPARK-12047. --- Resolution: Duplicate > Unhelpful error messages generated by JavaDoc while d

[jira] [Commented] (SPARK-12047) Unhelpful error messages generated by JavaDoc while doing sbt unidoc

[ https://issues.apache.org/jira/browse/SPARK-12047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053614#comment-15053614 ] Neelesh Srinivas Salian commented on SPARK-12047: - Closing these since th

[jira] [Commented] (SPARK-12265) Spark calls System.exit inside driver instead of throwing exception

[ https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051190#comment-15051190 ] Neelesh Srinivas Salian commented on SPARK-12265: - [~srowen] [~dragos] Ca

[jira] [Commented] (SPARK-2280) Java & Scala reference docs should describe function reference behavior.

[ https://issues.apache.org/jira/browse/SPARK-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047674#comment-15047674 ] Neelesh Srinivas Salian commented on SPARK-2280: [~srowen] , checking to s

[jira] [Comment Edited] (SPARK-9059) Update Python Direct Kafka Word count examples to show the use of HasOffsetRanges

[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047132#comment-15047132 ] Neelesh Srinivas Salian edited comment on SPARK-9059 at 12/8/15 11:15 PM: --

[jira] [Commented] (SPARK-12118) SparkR: Documentation change for isNaN

[ https://issues.apache.org/jira/browse/SPARK-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047180#comment-15047180 ] Neelesh Srinivas Salian commented on SPARK-12118: - Hi [~yanboliang] This

[jira] [Updated] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-12071: Labels: releasenotes starter (was: releasenotes) > Programming guide shoul

[jira] [Commented] (SPARK-9059) Update Python Direct Kafka Word count examples to show the use of HasOffsetRanges

[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047132#comment-15047132 ] Neelesh Srinivas Salian commented on SPARK-9059: Is this JIRA still active

[jira] [Comment Edited] (SPARK-11721) The programming guide for Spark SQL in Spark 1.3.0 needs additional imports to work

[ https://issues.apache.org/jira/browse/SPARK-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004265#comment-15004265 ] Neelesh Srinivas Salian edited comment on SPARK-11721 at 11/13/15 4:48 PM:

[jira] [Closed] (SPARK-11721) The programming guide for Spark SQL in Spark 1.3.0 needs additional imports to work

[ https://issues.apache.org/jira/browse/SPARK-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian closed SPARK-11721. --- Resolution: Implemented Fix Version/s: 1.3.0 > The programming guide f

[jira] [Commented] (SPARK-11721) The programming guide for Spark SQL in Spark 1.3.0 needs additional imports to work

[ https://issues.apache.org/jira/browse/SPARK-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004265#comment-15004265 ] Neelesh Srinivas Salian commented on SPARK-11721: - Didn't work when I tri

[jira] [Created] (SPARK-11721) The programming guide for Spark SQL in Spark 1.3.0 needs additional imports to work

Neelesh Srinivas Salian created SPARK-11721: --- Summary: The programming guide for Spark SQL in Spark 1.3.0 needs additional imports to work Key: SPARK-11721 URL: https://issues.apache.org/jira/browse/SPAR

[jira] [Commented] (SPARK-516) Improve error reporting when slaves fail to start

[ https://issues.apache.org/jira/browse/SPARK-516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995789#comment-14995789 ] Neelesh Srinivas Salian commented on SPARK-516: --- [~rxin] is this still releva

[jira] [Commented] (SPARK-1191) Convert configs to use SparkConf

[ https://issues.apache.org/jira/browse/SPARK-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995491#comment-14995491 ] Neelesh Srinivas Salian commented on SPARK-1191: Is this JIRA still releva

[jira] [Updated] (SPARK-9923) ShuffleMapStage.numAvailableOutputs should be an Int instead of Long

[ https://issues.apache.org/jira/browse/SPARK-9923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-9923: --- Component/s: Spark Core > ShuffleMapStage.numAvailableOutputs should be an Int

[jira] [Commented] (SPARK-9396) Spark yarn allocator does not call "removeContainerRequest" for allocated Container requests, resulting in bloated ask[] toYarn RM.

[ https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14663237#comment-14663237 ] Neelesh Srinivas Salian commented on SPARK-9396: [~prakhar088] feel free t

[jira] [Updated] (SPARK-9570) Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x'.

[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-9570: --- Description: There are still some inconsistencies in the documentation regardi

[jira] [Updated] (SPARK-9570) Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x'.

[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-9570: --- Summary: Consistent recommendation for submitting spark apps to YARN, -master

[jira] [Updated] (SPARK-9570) Consistent recommendation for spark-submit --master

[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-9570: --- Summary: Consistent recommendation for spark-submit --master (was: Preferred

[jira] [Updated] (SPARK-9570) Preferred rrecommendation for spark-submit --master

[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-9570: --- Summary: Preferred rrecommendation for spark-submit --master (was: Improveme

[jira] [Updated] (SPARK-9570) Preferred recommendation for spark-submit --master

[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-9570: --- Summary: Preferred recommendation for spark-submit --master (was: Preferred

[jira] [Created] (SPARK-9570) Improvement to spark-submit

Neelesh Srinivas Salian created SPARK-9570: -- Summary: Improvement to spark-submit Key: SPARK-9570 URL: https://issues.apache.org/jira/browse/SPARK-9570 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-8612) Yarn application status is misreported for failed PySpark apps.

[ https://issues.apache.org/jira/browse/SPARK-8612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650564#comment-14650564 ] Neelesh Srinivas Salian commented on SPARK-8612: Similar to SPARK-7736? >

[jira] [Commented] (SPARK-4449) specify port range in spark

[ https://issues.apache.org/jira/browse/SPARK-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648090#comment-14648090 ] Neelesh Srinivas Salian commented on SPARK-4449: I would like to pick this

[jira] [Commented] (SPARK-9380) Pregel example fix in graphx-programming-guide

[ https://issues.apache.org/jira/browse/SPARK-9380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646841#comment-14646841 ] Neelesh Srinivas Salian commented on SPARK-9380: Seems to be corrected. ht

[jira] [Issue Comment Deleted] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-4352: --- Comment: was deleted (was: Checking to see if this been resolved? ) > Incor

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618885#comment-14618885 ] Neelesh Srinivas Salian commented on SPARK-7736: My 2 cents: To have a YA

[jira] [Comment Edited] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615553#comment-14615553 ] Neelesh Srinivas Salian edited comment on SPARK-8743 at 7/6/15 8:36 PM:

[jira] [Comment Edited] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615553#comment-14615553 ] Neelesh Srinivas Salian edited comment on SPARK-8743 at 7/6/15 8:06 PM:

[jira] [Commented] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615553#comment-14615553 ] Neelesh Srinivas Salian commented on SPARK-8743: [~tdas] should have a PR

[jira] [Commented] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609437#comment-14609437 ] Neelesh Srinivas Salian commented on SPARK-8743: I would like to work on t

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601914#comment-14601914 ] Neelesh Srinivas Salian commented on SPARK-7736: Could you add more contex

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601898#comment-14601898 ] Neelesh Srinivas Salian commented on SPARK-4352: Checking to see if this b

[jira] [Commented] (SPARK-3629) Improvements to YARN doc

[ https://issues.apache.org/jira/browse/SPARK-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594941#comment-14594941 ] Neelesh Srinivas Salian commented on SPARK-3629: I have created a PR for t

[jira] [Issue Comment Deleted] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-8320: --- Comment: was deleted (was: Deleted that PR. Added https://github.com/apache/s

[jira] [Issue Comment Deleted] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-8320: --- Comment: was deleted (was: Added python example: https://github.com/apache/spa

[jira] [Commented] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14590040#comment-14590040 ] Neelesh Srinivas Salian commented on SPARK-8320: Deleted that PR. Added h

[jira] [Commented] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589990#comment-14589990 ] Neelesh Srinivas Salian commented on SPARK-8320: Added python example: htt

[jira] [Commented] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14585248#comment-14585248 ] Neelesh Srinivas Salian commented on SPARK-8320: I would like to work on t

[jira] [Comment Edited] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14585248#comment-14585248 ] Neelesh Srinivas Salian edited comment on SPARK-8320 at 6/14/15 8:24 PM: ---

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391623#comment-14391623 ] Neelesh Srinivas Salian commented on SPARK-2243: I hit this error. Simply

[jira] [Updated] (SPARK-5055) Minor typos on the downloads page

[ https://issues.apache.org/jira/browse/SPARK-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-5055: --- Attachment: Spark_DownloadsPage_FixedTypos.html Here is the HTML page with the