[jira] [Created] (SPARK-34327) Omit inlining passwords during build process.

2021-02-02 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-34327: --- Summary: Omit inlining passwords during build process. Key: SPARK-34327 URL: https://issues.apache.org/jira/browse/SPARK-34327 Project: Spark Issue

[jira] [Resolved] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2021-01-06 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-32221. - Resolution: Fixed > Avoid possible errors due to incorrect file size or type supplied

[jira] [Updated] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2021-01-06 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32221: Fix Version/s: 3.1.0 > Avoid possible errors due to incorrect file size or type supplied

[jira] [Assigned] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2021-01-06 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reassigned SPARK-32221: --- Assignee: Prashant Sharma > Avoid possible errors due to incorrect file size or

[jira] [Updated] (SPARK-32007) Spark Driver Supervise does not work reliably

2020-12-13 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32007: Priority: Major (was: Critical) > Spark Driver Supervise does not work reliably >

[jira] [Updated] (SPARK-33668) Fix flaky test "Verify logging configuration is picked from the provided SPARK_CONF_DIR/log4j.properties."

2020-12-04 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-33668: Description: The test is flaking, with multiple flaked instances - the reason for the

[jira] [Created] (SPARK-33668) Fix flaky test "Verify logging configuration is picked from the provided SPARK_CONF_DIR/log4j.properties."

2020-12-04 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-33668: --- Summary: Fix flaky test "Verify logging configuration is picked from the provided SPARK_CONF_DIR/log4j.properties." Key: SPARK-33668 URL:

[jira] [Updated] (SPARK-33626) Allow k8s integration tests to assert both driver and executor logs for expected log(s)

2020-12-02 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-33626: Summary: Allow k8s integration tests to assert both driver and executor logs for expected

[jira] [Updated] (SPARK-33626) Allow k8s integration tests to assert both driver and executor logs for expected log(s)

2020-12-02 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-33626: Description: Improve the k8s tests, to be able to assert both driver and executor logs

[jira] [Updated] (SPARK-33626) Allow k8s integration tests to assert both driver and executor logs for expected text(s)

2020-12-02 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-33626: Description: Improve the k8s tests, to be able to assert both driver and executor logs

[jira] [Updated] (SPARK-33626) Allow k8s integration tests to assert both driver and executor logs for expected text(s)

2020-12-02 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-33626: Summary: Allow k8s integration tests to assert both driver and executor logs for expected

[jira] [Created] (SPARK-33626) k8s integration tests should assert driver and executor logs for must & must not contain

2020-12-01 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-33626: --- Summary: k8s integration tests should assert driver and executor logs for must & must not contain Key: SPARK-33626 URL: https://issues.apache.org/jira/browse/SPARK-33626

[jira] [Commented] (SPARK-32223) Support adding a user provided config map.

2020-11-25 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239069#comment-17239069 ] Prashant Sharma commented on SPARK-32223: - One problem, I can think of with driver template is,

[jira] [Updated] (SPARK-32223) Support adding a user provided config map.

2020-11-25 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32223: Description: One of the challenge with this is, spark.properties is not user provided and

[jira] [Commented] (SPARK-32223) Support adding a user provided config map.

2020-11-25 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238617#comment-17238617 ] Prashant Sharma commented on SPARK-32223: - Hi [~dongjoon], Do you think this is useful ? Any

[jira] [Updated] (SPARK-32223) Support adding a user provided config map.

2020-11-25 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32223: Description: One of the challenge with this is, spark.properties is not user provided and

[jira] [Updated] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-23 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32221: Description: This would avoid failures, in case the files are a bit large or a user

[jira] [Updated] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-17 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32221: Description: This would avoid failures, in case the files are a bit large or a user

[jira] [Commented] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-11-16 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17233227#comment-17233227 ] Prashant Sharma commented on SPARK-30985: - Thanks [~dongjoon], you have resolved the confusion I

[jira] [Comment Edited] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-11-16 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232631#comment-17232631 ] Prashant Sharma edited comment on SPARK-30985 at 11/16/20, 9:21 AM:

[jira] [Assigned] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-11-16 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reassigned SPARK-30985: --- Assignee: (was: Prashant Sharma) > Propagate SPARK_CONF_DIR files to driver

[jira] [Assigned] (SPARK-33461) Foundational work for propagating SPARK_CONF_DIR

2020-11-16 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reassigned SPARK-33461: --- Assignee: Prashant Sharma > Foundational work for propagating SPARK_CONF_DIR >

[jira] [Resolved] (SPARK-33461) Foundational work for propagating SPARK_CONF_DIR

2020-11-16 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-33461. - Fix Version/s: 3.1.0 Resolution: Fixed > Foundational work for propagating

[jira] [Created] (SPARK-33461) Foundational work for propagating SPARK_CONF_DIR

2020-11-16 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-33461: --- Summary: Foundational work for propagating SPARK_CONF_DIR Key: SPARK-33461 URL: https://issues.apache.org/jira/browse/SPARK-33461 Project: Spark Issue

[jira] [Reopened] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-11-16 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reopened SPARK-30985: - Reopening this JIRA as, this is Umbrella jira and I created a PR incorrectly targeting the

[jira] [Commented] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-11-16 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232628#comment-17232628 ] Prashant Sharma commented on SPARK-30985: - [~dongjoon] Hm.. my mistake. As you said, I added

[jira] [Updated] (SPARK-33157) Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Teradata dialect)

2020-10-15 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-33157: Description: Override the default SQL strings for: ALTER TABLE ADD COLUMN ALTER TABLE

[jira] [Created] (SPARK-33157) Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Teradata dialect)

2020-10-15 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-33157: --- Summary: Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Teradata dialect) Key: SPARK-33157 URL:

[jira] [Created] (SPARK-33130) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MsSqlServer dialect)

2020-10-13 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-33130: --- Summary: Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MsSqlServer dialect) Key: SPARK-33130 URL:

[jira] [Updated] (SPARK-33129) Since the sbt version is now upgraded, old `test-only` needs to be replaced with `testOnly`

2020-10-13 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-33129: Description: Follow up to SPARK-21708, updating the references to test-only with

[jira] [Created] (SPARK-33129) Since the sbt version is now upgraded, old `test-only` needs to be replaced with `testOnly`

2020-10-13 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-33129: --- Summary: Since the sbt version is now upgraded, old `test-only` needs to be replaced with `testOnly` Key: SPARK-33129 URL: https://issues.apache.org/jira/browse/SPARK-33129

[jira] [Updated] (SPARK-33095) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MySQL dialect)

2020-10-13 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-33095: Description: Override the default SQL strings for: ALTER TABLE UPDATE COLUMN TYPE ALTER

[jira] [Created] (SPARK-33095) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MySQL dialect)

2020-10-08 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-33095: --- Summary: Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MySQL dialect) Key: SPARK-33095 URL:

[jira] [Created] (SPARK-32937) DecomissionSuite in k8s integration tests is failing.

2020-09-18 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-32937: --- Summary: DecomissionSuite in k8s integration tests is failing. Key: SPARK-32937 URL: https://issues.apache.org/jira/browse/SPARK-32937 Project: Spark

[jira] [Resolved] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

2020-08-31 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-32495. - Resolution: Won't Fix Resolving it as won't fix for now, as most of us feel the

[jira] [Created] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

2020-08-14 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-32617: --- Summary: Upgrade kubernetes client version to support latest minikube version. Key: SPARK-32617 URL: https://issues.apache.org/jira/browse/SPARK-32617 Project:

[jira] [Commented] (SPARK-32018) Fix UnsafeRow set overflowed decimal

2020-08-13 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17176906#comment-17176906 ] Prashant Sharma commented on SPARK-32018: - This issue is resolved as fixed with version 2.4.7.

[jira] [Updated] (SPARK-32556) Fix release script to uri encode the user provided passwords.

2020-08-13 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32556: Fix Version/s: 2.4.7 > Fix release script to uri encode the user provided passwords. >

[jira] [Resolved] (SPARK-32556) Fix release script to uri encode the user provided passwords.

2020-08-07 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-32556. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved

[jira] [Assigned] (SPARK-32556) Fix release script to uri encode the user provided passwords.

2020-08-07 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reassigned SPARK-32556: --- Assignee: Prashant Sharma > Fix release script to uri encode the user provided

[jira] [Updated] (SPARK-32556) Fix release script to uri encode the user provided passwords.

2020-08-06 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32556: Component/s: Project Infra > Fix release script to uri encode the user provided

[jira] [Updated] (SPARK-32556) Fix release script to uri encode the user provided passwords.

2020-08-05 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32556: Description: As I was trying to do the release using the docker {code:java}

[jira] [Created] (SPARK-32556) Fix release script to uri encode the user provided passwords.

2020-08-05 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-32556: --- Summary: Fix release script to uri encode the user provided passwords. Key: SPARK-32556 URL: https://issues.apache.org/jira/browse/SPARK-32556 Project: Spark

[jira] [Commented] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

2020-08-03 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169800#comment-17169800 ] Prashant Sharma commented on SPARK-32495: - In general, upgrading the version of a dependency can

[jira] [Comment Edited] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

2020-08-03 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169756#comment-17169756 ] Prashant Sharma edited comment on SPARK-32495 at 8/3/20, 7:54 AM: -- As

[jira] [Commented] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

2020-08-03 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169781#comment-17169781 ] Prashant Sharma commented on SPARK-32486: - This issue needs discussion, before we can mark it as

[jira] [Updated] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

2020-08-03 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32486: Priority: Major (was: Blocker) > Issue with deserialization and persist api in latest

[jira] [Commented] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

2020-08-03 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169756#comment-17169756 ] Prashant Sharma commented on SPARK-32495: - As per the issues and commit:

[jira] [Updated] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

2020-08-02 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32495: Summary: Update jackson-databind versions to fix various vulnerabilities. (was: Update

[jira] [Commented] (SPARK-32495) Update jackson versions from 2.4.6 and so on(2.4.x)

2020-07-31 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17168825#comment-17168825 ] Prashant Sharma commented on SPARK-32495: - Furthermore, according to

[jira] [Commented] (SPARK-32495) Update jackson versions from 2.4.6 and so on(2.4.x)

2020-07-31 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17168628#comment-17168628 ] Prashant Sharma commented on SPARK-32495: - Is this not specific to, jackson-databind? And the

[jira] [Created] (SPARK-32379) docker based spark release script should use correct CRAN repo.

2020-07-21 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-32379: --- Summary: docker based spark release script should use correct CRAN repo. Key: SPARK-32379 URL: https://issues.apache.org/jira/browse/SPARK-32379 Project: Spark

[jira] [Created] (SPARK-32371) Autodetect persistently failing executor pods and fail the application logging the cause.

2020-07-20 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-32371: --- Summary: Autodetect persistently failing executor pods and fail the application logging the cause. Key: SPARK-32371 URL: https://issues.apache.org/jira/browse/SPARK-32371

[jira] [Updated] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-07-13 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30985: Description: SPARK_CONF_DIR hosts configuration files like, 1) spark-defaults.conf -

[jira] [Updated] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-07-13 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30985: Component/s: (was: Spark Core) > Propagate SPARK_CONF_DIR files to driver and exec

[jira] [Created] (SPARK-32223) Support adding a user provided config map.

2020-07-08 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-32223: --- Summary: Support adding a user provided config map. Key: SPARK-32223 URL: https://issues.apache.org/jira/browse/SPARK-32223 Project: Spark Issue Type:

[jira] [Created] (SPARK-32222) Add integration tests

2020-07-08 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-3: --- Summary: Add integration tests Key: SPARK-3 URL: https://issues.apache.org/jira/browse/SPARK-3 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-07-08 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-32221: --- Summary: Avoid possible errors due to incorrect file size or type supplied in spark conf. Key: SPARK-32221 URL: https://issues.apache.org/jira/browse/SPARK-32221

[jira] [Updated] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-07-07 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30985: Description: SPARK_CONF_DIR hosts configuration files like, 1) spark-defaults.conf -

[jira] [Updated] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-07-01 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30985: Description: SPARK_CONF_DIR hosts configuration files like, 1) spark-defaults.conf -

[jira] [Updated] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-07-01 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30985: Description: SPARK_CONF_DIR hosts configuration files like, 1) spark-defaults.conf -

[jira] [Commented] (SPARK-30466) remove dependency on jackson-mapper-asl-1.9.13 and jackson-core-asl-1.9.13

2020-06-24 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143607#comment-17143607 ] Prashant Sharma commented on SPARK-30466: - https://issues.apache.org/jira/browse/HADOOP-15984

[jira] [Commented] (SPARK-30466) remove dependency on jackson-mapper-asl-1.9.13 and jackson-core-asl-1.9.13

2020-06-24 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143569#comment-17143569 ] Prashant Sharma commented on SPARK-30466: - I just saw, Hadoop 3.2.1 still uses these

[jira] [Updated] (SPARK-31994) Docker image should use `https` urls for only mirrors that support it(SSL)

2020-06-15 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-31994: Summary: Docker image should use `https` urls for only mirrors that support it(SSL)

[jira] [Created] (SPARK-31994) Docker image should use `https` urls for only deb.debian.org mirrors.

2020-06-15 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-31994: --- Summary: Docker image should use `https` urls for only deb.debian.org mirrors. Key: SPARK-31994 URL: https://issues.apache.org/jira/browse/SPARK-31994 Project:

[jira] [Commented] (SPARK-31371) FileStreamSource: Decide seen files on the checksum, instead of filename.

2020-04-29 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095286#comment-17095286 ] Prashant Sharma commented on SPARK-31371: - Thank you for responding. As you said, a link to the

[jira] [Resolved] (SPARK-30467) On Federal Information Processing Standard (FIPS) enabled cluster, Spark Workers are not able to connect to Remote Master.

2020-04-22 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-30467. - Resolution: Cannot Reproduce > On Federal Information Processing Standard (FIPS)

[jira] [Commented] (SPARK-30467) On Federal Information Processing Standard (FIPS) enabled cluster, Spark Workers are not able to connect to Remote Master.

2020-04-22 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089517#comment-17089517 ] Prashant Sharma commented on SPARK-30467: - As it is already mentioned here, this is not a SPARK

[jira] [Commented] (SPARK-31371) FileStreamSource: Decide seen files on the checksum, instead of filename.

2020-04-07 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077048#comment-17077048 ] Prashant Sharma commented on SPARK-31371: - [~tdas] What do you think? > FileStreamSource:

[jira] [Created] (SPARK-31371) FileStreamSource: Decide seen files on the checksum, instead of filename.

2020-04-07 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-31371: --- Summary: FileStreamSource: Decide seen files on the checksum, instead of filename. Key: SPARK-31371 URL: https://issues.apache.org/jira/browse/SPARK-31371

[jira] [Updated] (SPARK-31200) Docker image build fails with Mirror sync in progress? errors.

2020-03-20 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-31200: Description: Following errors would appear, in spite of trying to switch between various

[jira] [Created] (SPARK-31200) Docker image build fails with Mirror sync in progress? errors.

2020-03-20 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-31200: --- Summary: Docker image build fails with Mirror sync in progress? errors. Key: SPARK-31200 URL: https://issues.apache.org/jira/browse/SPARK-31200 Project: Spark

[jira] [Updated] (SPARK-31120) Support enabling maven profiles for importing via sbt on Intellij IDEA.

2020-03-11 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-31120: Summary: Support enabling maven profiles for importing via sbt on Intellij IDEA. (was:

[jira] [Updated] (SPARK-31120) Support enabling maven profiles while importing via sbt on Intellij IDEA.

2020-03-11 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-31120: Attachment: Screenshot 2020-03-11 at 4.18.09 PM.png > Support enabling maven profiles

[jira] [Updated] (SPARK-31120) Support enabling maven profiles while importing via sbt on Intellij IDEA.

2020-03-11 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-31120: Attachment: Screenshot 2020-03-11 at 4.09.57 PM.png > Support enabling maven profiles

[jira] [Created] (SPARK-31120) Support enabling maven profiles while importing via sbt on Intellij IDEA.

2020-03-11 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-31120: --- Summary: Support enabling maven profiles while importing via sbt on Intellij IDEA. Key: SPARK-31120 URL: https://issues.apache.org/jira/browse/SPARK-31120

[jira] [Assigned] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-03-05 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reassigned SPARK-30985: --- Assignee: (was: Prashant Sharma) > Propagate SPARK_CONF_DIR files to driver

[jira] [Updated] (SPARK-31006) Mark Spark streaming as deprecated and add warnings.

2020-03-02 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-31006: Description: It is noticed that some of the users of Spark streaming do not immediately

[jira] [Created] (SPARK-31006) Mark Spark streaming as deprecated and add warnings.

2020-03-02 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-31006: --- Summary: Mark Spark streaming as deprecated and add warnings. Key: SPARK-31006 URL: https://issues.apache.org/jira/browse/SPARK-31006 Project: Spark

[jira] [Created] (SPARK-30985) Propagate SPARK_CONF_DIR files to driver and exec pods.

2020-02-28 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-30985: --- Summary: Propagate SPARK_CONF_DIR files to driver and exec pods. Key: SPARK-30985 URL: https://issues.apache.org/jira/browse/SPARK-30985 Project: Spark

[jira] [Updated] (SPARK-30771) Failed mount warning from kubernetes and support the "optional" mount.

2020-02-10 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30771: Attachment: (was: Screenshot 2020-02-10 at 3.10.01 PM.png) > Failed mount warning

[jira] [Updated] (SPARK-30771) Failed mount warning from kubernetes and support the "optional" mount.

2020-02-10 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30771: Attachment: Screenshot 2020-02-10 at 3.10.01 PM.png > Failed mount warning from

[jira] [Created] (SPARK-30771) Avoid failed mount warning from kubernetes and support the "optional" mount.

2020-02-10 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-30771: --- Summary: Avoid failed mount warning from kubernetes and support the "optional" mount. Key: SPARK-30771 URL: https://issues.apache.org/jira/browse/SPARK-30771

[jira] [Updated] (SPARK-30771) Failed mount warning from kubernetes and support the "optional" mount.

2020-02-10 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30771: Summary: Failed mount warning from kubernetes and support the "optional" mount. (was:

[jira] [Updated] (SPARK-30771) Failed mount warning from kubernetes and support the "optional" mount.

2020-02-10 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30771: Attachment: Screenshot 2020-02-10 at 3.10.01 PM.png > Failed mount warning from

[jira] [Commented] (SPARK-30595) Unable to create local temp dir on spark on k8s mode, with defaults.

2020-02-05 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031309#comment-17031309 ] Prashant Sharma commented on SPARK-30595: - Resolving this as not a problem, as this was a

[jira] [Resolved] (SPARK-30595) Unable to create local temp dir on spark on k8s mode, with defaults.

2020-02-05 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-30595. - Resolution: Not A Problem > Unable to create local temp dir on spark on k8s mode, with

[jira] [Commented] (SPARK-25065) Driver and executors pick the wrong logging configuration file.

2020-02-04 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029640#comment-17029640 ] Prashant Sharma commented on SPARK-25065: - I have an updated patch available for this issue, any

[jira] [Created] (SPARK-30595) Unable to create local temp dir on spark on k8s mode, with defaults.

2020-01-21 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-30595: --- Summary: Unable to create local temp dir on spark on k8s mode, with defaults. Key: SPARK-30595 URL: https://issues.apache.org/jira/browse/SPARK-30595 Project:

[jira] [Updated] (SPARK-25065) Driver and executors pick the wrong logging configuration file.

2019-10-21 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25065: Labels: (was: bulk-closed) > Driver and executors pick the wrong logging configuration

[jira] [Reopened] (SPARK-25065) Driver and executors pick the wrong logging configuration file.

2019-10-13 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reopened SPARK-25065: - > Driver and executors pick the wrong logging configuration file. >

[jira] [Updated] (SPARK-25065) Driver and executors pick the wrong logging configuration file.

2019-10-13 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25065: Affects Version/s: (was: 2.3.1) 3.0.0

[jira] [Commented] (SPARK-22865) Publish Official Apache Spark Docker images

2019-09-17 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931464#comment-16931464 ] Prashant Sharma commented on SPARK-22865: - Hi, what is the update on this issue? Do we have

[jira] [Commented] (SPARK-22842) Support consuming oauth token and certs through environment variables

2019-09-17 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931462#comment-16931462 ] Prashant Sharma commented on SPARK-22842: - Fabric8 client supports exporting Env vars for

[jira] [Updated] (SPARK-21869) A cached Kafka producer should not be closed if any task is using it.

2019-09-09 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-21869: Affects Version/s: (was: 2.2.0) 3.0.0

[jira] [Commented] (SPARK-28367) Kafka connector infinite wait because metadata never updated

2019-09-05 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923132#comment-16923132 ] Prashant Sharma commented on SPARK-28367: - Hi, can you please provide the link to the kafka

[jira] [Resolved] (SPARK-27664) Performance issue with FileStatusCache, while reading from object stores.

2019-06-12 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-27664. - Resolution: Won't Fix I am marking it as won't fix, because, this is now difficult to

[jira] [Updated] (SPARK-27664) Performance issue with FileStatusCache, while reading from object stores.

2019-05-10 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-27664: Description: In short, This issue(i.e. degraded performance ) surfaces when the number

[jira] [Updated] (SPARK-27664) Performance issue with FileStatusCache, while reading from object stores.

2019-05-10 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-27664: Description: In short, This issue(i.e. degraded performance ) surfaces when the number

[jira] [Updated] (SPARK-27664) Performance issue with FileStatusCache, while reading from object stores.

2019-05-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-27664: Description: In short, This issue(i.e. degraded performance ) surfaces when the number

  1   2   3   4   >