[jira] [Created] (SPARK-46601) Fix log error in handleStatusMessage

2024-01-04 Thread qingbo jiao (Jira)
qingbo jiao created SPARK-46601:
---

 Summary: Fix log error in handleStatusMessage
 Key: SPARK-46601
 URL: https://issues.apache.org/jira/browse/SPARK-46601
 Project: Spark
  Issue Type: Improvement
  Components: Spark Core
Affects Versions: 3.5.0
Reporter: qingbo jiao






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44381) How to specify parameters in spark-sumbit to make HiveDelegationTokenProvider refresh token regularly

2023-07-11 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-44381:

Description: 
export KRB5CCNAME=FILE:/tmp/krb5cc_1001
./bin/spark-submit -{-}master yarn --deploy-mode client --proxy-user  
--conf spark.app.name=spark-hive-test --conf 
spark.security.credentials.renewalRatio=0.58 --conf 
spark.kerberos.renewal.credentials=ccache{-}  -class 
org.apache.spark.examples.sql.hive.SparkHiveExample 
/examples/jars/spark-examples_2.12-3.1.1.jar

spark version 3.1.1,I configured it to refresh every 5 seconds。

--deploy-mode client/cluster wtih/without --proxy-user have all been tried, but 
none of them will work

Missing any configuration parameters?

  was:
export KRB5CCNAME=FILE:/tmp/krb5cc_1001
./bin/spark-submit --master yarn --deploy-mode client --proxy-user ocdp --conf 
spark.app.name=spark-hive-test --conf 
spark.security.credentials.renewalRatio=0.58 --conf 
spark.kerberos.renewal.credentials=ccache  --class 
org.apache.spark.examples.sql.hive.SparkHiveExample 
/examples/jars/spark-examples_2.12-3.1.1.jar

spark version 3.1.1,I configured it to refresh every 5 seconds。

--deploy-mode client/cluster wtih/without --proxy-user have all been tried, but 
none of them will work

Missing any configuration parameters?


> How to specify parameters in spark-sumbit to make HiveDelegationTokenProvider 
> refresh token regularly
> -
>
> Key: SPARK-44381
> URL: https://issues.apache.org/jira/browse/SPARK-44381
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.1.1
>Reporter: qingbo jiao
>Priority: Minor
>
> export KRB5CCNAME=FILE:/tmp/krb5cc_1001
> ./bin/spark-submit -{-}master yarn --deploy-mode client --proxy-user  
> --conf spark.app.name=spark-hive-test --conf 
> spark.security.credentials.renewalRatio=0.58 --conf 
> spark.kerberos.renewal.credentials=ccache{-}  -class 
> org.apache.spark.examples.sql.hive.SparkHiveExample 
> /examples/jars/spark-examples_2.12-3.1.1.jar
> spark version 3.1.1,I configured it to refresh every 5 seconds。
> --deploy-mode client/cluster wtih/without --proxy-user have all been tried, 
> but none of them will work
> Missing any configuration parameters?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-44381) How to specify parameters in spark-sumbit to make HiveDelegationTokenProvider refresh token regularly

2023-07-11 Thread qingbo jiao (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-44381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742293#comment-17742293
 ] 

qingbo jiao commented on SPARK-44381:
-

[~jshao] please cc ,thanks

> How to specify parameters in spark-sumbit to make HiveDelegationTokenProvider 
> refresh token regularly
> -
>
> Key: SPARK-44381
> URL: https://issues.apache.org/jira/browse/SPARK-44381
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.1.1
>Reporter: qingbo jiao
>Priority: Minor
>
> export KRB5CCNAME=FILE:/tmp/krb5cc_1001
> ./bin/spark-submit --master yarn --deploy-mode client --proxy-user ocdp 
> --conf spark.app.name=spark-hive-test --conf 
> spark.security.credentials.renewalRatio=0.58 --conf 
> spark.kerberos.renewal.credentials=ccache  --class 
> org.apache.spark.examples.sql.hive.SparkHiveExample 
> /examples/jars/spark-examples_2.12-3.1.1.jar
> spark version 3.1.1,I configured it to refresh every 5 seconds。
> --deploy-mode client/cluster wtih/without --proxy-user have all been tried, 
> but none of them will work
> Missing any configuration parameters?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Created] (SPARK-44381) How to specify parameters in spark-sumbit to make HiveDelegationTokenProvider refresh token regularly

2023-07-11 Thread qingbo jiao (Jira)
qingbo jiao created SPARK-44381:
---

 Summary: How to specify parameters in spark-sumbit to make 
HiveDelegationTokenProvider refresh token regularly
 Key: SPARK-44381
 URL: https://issues.apache.org/jira/browse/SPARK-44381
 Project: Spark
  Issue Type: Improvement
  Components: SQL
Affects Versions: 3.1.1
Reporter: qingbo jiao


export KRB5CCNAME=FILE:/tmp/krb5cc_1001
./bin/spark-submit --master yarn --deploy-mode client --proxy-user ocdp --conf 
spark.app.name=spark-hive-test --conf 
spark.security.credentials.renewalRatio=0.58 --conf 
spark.kerberos.renewal.credentials=ccache  --class 
org.apache.spark.examples.sql.hive.SparkHiveExample 
/examples/jars/spark-examples_2.12-3.1.1.jar

spark version 3.1.1,I configured it to refresh every 5 seconds。

--deploy-mode client/cluster wtih/without --proxy-user have all been tried, but 
none of them will work

Missing any configuration parameters?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44203) The obtainDelegationTokens method of HiveDelegationTokenProvider should return nextRenewalDate instead of None

2023-06-26 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-44203:

Affects Version/s: 3.4.1
   (was: 3.5.0)

> The obtainDelegationTokens method of HiveDelegationTokenProvider should 
> return nextRenewalDate instead of None
> --
>
> Key: SPARK-44203
> URL: https://issues.apache.org/jira/browse/SPARK-44203
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.4.1
>Reporter: qingbo jiao
>Priority: Minor
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Created] (SPARK-44203) The obtainDelegationTokens method of HiveDelegationTokenProvider should return nextRenewalDate instead of None

2023-06-26 Thread qingbo jiao (Jira)
qingbo jiao created SPARK-44203:
---

 Summary: The obtainDelegationTokens method of 
HiveDelegationTokenProvider should return nextRenewalDate instead of None
 Key: SPARK-44203
 URL: https://issues.apache.org/jira/browse/SPARK-44203
 Project: Spark
  Issue Type: Improvement
  Components: SQL
Affects Versions: 3.5.0
Reporter: qingbo jiao






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-22 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Affects Version/s: (was: 3.1.2)

> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Attachments: error_message.png
>
>
> {code:java}
> NOTE: you need to replace  and  with actual value
> the JHS_POST should be JHS_HOST
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-22 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Target Version/s:   (was: 3.1.2, 3.2.0)

> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.1.2, 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Attachments: error_message.png
>
>
> {code:java}
> NOTE: you need to replace  and  with actual value
> the JHS_POST should be JHS_HOST
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-22 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Fix Version/s: (was: 3.1.2)
   (was: 3.2.0)

> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.1.2, 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Attachments: error_message.png
>
>
> {code:java}
> NOTE: you need to replace  and  with actual value
> the JHS_POST should be JHS_HOST
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Target Version/s: 3.1.2, 3.2.0  (was: 3.1.2)

> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.1.2, 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Fix For: 3.1.2, 3.2.0
>
> Attachments: error_message.png
>
>
> {code:java}
> NOTE: you need to replace  and  with actual value
> the JHS_POST should be JHS_HOST
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Description: 
{code:java}
NOTE: you need to replace  and  with actual value

the JHS_POST should be JHS_HOST

{code}

  was:
{code:java}
NOTE: you need to replace  and  with actual value

the JHS_POST should be JHS_HOST



{code}


> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.1.2, 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Fix For: 3.1.2
>
> Attachments: error_message.png
>
>
> {code:java}
> NOTE: you need to replace  and  with actual value
> the JHS_POST should be JHS_HOST
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Fix Version/s: 3.2.0

> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.1.2, 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Fix For: 3.1.2, 3.2.0
>
> Attachments: error_message.png
>
>
> {code:java}
> NOTE: you need to replace  and  with actual value
> the JHS_POST should be JHS_HOST
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Description: 
{code:java}
NOTE: you need to replace  and  with actual value

the JHS_POST should be JHS_HOST



{code}

  was:
{code:java}
// code placeholder

NOTE: you need to replace  and  with actual value

the JHS_POST should be JHS_HOST



{code}


> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.1.2, 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Fix For: 3.1.2
>
> Attachments: error_message.png
>
>
> {code:java}
> NOTE: you need to replace  and  with actual value
> the JHS_POST should be JHS_HOST
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Description: 
{code:java}
// code placeholder

NOTE: you need to replace  and  with actual value

the JHS_POST should be JHS_HOST



{code}

> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.1.2, 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Fix For: 3.1.2
>
> Attachments: error_message.png
>
>
> {code:java}
> // code placeholder
> NOTE: you need to replace  and  with actual value
> the JHS_POST should be JHS_HOST
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Attachment: error_message.png

> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.1.2, 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Fix For: 3.1.2
>
> Attachments: error_message.png
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Attachment: 微信截图_20210917181324.png

> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.1.2, 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Fix For: 3.1.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

qingbo jiao updated SPARK-36791:

Attachment: (was: 微信截图_20210917181324.png)

> this is a spelling mistakes in running-on-yarn.md file where  JHS_POST should 
> be JHS_HOST
> -
>
> Key: SPARK-36791
> URL: https://issues.apache.org/jira/browse/SPARK-36791
> Project: Spark
>  Issue Type: Documentation
>  Components: Documentation
>Affects Versions: 3.1.2, 3.2.0
>Reporter: qingbo jiao
>Priority: Minor
> Fix For: 3.1.2
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Created] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)
qingbo jiao created SPARK-36791:
---

 Summary: this is a spelling mistakes in running-on-yarn.md file 
where  JHS_POST should be JHS_HOST
 Key: SPARK-36791
 URL: https://issues.apache.org/jira/browse/SPARK-36791
 Project: Spark
  Issue Type: Documentation
  Components: Documentation
Affects Versions: 3.1.2, 3.2.0
Reporter: qingbo jiao
 Fix For: 3.1.2






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org