Biao Geng created FLINK-39572:
---------------------------------
Summary: Hide sensitive information when pyflink's beam runner is
closed
Key: FLINK-39572
URL: https://issues.apache.org/jira/browse/FLINK-39572
Project: Flink
Issue Type: Improvement
Reporter: Biao Geng
Currently when pyflink finishes a job execution,
DefaultJobBundleFactory will be closed, which will unref underlying
WrappedSdkHarnessClient.
Given the current implementation, environment.getEnvironment() would be
logged, we may need to use helper method like
ConfigurationUtils.hideSensitiveValues to hide the sensitive information
:
{code:java}
private int unref() {
int refCount = bundleRefCount.decrementAndGet();
Preconditions.checkState(refCount >= 0, "Reference count must not be
negative.");
if (refCount == 0) {
// Close environment after it was removed from cache and all bundles
finished.
LOG.info("Closing environment {}", environment.getEnvironment());
close();
}
return refCount;
} {code}
2026-04-28 20:44:34,591 INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory [] -
Closing environment urn: "beam:env:process:v1"
payload:
"\032`/root/multi-modal-benchmark/.venv/lib/python3.11/site-packages/pyflink/bin/pyflink-udf-runner.sh\"\367\001\n\004PATH\022\356\001/usr/lib/jvm/java-11-openj
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
