sangkyoonnam opened a new pull request, #1282:
URL: https://github.com/apache/flink-agents/pull/1282

   
   Linked issue: #1281
   
   ### Purpose of change
   
   Python agent jobs submitted one after another to the same TaskManager can 
fail when Setup's manual PyFlink installation leaves the distribution JAR out 
of `$FLINK_HOME/lib`. #1281 has the reproduction and the class-loading analysis.
   
   This documents `classloader.parent-first-patterns.additional: pemja.` as a 
Setup step, "Configure Class Loading for PyFlink Jobs", and links to it from 
the Quickstart overview next to the JDK 21 note. pemja then comes from the 
flink-python JAR already in `lib`, and the flink-agents JARs stay in 
`pipeline.jars`, which keeps the dependency isolation #818 set up. The quick 
install puts the distribution JAR in `lib` and doesn't need the step.
   
   ### Tests
   
   The docs build with Hugo 0.110.0, and the new anchor and the Quickstart link 
to it resolve. On a Flink 2.3.0 session cluster with the YAML from the new 
section, three consecutive Python agent jobs produced output on Linux aarch64 
with pemja 0.5.7 and on macOS arm64 with pemja 0.6.3 swapped in. On macOS with 
pemja 0.5.7, four consecutive jobs all started. Without it, the second and 
third failed on Linux with pemja 0.5.7 and on macOS with pemja 0.6.3, and later 
submissions failed on macOS with pemja 0.5.7 as well.
   
   ### API
   
   No.
   
   ### Documentation
   
   - [ ] `doc-needed`
   - [ ] `doc-not-needed`
   - [x] `doc-included`
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   - [x] Yes
   - [ ] No
   
   Generated-by: Claude Code 2.1.303 (Claude Opus 5.5)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to