Abacn commented on PR #34394: URL: https://github.com/apache/beam/pull/34394#issuecomment-2749017454
> there are two cases where the database is accessed during expansion time: > > 2. Get partition bounds This is because Get partition bounds is done by a JdbcIO.read transform (pointed above, JdbcIO.java#L1513), as a result, it tries to infer a schema. But this is not needed if we already know it would be a long. I mean we can set schema to FieldType.Long here, if we know it's going to be long, then Get partition bounds and JdbcIO.readFromPartition won't require database connection at pipeline submission time -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
