[
https://issues.apache.org/jira/browse/FLINK-38479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024999#comment-18024999
]
fallenup commented on FLINK-38479:
----------------------------------
{code:java}
apiVersion: flink.apache.org/v1beta1
kind: FlinkSessionJob
metadata:
name: 005-clickhouse-research-orders-reals
namespace: data-processing
spec:
deploymentName: data-flink-cluster
job:
allowNonRestoredState: false
args:
- '--clickhouse.flush.interval'
- 30s
- '--clickhouse.max.rows'
- '100000'
- '--clickhouse.password'
- xxx
- '--clickhouse.table'
- yyy
- '--clickhouse.url'
- >-
jdbc:clickhouse://ch.test.env:8123?connection_timeout=600000&timeToLiveMillis=600000&socket_timeout=610000&dataTransferTimeout=600000
- '--clickhouse.user'
- aaa
- '--config.providers'
- directory
- '--config.providers.directory.class'
- org.apache.kafka.common.config.provider.DirectoryConfigProvider
- '--execution.checkpointing.incremental'
- 'true'
- '--execution.checkpointing.interval'
- '900000'
- '--execution.checkpointing.timeout'
- '3600000'
- '--execution.checkpointing.tolerable-failed-checkpoints'
- '5'
- '--jar-uri'
- >-
http://bbb.jar
- '--job-catalog-path'
- /data/data-flink-cluster-catalog/
- '--job-name'
- 005-clickhouse-research-orders-reals
- '--job-script'
- >-
xxx;
- '--job.name.underscored'
- 005_clickhouse_research_orders_reals
- '--kafka.bootstrap.servers'
- >-
kafka-01.test.env:9092,kafka-02.test.env:9092,kafka-03.test.env:9092
- '--kafka.group.id'
- ddd
- '--kafka.ssl.keystore.location'
- /data/user.p12
- '--kafka.ssl.keystore.password'
- fff
- '--kafka.ssl.truststore.location'
- /data/ca.p12
- '--kafka.ssl.truststore.password'
- eee
- '--kafka.topics'
- >-
events.reals
- '--pipeline.jars.external'
- s3a://flink/libs/protobuf.jar
- '--schema.registry.url'
- https://schema-registry.test.env
- '--state.backend.rocksdb.checkpoint.transfer.thread.num'
- '8'
- '--state.backend.rocksdb.predefined-options'
- FLASH_SSD_OPTIMIZED
- '--state.backend.type'
- rocksdb
entryClass: com.sdp.flink.runner.sql.SqlRunner
jarURI: >-
http://bbb.jar
parallelism: 35
state: running
upgradeMode: stateless
restartNonce: 0{code}
> Problems after upgrading the operator from 1.12.1 to 1.13.0
> -----------------------------------------------------------
>
> Key: FLINK-38479
> URL: https://issues.apache.org/jira/browse/FLINK-38479
> Project: Flink
> Issue Type: Bug
> Components: Kubernetes Operator
> Affects Versions: 1.13.0
> Reporter: fallenup
> Priority: Major
>
> FlinkSessionJobs
> 1)
> {code:java}
> 2025-09-30 09:10:45,230 i.j.o.p.e.EventProcessor [WARN ]
> ][data-processing/005-clickhouse-research-orders-reals] Uncaught error during
> event processing ExecutionScope{ resource id:
> ResourceID{name='005-clickhouse-research-orders-reals',
> namespace='data-processing'}, version: 1347467883} - but another
> reconciliation will be attempted because a superseding event has been
> received or another retry attempt is pending.
> org.apache.flink.kubernetes.operator.exception.ReconciliationException:
> java.lang.NullPointerException: Cannot invoke
> "org.apache.flink.kubernetes.operator.api.spec.ConfigObjectNode.asFlatMap()"
> because "leftField" is null at
> org.apache.flink.kubernetes.operator.controller.FlinkSessionJobController.reconcile(FlinkSessionJobController.java:120)
> at
> org.apache.flink.kubernetes.operator.controller.FlinkSessionJobController.reconcile(FlinkSessionJobController.java:56)
> at
> io.javaoperatorsdk.operator.processing.Controller$1.execute(Controller.java:161)
> at
> io.javaoperatorsdk.operator.processing.Controller$1.execute(Controller.java:117)
> at
> org.apache.flink.kubernetes.operator.metrics.OperatorJosdkMetrics.timeControllerExecution(OperatorJosdkMetrics.java:81)
> at
> io.javaoperatorsdk.operator.processing.Controller.reconcile(Controller.java:116)
> at
> io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.reconcileExecution(ReconciliationDispatcher.java:153)
> at
> io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.handleReconcile(ReconciliationDispatcher.java:130)
> at
> io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.handleDispatch(ReconciliationDispatcher.java:97)
> at
> io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.handleExecution(ReconciliationDispatcher.java:68)
> at
> io.javaoperatorsdk.operator.processing.event.EventProcessor$ReconcilerExecutor.run(EventProcessor.java:475)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
> Source) at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> at java.base/java.lang.Thread.run(Unknown Source) Caused by:
> java.lang.NullPointerException: Cannot invoke
> "org.apache.flink.kubernetes.operator.api.spec.ConfigObjectNode.asFlatMap()"
> because "leftField" is null at
> org.apache.flink.kubernetes.operator.reconciler.diff.ReflectiveDiffBuilder.appendFields(ReflectiveDiffBuilder.java:89)
> at
> org.apache.flink.kubernetes.operator.reconciler.diff.ReflectiveDiffBuilder.build(ReflectiveDiffBuilder.java:78)
> at
> org.apache.flink.kubernetes.operator.reconciler.deployment.AbstractFlinkResourceReconciler.reconcile(AbstractFlinkResourceReconciler.java:138)
> at
> org.apache.flink.kubernetes.operator.controller.FlinkSessionJobController.reconcile(FlinkSessionJobController.java:117)
> ... 13 more{code}
> 2)
> {code:java}
> 2025-09-30 09:35:30,140 i.j.o.p.e.EventProcessor [WARN
> ][data-processing/pyflink-to-outbox] Uncaught error during event processing
> ExecutionScope{ resource id: ResourceID{name='pyflink-to-outbox',
> namespace='data-processing'}, version: 1347486671} - but another
> reconciliation will be attempted because a superseding event has been
> received or another retry attempt is pending.
> org.apache.flink.kubernetes.operator.exception.ReconciliationException:
> java.lang.NullPointerException at
> org.apache.flink.kubernetes.operator.controller.FlinkSessionJobController.reconcile(FlinkSessionJobController.java:120)
> at
> org.apache.flink.kubernetes.operator.controller.FlinkSessionJobController.reconcile(FlinkSessionJobController.java:56)
> at
> io.javaoperatorsdk.operator.processing.Controller$1.execute(Controller.java:161)
> at
> io.javaoperatorsdk.operator.processing.Controller$1.execute(Controller.java:117)
> at
> org.apache.flink.kubernetes.operator.metrics.OperatorJosdkMetrics.timeControllerExecution(OperatorJosdkMetrics.java:81)
> at
> io.javaoperatorsdk.operator.processing.Controller.reconcile(Controller.java:116)
> at
> io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.reconcileExecution(ReconciliationDispatcher.java:153)
> at
> io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.handleReconcile(ReconciliationDispatcher.java:130)
> at
> io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.handleDispatch(ReconciliationDispatcher.java:97)
> at
> io.javaoperatorsdk.operator.processing.event.ReconciliationDispatcher.handleExecution(ReconciliationDispatcher.java:68)
> at
> io.javaoperatorsdk.operator.processing.event.EventProcessor$ReconcilerExecutor.run(EventProcessor.java:475){code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
