Quilian opened a new issue, #8772:
URL: https://github.com/apache/seatunnel/issues/8772

   ### Search before asking
   
   - [x] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   Oracle-cdc任务运行一个月发生报错,报错:Caused by: java.sql.SQLException: ORA-00310: 
archived log contains sequence 14319; sequence 14316 requiredORA-00334: 
archived log: '/OSdata/oradata_ncdb/SJZTNCDB/redo03.log'。但是检查数据库保存点是连续正常的:
   -rw-r----- 1 oracle oinstall 202161688 Feb 19 10:23 o1_mf_14313_mvbht21b_.arc
   -rw-r----- 1 oracle oinstall 109754880 Feb 19 10:23 o1_mf_14314_mvb5wy6_.arc
   -rw-r----- 1 oracle oinstall  53207744 Feb 19 10:23 o1_mf_14315_mvb57yh_.arc
   -rw-r----- 1 oracle oinstall 196684888 Feb 19 10:24 o1_mf_14316_mvb6r7x_.arc
   -rw-r----- 1 oracle oinstall 195910144 Feb 19 10:24 o1_mf_14317_mvb6j6t_.arc
   -rw-r----- 1 oracle oinstall 195910144 Feb 19 10:24 o1_mf_14318_mvb6jtw_.arc
   -rw-r----- 1 oracle oinstall 195910144 Feb 19 10:24 o1_mf_14319_mvb6vxm_.arc
   -rw-r----- 1 oracle oinstall 196322528 Feb 19 10:24 o1_mf_14320_mvb6y1h_.arc
   -rw-r----- 1 oracle oinstall 198780288 Feb 19 10:24 o1_mf_14322_mvb74vy_.arc
   -rw-r----- 1 oracle oinstall 201594728 Feb 19 10:25 o1_mf_14324_mvb8y0t_.arc
   -rw-r----- 1 oracle oinstall  93376824 Feb 19 10:35 o1_mf_14327_mvbvsyf_.arc
   
   ### SeaTunnel Version
   
   2.3.9
   
   ### SeaTunnel Config
   
   ```conf
   env{
     execution.parallelism = 1
     job.mode = "STREAMING"
     checkpoint.interval =1000
   }
   source {
     Oracle-CDC {
         username = "xx"
         password = "xxx"
         database-names = ["db1"]
         schema-names = ["sc1"]
         table-names = ["db1.sc1.table1"]
         connect.timeout.ms = 60000
         connect.max-retries = 5
         base-url = "jdbc:oracle:thin:@xx.xxx.xxx.xx:xxxx:db1"
       }
   }
   sink {
     Doris {
         fenodes = "xx.xxx.xx.xxx:xxxx"
         username = xxx
         password = "xxxxx"
         database = "xxx"
         #table = "xxxx"
         sink.enable-2pc = "false"
         sink.label-prefix = "xxx_111"
         sink.enable-delete = "true"
         doris.config = {
               format="json"
               read_json_by_line="true"
           }
       }
   }
   ```
   
   ### Running Command
   
   ```shell
   bin/seatunnel.sh -c cdc.template --async
   ```
   
   ### Error Exception
   
   ```log
   2025-02-19 10:29:10,909 ERROR [o.a.s.e.s.d.p.PhysicalVertex  ] 
[hz.main.generic-operation.thread-5] - Job db_oracle_cdc (933615545725485057), 
Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Oracle-CDC]-SourceTask (1/1)] 
end with state FAILED and Exception: java.lang.RuntimeException: One or more 
fetchers have encountered exception
           at 
org.apache.seatunnel.connectors.seatunnel.common.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:147)
           at 
org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:167)
           at 
org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:93)
           at 
org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.pollNext(IncrementalSourceReader.java:119)
           at 
org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:159)
           at 
org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:127)
           at 
org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:169)
           at 
org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:132)
           at 
org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:694)
           at 
org.apache.seatunnel.engine.server.TaskExecutionService$NamedTaskWrapper.run(TaskExecutionService.java:1019)
           at 
org.apache.seatunnel.api.tracing.MDCRunnable.run(MDCRunnable.java:43)
           at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
           at java.util.concurrent.FutureTask.run(FutureTask.java:266)
           at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
           at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
           at java.lang.Thread.run(Thread.java:750)
   Caused by: java.lang.RuntimeException: SplitFetcher thread 0 received 
unexpected exception while polling the records
           at 
org.apache.seatunnel.connectors.seatunnel.common.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
           at 
org.apache.seatunnel.connectors.seatunnel.common.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:81)
           ... 5 more
   Caused by: org.apache.kafka.connect.errors.ConnectException: An exception 
occurred in the change event producer. This connector will be stopped.
           at 
io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:50)
           at 
io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:264)
           at 
org.apache.seatunnel.connectors.seatunnel.cdc.oracle.source.reader.fetch.logminer.OracleRedoLogFetchTask$RedoLogSplitReadTask.execute(OracleRedoLogFetchTask.java:147)
           at 
org.apache.seatunnel.connectors.seatunnel.cdc.oracle.source.reader.fetch.logminer.OracleRedoLogFetchTask.execute(OracleRedoLogFetchTask.java:73)
           at 
org.apache.seatunnel.connectors.cdc.base.source.reader.external.IncrementalSourceStreamFetcher.lambda$submitTask$0(IncrementalSourceStreamFetcher.java:107)
           ... 5 more
   Caused by: java.sql.SQLException: ORA-00310: archived log contains sequence 
14319; sequence 14316 required
   ORA-00334: archived log: '/OSdata/oradata_ncdb/SJZTNCDB/redo03.log'
   
           at oracle.jdbc.driver.T4CTTIoer11.processError(T4CTTIoer11.java:494)
           at oracle.jdbc.driver.T4CTTIoer11.processError(T4CTTIoer11.java:446)
           at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:1054)
           at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:623)
           at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:252)
           at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:612)
           at 
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:226)
           at 
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:59)
           at 
oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:747)
           at 
oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:904)
           at 
oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1082)
           at 
oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3780)
           at 
oracle.jdbc.driver.T4CPreparedStatement.executeInternal(T4CPreparedStatement.java:1343)
           at 
oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3822)
           at 
oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1165)
           at 
io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.process(AbstractLogMinerEventProcessor.java:185)
           at 
io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:252)
           ... 8 more
   Caused by: Error : 310, Position : 0, Sql = SELECT SCN, SQL_REDO, 
OPERATION_CODE, TIMESTAMP, XID, CSF, TABLE_NAME, SEG_OWNER, OPERATION, 
USERNAME, ROW_ID, ROLLBACK, RS_ID, STATUS, INFO, SSN, THREAD# FROM 
V$LOGMNR_CONTENTS WHERE SCN > :1  AND SCN <= :2  AND (SEG_OWNER IS NULL OR 
SEG_OWNER NOT IN 
('APPQOSSYS','AUDSYS','CTXSYS','DVSYS','DBSFWUSER','DBSNMP','GSMADMIN_INTERNAL','LBACSYS','MDSYS','OJVMSYS','OLAPSYS','ORDDATA','ORDSYS','OUTLN','SYS','SYSTEM','WMSYS','XDB'))
 AND ((OPERATION_CODE IN (6,7,34,36) OR (OPERATION_CODE = 5 AND USERNAME NOT IN 
('SYS','SYSTEM') AND INFO NOT LIKE 'INTERNAL DDL%' AND (TABLE_NAME IS NULL OR 
TABLE_NAME NOT LIKE 'ORA_TEMP_%')) ) OR (OPERATION_CODE IN (1,2,3,255) AND 
TABLE_NAME != 'LOG_MINING_FLUSH' AND (REGEXP_LIKE(SEG_OWNER,'^DBO_AODB$','i')) 
AND (REGEXP_LIKE(SEG_OWNER || '.' || TABLE_NAME,'^DBO_AODB.PLANFLIGHT$','i')) 
)), OriginalSql = SELECT SCN, SQL_REDO, OPERATION_CODE, TIMESTAMP, XID, CSF, 
TABLE_NAME, SEG_OWNER, OPERATION, USERNAME, ROW_ID, ROLLB
 ACK, RS_ID, STATUS, INFO, SSN, THREAD# FROM V$LOGMNR_CONTENTS WHERE SCN > ? 
AND SCN <= ? AND (SEG_OWNER IS NULL OR SEG_OWNER NOT IN 
('APPQOSSYS','AUDSYS','CTXSYS','DVSYS','DBSFWUSER','DBSNMP','GSMADMIN_INTERNAL','LBACSYS','MDSYS','OJVMSYS','OLAPSYS','ORDDATA','ORDSYS','OUTLN','SYS','SYSTEM','WMSYS','XDB'))
 AND ((OPERATION_CODE IN (6,7,34,36) OR (OPERATION_CODE = 5 AND USERNAME NOT IN 
('SYS','SYSTEM') AND INFO NOT LIKE 'INTERNAL DDL%' AND (TABLE_NAME IS NULL OR 
TABLE_NAME NOT LIKE 'ORA_TEMP_%')) ) OR (OPERATION_CODE IN (1,2,3,255) AND 
TABLE_NAME != 'LOG_MINING_FLUSH' AND (REGEXP_LIKE(SEG_OWNER,'^DBO_AODB$','i')) 
AND (REGEXP_LIKE(SEG_OWNER || '.' || TABLE_NAME,'^DBO_AODB.PLANFLIGHT$','i')) 
)), Error Msg = ORA-00310: archived log contains sequence 14319; sequence 14316 
required
   ORA-00334: archived log: '/OSdata/oradata_ncdb/SJZTNCDB/redo03.log'
   
           at oracle.jdbc.driver.T4CTTIoer11.processError(T4CTTIoer11.java:498)
           ... 24 more
   ```
   
   ### Zeta or Flink or Spark Version
   
   zeta
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [x] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to