yxfff opened a new issue, #7810:
URL: https://github.com/apache/seatunnel/issues/7810

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   when I use zeta engine to sync mysql to apache paimon ,it appears 
java.lang.UnsatisfiedLinkError: 
org.xerial.snappy.SnappyNative.maxCompressedLength(I)I error 。my paimon version 
is 0.9
   
   ### SeaTunnel Version
   
   2.3.7
   
   ### SeaTunnel Config
   
   ```conf
   env {
     parallelism = 1
     job.mode = "BATCH"
   }
   source {
     Jdbc {
           url = "jdbc:mysql://xxx:3306/test"
           driver = "com.mysql.cj.jdbc.Driver"
           connection_check_timeout_sec = 100
           user = "root"
           password = "xxx"
           query = "select name,age from test.paimon_test"
           partition_column = "name"
           split.size = 10000
       }
   }
   
   sink {
     Paimon {
       catalog_name="paimon_test"
       warehouse="hdfs://xxx:8020/warehouse/tablespace/external/hive/"
       database="yxf"
       table="paimon_test3"
       paimon.table.write-props = {
         #bucket = 4
         #bucket-key="create_time"
         snapshot.num-retained.min = 3
         snapshot.num-retained.max = 10
         file.format = "orc"
         deletion-vectors.enabled = "true"
       }
     }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   ./bin/seatunnel.sh -c ./config/paimon/mysql2paimon.conf
   ```
   
   
   ### Error Exception
   
   ```log
   Caused by: java.lang.RuntimeException: Exception occurs when preparing 
snapshot #1 (path 
hdfs://xxx:8020/warehouse/tablespace/external/hive/yxf.db/paimon_test3/snapshot/snapshot-1)
 by user 11dde3ef-bee7-4766-acff-89a9c8b7b3c0 with hash 9223372036854775807 and 
kind APPEND. Clean up.
           at 
org.apache.paimon.operation.FileStoreCommitImpl.tryCommitOnce(FileStoreCommitImpl.java:829)
           at 
org.apache.paimon.operation.FileStoreCommitImpl.tryCommit(FileStoreCommitImpl.java:605)
           at 
org.apache.paimon.operation.FileStoreCommitImpl.commit(FileStoreCommitImpl.java:248)
           at 
org.apache.paimon.table.sink.TableCommitImpl.commitMultiple(TableCommitImpl.java:192)
           at 
org.apache.paimon.table.sink.TableCommitImpl.commit(TableCommitImpl.java:186)
           at 
org.apache.paimon.table.sink.TableCommitImpl.commit(TableCommitImpl.java:165)
           at 
org.apache.paimon.table.sink.TableCommitImpl.commit(TableCommitImpl.java:160)
           at 
org.apache.seatunnel.connectors.seatunnel.paimon.sink.PaimonSinkWriter.<init>(PaimonSinkWriter.java:125)
           ... 20 more
   Caused by: java.lang.UnsatisfiedLinkError: 
org.xerial.snappy.SnappyNative.maxCompressedLength(I)I
           at org.xerial.snappy.SnappyNative.maxCompressedLength(Native Method)
           at org.xerial.snappy.Snappy.maxCompressedLength(Snappy.java:320)
           at 
org.apache.paimon.shade.org.apache.avro.file.SnappyCodec.compress(SnappyCodec.java:55)
           at 
org.apache.paimon.shade.org.apache.avro.file.DataFileStream$DataBlock.compressUsing(DataFileStream.java:398)
           at 
org.apache.paimon.shade.org.apache.avro.file.DataFileWriter.writeBlock(DataFileWriter.java:407)
           at 
org.apache.paimon.shade.org.apache.avro.file.DataFileWriter.sync(DataFileWriter.java:428)
           at 
org.apache.paimon.shade.org.apache.avro.file.DataFileWriter.flush(DataFileWriter.java:437)
           at 
org.apache.paimon.format.avro.AvroBulkWriter.flush(AvroBulkWriter.java:45)
           at 
org.apache.paimon.format.avro.AvroFileFormat$RowAvroWriterFactory$1.flush(AvroFileFormat.java:126)
           at 
org.apache.paimon.io.SingleFileWriter.close(SingleFileWriter.java:144)
           at 
org.apache.paimon.io.RollingFileWriter.closeCurrentWriter(RollingFileWriter.java:108)
           at 
org.apache.paimon.io.RollingFileWriter.close(RollingFileWriter.java:145)
           at 
org.apache.paimon.manifest.ManifestFile.write(ManifestFile.java:94)
           at 
org.apache.paimon.operation.FileStoreCommitImpl.tryCommitOnce(FileStoreCommitImpl.java:766)
           ... 27 more
   
           ... 11 more
   
           at 
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:203)
           ... 2 more
   ```
   
   
   ### Zeta or Flink or Spark Version
   
   zeta
   
   ### Java or Scala Version
   
   java 1.8.0_351
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to