Re: [I] [SUPPORT] Kafka connect sink to S3 authentification parameters [hudi]
ad1happy2go commented on issue #10428: URL: https://github.com/apache/hudi/issues/10428#issuecomment-1884422179 Great! Thanks for the information @akolyaga, will help a lot. Closing this issue then . Please reopen or create a new one in case of any issues. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Kafka connect sink to S3 authentification parameters [hudi]
codope closed issue #10428: [SUPPORT] Kafka connect sink to S3 authentification parameters URL: https://github.com/apache/hudi/issues/10428 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Kafka connect sink to S3 authentification parameters [hudi]
akolyaga commented on issue #10428: URL: https://github.com/apache/hudi/issues/10428#issuecomment-1882937441 I don't use AWS, as I mentioned I try to connect to ceph cluster. This connection configuration works for my case: "hoodie.base.path": "s3a://x", "store.url": "https://x:443;, "com.amazonaws.services.s3.enableV4": "true", "fs.s3a.impl": "org.apache.hadoop.fs.s3a.S3AFileSystem", "fs.AbstractFileSystem.s3a.impl": "org.apache.hadoop.fs.s3a.S3A", "fs.defaultFS": "s3a://xx", "fs.s3a.endpoint": "xx", "fs.s3a.access.key": "xx", "fs.s3a.secret.key": "xx", "fs.s3a.path.style.access": "true", "fs.s3a.signing-algorithm": "S3SignerType", "fs.s3a.connection.ssl.enabled": "true", "s3.bucket.name": "xxx", "aws.access.key.id": "xxx", "aws.secret.access.key": "x", -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Kafka connect sink to S3 authentification parameters [hudi]
ad1happy2go commented on issue #10428: URL: https://github.com/apache/hudi/issues/10428#issuecomment-1874091735 @akolyaga Did this suggestion worked? Do let us know. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Kafka connect sink to S3 authentification parameters [hudi]
ad1happy2go commented on issue #10428: URL: https://github.com/apache/hudi/issues/10428#issuecomment-1871834313 @akolyaga Did you tried setting env variables like below and adding hadoop-aws and aws-java-sdk bundle jar - export AWS_ACCESS_KEY_ID= export AWS_SECRET_ACCESS_KEY= export AWS_DEFAULT_REGION= -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
