nikenfls opened a new issue #4461: URL: https://github.com/apache/hudi/issues/4461
**_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? Yes, I searched the keyword "Invalid range value". - Join the mailing list to engage in conversations and get faster support at dev-subscr...@hudi.apache.org. - If you have triaged this as a bug, then file an [issue](https://issues.apache.org/jira/projects/HUDI/issues) directly. **Describe the problem you faced** 1. I am using hudi 0.10.0 with spark 2.4.8 to write data into Aliyun oss. At first, I set **"hoodie.metadata.enable"="false"**. And everything worked fine except it was lower than using HDFS on ecs. Later, I set **"hoodie.metadata.enable"="true")** And I got the warning : 1508921 [qtp658329022-2551] WARN com.aliyun.oss - Invalid range value [6987, 6986], ignore it and just get entire object 1509026 [qtp658329022-2551] WARN com.aliyun.oss - Invalid range value [6986, 6985], ignore it and just get entire object 1509106 [qtp658329022-2551] WARN com.aliyun.oss - Invalid range value [7039, 7038], ignore it and just get entire object 1509197 [qtp658329022-2551] WARN com.aliyun.oss - Invalid range value [6992, 6991], ignore it and just get entire object I just wonder what's going on and is it a bug? array[0] should be larger than array[1],right? ( I read the code in sdk which could be the reason: https://github.com/aliyun/aliyun-oss-java-sdk/blob/master/src/main/java/com/aliyun/oss/common/utils/RangeSpec.java. ) Does metadata table actually improve the list objects performance? 2. while writing this post, I also got the error, is this the right place to ask what's going on? The spark application is still running for new batch even though I got the error. 2080792 [stream execution thread for [id = 08bb27a5-9674-4fb1-bdac-35f0b66e0dc7, runId = e435f540-8f10-4866-b5b7-f19373ea6629]] WARN com.aliyun.oss - [Client]Unable to execute HTTP request: The target server failed to respond [ErrorCode]: ConnectionTimeout [RequestId]: Unknown Thank you very much. XD **To Reproduce** Steps to reproduce the behavior: 1. using COW table 2. set hoodie.metadata.enable=true 3. write to Aliyun oss using Spark 4. **Expected behavior** A clear and concise description of what you expected to happen. **Environment Description** * Hudi version : 0.10.0 * Spark version : 2.4.8 * Hive version : 2.1.1-cdh6.2.0 * Hadoop version : 3.0.0-cdh6.2.0 * Storage (HDFS/S3/GCS..) : Aliyun Oss * Running on Docker? (yes/no) : No **Additional context** Add any other context about the problem here. **Stacktrace** ```Add the stacktrace of the error.``` - Invalid range value [6996, 6995], ignore it and just get entire object 2018105 [qtp383439874-3837] WARN com.aliyun.oss - Invalid range value [6997, 6996], ignore it and just get entire object 2080792 [stream execution thread for [id = 08bb27a5-9674-4fb1-bdac-35f0b66e0dc7, runId = e435f540-8f10-4866-b5b7-f19373ea6629]] WARN com.aliyun.oss - [Client]Unable to execute HTTP request: The target server failed to respond [ErrorCode]: ConnectionTimeout [RequestId]: Unknown 2082054 [stream execution thread for [id = 08bb27a5-9674-4fb1-bdac-35f0b66e0dc7, runId = e435f540-8f10-4866-b5b7-f19373ea6629]] WARN com.aliyun.oss - Invalid range value [6996, 6995], ignore it and just get entire object 2082078 [stream execution thread for [id = 08bb27a5-9674-4fb1-bdac-35f0b66e0dc7, runId = e435f540-8f10-4866-b5b7-f19373ea6629]] WARN com.aliyun.oss - Invalid range value [6997, 6996], ignore it and just get entire object 2082180 [stream execution thread for [id = 08bb27a5-9674-4fb1-bdac-35f0b66e0dc7, runId = e435f540-8f10-4866-b5b7-f19373ea6629]] WARN com.aliyun.oss - Invalid range value [6992, 6991], ignore it and just get entire object 2082948 [qtp383439874-3853] WARN com.aliyun.oss - Invalid range value [6996, 6995], ignore it and just get entire object 2082971 [qtp383439874-3853] WARN com.aliyun.oss - Invalid range value [6997, 6996], ignore it and just get entire object 2083058 [qtp383439874-3853] WARN com.aliyun.oss - Invalid range value [6992, 6991], ignore it and just get entire object -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
