[GitHub] [hudi] ROOBALJINDAL commented on issue #7064: [SUPPORT] Data ingestion from csv file i.e. CsvDFSSource is working for FilebasedSchemaProvider but not working if schema is provided with Schema

2022-11-22 Thread GitBox
ROOBALJINDAL commented on issue #7064: URL: https://github.com/apache/hudi/issues/7064#issuecomment-1324620970 @nsivabalan We updated the code as follows and built hudi and it worked fine for us now `return (originalProvider instanceof FilebasedSchemaProvider || originalProvider i

[GitHub] [hudi] ROOBALJINDAL commented on issue #7064: [SUPPORT] Data ingestion from csv file i.e. CsvDFSSource is working for FilebasedSchemaProvider but not working if schema is provided with Schema

2022-11-22 Thread GitBox
ROOBALJINDAL commented on issue #7064: URL: https://github.com/apache/hudi/issues/7064#issuecomment-1323406820 @nsivabalan Or I suspect here is the bug, it is working fine for FileBasedSchema provider but not with SchemaRegistryBasedSchema. Should it be handled here in SourceFormatAdapter.j

[GitHub] [hudi] ROOBALJINDAL commented on issue #7064: [SUPPORT] Data ingestion from csv file i.e. CsvDFSSource is working for FilebasedSchemaProvider but not working if schema is provided with Schema

2022-11-21 Thread GitBox
ROOBALJINDAL commented on issue #7064: URL: https://github.com/apache/hudi/issues/7064#issuecomment-1321805985 @nsivabalan I debbuged arround the logger you posted. Code is not going in that block because my writeClient is null. Though I checked values of source and target schema and those

[GitHub] [hudi] ROOBALJINDAL commented on issue #7064: [SUPPORT] Data ingestion from csv file i.e. CsvDFSSource is working for FilebasedSchemaProvider but not working if schema is provided with Schema

2022-11-21 Thread GitBox
ROOBALJINDAL commented on issue #7064: URL: https://github.com/apache/hudi/issues/7064#issuecomment-1321770420 @nsivabalan I have debugged the code. In HoodieAvroUtils, I checked, firstly it converts avroToBytes, it has schema with record field (primary key) of type Union( null, long ) and

[GitHub] [hudi] ROOBALJINDAL commented on issue #7064: [SUPPORT] Data ingestion from csv file i.e. CsvDFSSource is working for FilebasedSchemaProvider but not working if schema is provided with Schema

2022-10-30 Thread GitBox
ROOBALJINDAL commented on issue #7064: URL: https://github.com/apache/hudi/issues/7064#issuecomment-1296615480 > Will get back to you tomorrow on this. Bit busy with some stuff. Can you please check? @pratyakshsharma -- This is an automated message from the Apache Git Service. To r

[GitHub] [hudi] ROOBALJINDAL commented on issue #7064: [SUPPORT] Data ingestion from csv file i.e. CsvDFSSource is working for FilebasedSchemaProvider but not working if schema is provided with Schema

2022-10-25 Thread GitBox
ROOBALJINDAL commented on issue #7064: URL: https://github.com/apache/hudi/issues/7064#issuecomment-1291531698 @pratyakshsharma @nsivabalan Hi guys, can you check this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and