[GitHub] [hudi] ranjanankur commented on issue #9355: [SUPPORT] Problem while reading from BQ tables which are synced on Hudi table

2023-08-29 Thread via GitHub
ranjanankur commented on issue #9355: URL: https://github.com/apache/hudi/issues/9355#issuecomment-1697240196 Or Is it possible to make some `0.13.x` release where this can fixed? I think this a major blocker for everyone who is using GCP as cloud and using BigQuery. Please help on this.

[GitHub] [hudi] ranjanankur commented on issue #9355: [SUPPORT] Problem while reading from BQ tables which are synced on Hudi table

2023-08-29 Thread via GitHub
ranjanankur commented on issue #9355: URL: https://github.com/apache/hudi/issues/9355#issuecomment-1697226710 Hi @the-other-tim-brown We will not able to use `snapshot` version in our production use case. This is blocking all our streaming use case because in most of them we create

[GitHub] [hudi] ranjanankur commented on issue #9355: [SUPPORT] Problem while reading from BQ tables which are synced on Hudi table

2023-08-28 Thread via GitHub
ranjanankur commented on issue #9355: URL: https://github.com/apache/hudi/issues/9355#issuecomment-1696793585 & We are not able file the `BIGQUERY_SYNC_USE_BQ_MANIFEST_FILE` in the `0.14.0-SNAPSHOT` version. We are able to see that this part of code present on GitHub. Was the code bundled

[GitHub] [hudi] ranjanankur commented on issue #9355: [SUPPORT] Problem while reading from BQ tables which are synced on Hudi table

2023-08-28 Thread via GitHub
ranjanankur commented on issue #9355: URL: https://github.com/apache/hudi/issues/9355#issuecomment-1696782369 We can see this code in the source but @the-other-tim-brown will you please confirm the version of `hudi-gcp-hundle` that we should use & if we have to use `0.14.0-SNAPSHOT` then

[GitHub] [hudi] ranjanankur commented on issue #9355: [SUPPORT] Problem while reading from BQ tables which are synced on Hudi table

2023-08-28 Thread via GitHub
ranjanankur commented on issue #9355: URL: https://github.com/apache/hudi/issues/9355#issuecomment-1696764242 Hi @the-other-tim-brown , @emkornfield In the above article it is mentioned to use the `use-bq-manifest-file` flag while running `BigQuerySyncTool` function to sync Hudi table