amrishlal commented on issue #7244: URL: https://github.com/apache/hudi/issues/7244#issuecomment-1650363772
Verified using the latest master using the same model as @ad1happy2go above and successfully ran the model **DBT run** ```amrish@Amrishs-MBP github-issue-7244 % dbt run 18:45:29 Running with dbt=1.5.3 18:45:29 [WARNING]: Deprecated functionality The `source-paths` config has been renamed to `model-paths`. Please update your `dbt_project.yml` configuration to reflect this change. 18:45:29 [WARNING]: Deprecated functionality The `data-paths` config has been renamed to `seed-paths`. Please update your `dbt_project.yml` configuration to reflect this change. 18:45:29 Registered adapter: spark=1.5.0 18:45:29 Found 1 model, 2 tests, 0 snapshots, 0 analyses, 357 macros, 0 operations, 0 seed files, 0 sources, 0 exposures, 0 metrics, 0 groups 18:45:29 18:45:31 Concurrency: 1 threads (target='dev') 18:45:31 18:45:31 1 of 1 START sql incremental model default.issue_7244_model .................... [RUN] 18:45:38 1 of 1 OK created sql incremental model default.issue_7244_model ............... [OK in 7.93s] 18:45:39 18:45:39 Finished running 1 incremental model in 0 hours 0 minutes and 9.22 seconds (9.22s). 18:45:39 18:45:39 Completed successfully 18:45:39 18:45:39 Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1 amrish@Amrishs-MBP github-issue-7244 % ``` **spark-sql verification** ``` spark-sql> show databases; default test_database1 Time taken: 2.562 seconds, Fetched 2 row(s) spark-sql> use default > ; 23/07/25 11:47:20 WARN ObjectStore: Failed to get database global_temp, returning NoSuchObjectException Time taken: 0.125 seconds spark-sql> show tables; issue_7244_model my_first_dbt_model my_first_dbt_model1 my_second_dbt_model Time taken: 0.263 seconds, Fetched 4 row(s) spark-sql> select * from issue_7244_model > ; 23/07/25 11:47:43 WARN DFSPropertiesConfiguration: Cannot find HUDI_CONF_DIR, please set it as the dir of hudi-defaults.conf 23/07/25 11:47:43 WARN DFSPropertiesConfiguration: Properties file file:/etc/hudi/conf/hudi-defaults.conf not found. Ignoring to load props file 20230725114531327 20230725114531327_1_4 2 fbb84dbc-e72f-4ac6-990a-d0205e2aaab3-0_1-33-0_20230725114531327.parquet 2 anyway 2023-07-25 11:45:31.367 20230725114531327 20230725114531327_2_5 3 c1d85730-7a1a-4845-bb4a-1b7128f6de3d-0_2-34-0_20230725114531327.parquet 3 bye 2023-07-25 11:45:31.367 20230725114531327 20230725114531327_0_6 1 1da126fe-eb3a-4982-ab77-f294458eefea-0_0-32-0_20230725114531327.parquet 1 yo 2023-07-25 11:45:31.367 Time taken: 4.461 seconds, Fetched 3 row(s) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org