dik111 opened a new issue, #5370: URL: https://github.com/apache/seatunnel/issues/5370
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened Hi Teams: I try to use connector-v2-http to synchronize http-json data to hive, but I get empty data, where I locate `$.data[*].finishPermissions[*].permissionName`, `$.data[*]. finishPermissions[*].permissionCode` results in empty data, how can I modify the configuration file? json data: ```json { "errorMsg": null, "stateCode": 200, "data": [ { "finishMainCode": "312", "finishCode": "312DHAE", "finishName": "xx", "texture": "无", "greenLevel": "ENF", "createDate": "2023/8/7 9:59:21", "lastUpdateDate": "2023/8/8 10:03:02", "saleState": "在售", "finishPermissions": [ { "permissionName": "11", "permissionCode": "22", "brand": "33", "category": "44", "finishCode": "55", "finishName": "66", "finishNickCode": null, "finihsNickName": null, "isUseChest": 1, "isUseBackPannel": 0, "isUseDoor": 0, "isUseWallPannel": 0 } ] } ]} ``` ### SeaTunnel Version 2.3.3 ### SeaTunnel Config ```conf env { spark.streaming.batchDuration = 5 spark.app.name = "seatunnel-app-http-hive-spark" spark.sql.catalogImplementation = "hive" hive.metastore.dml.events = false spark.executor.memory=5G spark.network.timeout=10000000 spark.executor.heartbeatInterval=10000000 job.mode = "BATCH" } source { Http { url = "http://xx/finishapi/getFinishSummary"; method = "GET" format = "json" json_field = { finish_main_code = "$.data[*].finishMainCode" finish_code = "$.data[*].finishCode" texture = "$.data[*].texture" green_level = "$.data[*].greenLevel" create_date = "$.data[*].createDate" last_update_date = "$.data[*].lastUpdateDate" sale_state = "$.data[*].saleState" permission_name = "$.data[*].finishPermissions[*].permissionName" permission_code = "$.data[*].finishPermissions[*].permissionCode" } schema = { fields { finish_main_code = string finish_code = string texture = string green_level = string create_date = string last_update_date = string sale_state = string permission_name = string permission_code = string } } } } sink { Hive { table_name = "test.http_hive_finish" save_mode = "overwrite" metastore_uri = "thrift://xx:9083" } } transform{} ``` ### Running Command ```shell bin/start-seatunnel-spark-3-connector-v2.sh --master yarn --deploy-mode client --config ./config/http-hive-finish-spark.conf ``` ### Error Exception ```log none ``` ### Zeta or Flink or Spark Version spark version 3.2.1 ### Java or Scala Version java 8 ### Screenshots _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
