SongboWang1998 opened a new issue, #39543:
URL: https://github.com/apache/doris/issues/39543

   ### Discussed in https://github.com/apache/doris/discussions/39518
   
   <div type='discussions-op-text'>
   
   <sup>Originally posted by **SongboWang1998** August 17, 2024</sup>
   Hello Doris Community,
   
   I am encountering an issue when executing SQL queries that include a LIMIT 
clause through the doris-spark-connector. The same queries work fine when 
executed directly in the Doris client, but they fail when run through the 
connector.
   
   **Error Message:**
   ERROR DorisBatch: Doris FE's response cannot map to schema. res: 
{"exception":"only support single table filter-prune-scan, but found [ select 
user_id, city from xxx LIMIT 1]","status":400} 
org.apache.doris.shaded.com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException:
 Unrecognized field "exception" (class 
org.apache.doris.spark.rest.models.QueryPlan), not marked as ignorable (3 known 
properties: "partitions", "status", "opaqued_query_plan"]) at [Source: 
(String)"{"exception":"only support single table filter-prune-scan, but found [ 
select user_id, city from xxx LIMIT 1]","status":400}"; line: 1, column: 15] 
(through reference chain: 
org.apache.doris.spark.rest.models.QueryPlan["exception"])
   
   This error suggests that the query is not supported for filter-prune-scan 
operations on a single table when using the doris-spark-connector, even though 
it works directly in the Doris client. Additionally, there seems to be an issue 
with parsing the error response in the connector.
   
   **Steps to Reproduce:**
   1. Execute the query `SELECT user_id, city FROM xxx LIMIT 1;` directly in 
the Doris client (works fine).
   2. Execute the same query through the doris-spark-connector (results in the 
above error).
   
   **Environment:**
   - Doris version: 2.0.13
   - Spark Doris Connector version: 1.3.1
   - Apache Spark version: 3.5
   
   Could anyone please help me understand why this discrepancy occurs and how 
to resolve it? Additionally, any advice on handling the unrecognized field 
issue in the error response would be greatly appreciated.
   
   Thank you for your assistance.
   </div>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to