cl-2048 opened a new issue, #139:
URL: https://github.com/apache/doris-spark-connector/issues/139

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and 
found no similar issues.
   
   
   ### Version
   
   version: spark 3.3.1
   
   
   ### What's Wrong?
   
   
![image](https://github.com/apache/doris-spark-connector/assets/19605149/2a90f7cd-7053-442e-af1c-849b68489ca5)
   
![image](https://github.com/apache/doris-spark-connector/assets/19605149/a6fa2df9-f6f5-47d4-9747-1c7ec6b54d1a)
   我的repartition设置是10,但是在stage中执行repartition 并行度任务数一直是1,导致分区执行完成不了;
   定位源码,我想知道这个是spark3.3 需要配置什么参数么,还是说 dataframe 到 repartition 之前因为什么操作导致 
并行度降到1呢 
   希望指导下
   
   
   ### What You Expected?
   
   我想知道 spark3.3 是否需要配置什么参数,从stage上看 是不是  deserializeToObejct 
导致并发降低到1呢,需要什么配置什么spark参数防止这种
   
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to