pan3793 opened a new issue, #5380: URL: https://github.com/apache/kyuubi/issues/5380
### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) ### Search before creating - [X] I have searched in the [task list](https://github.com/orgs/apache/projects/296) and found no similar tasks. ### Mentor - [ ] I have sufficient knowledge and experience of this task, and I volunteer to be the mentor of this task to guide contributors to complete the task. ### Skill requirements - Knowledge about Spark submit - Basic Knowledge of Scala testing and PySpark programming ### Background and Goals Restful API supports creating Batch jobs by posting /batches requests with or without resource file uploading. Currently, it is mainly used for submitting Spark Jars. As PySpark jobs become popular approach for data exploring and processing, we need to create tests for creating PySpark jobs. - Rest API docs for creating batches - https://kyuubi.readthedocs.io/en/master/client/rest/rest_api.html#post-batches - https://kyuubi.readthedocs.io/en/master/client/rest/rest_api.html#post-batches-with-uploading-resource - Rest API test caes: - POST without uploading https://github.com/apache/kyuubi/blob/master/kyuubi-server/src/test/scala/org/apache/kyuubi/server/rest/client/BatchRestApiSuite.scala#L141 - POST with uploading https://github.com/apache/kyuubi/blob/master/kyuubi-server/src/test/scala/org/apache/kyuubi/server/rest/client/BatchRestApiSuite.scala#L90 ### Implementation steps Add tests for creating PySpark jobs via Rest API - create tests for creating PySpark jobs using POST /batches with file on path of storage , e.g.s local filesystem, HDFS - create tests for creating PySpark jobs with resource file uploading (https://kyuubi.readthedocs.io/en/master/client/rest/rest_api.html#post-batches) - create tests with Rest API client - zip PySpark scripts and related files before if necessary ### Additional context Original reporter is @bowenliang123 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
