anishshri-db opened a new pull request, #45038:
URL: https://github.com/apache/spark/pull/45038

   ### What changes were proposed in this pull request?
   Add support for specifying key and value encoder separately and also for 
each col family in RocksDB state store provider
   
   
   ### Why are the changes needed?
   This change allows us to specify encoder for key/values separately and avoid 
encoding additional bytes. Also, it allows us to set schemas/encoders for 
individual column families, which will be required for future changes related 
to transformWithState operator.
   
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   Added unit tests
   ```
   [info] Run completed in 3 minutes, 5 seconds.
   [info] Total number of tests run: 286
   [info] Suites: completed 1, aborted 0
   [info] Tests: succeeded 286, failed 0, canceled 0, ignored 0, pending 0
   [info] All tests passed.
   ```
   
   
   ### Was this patch authored or co-authored using generative AI tooling?
   No
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to