kfaraz commented on code in PR #19945: URL: https://github.com/apache/druid/pull/19945#discussion_r3998702568
########## docs/release-info/release-notes.md: ########## @@ -65,42 +139,389 @@ This section contains detailed release notes separated by areas. #### Other web console improvements +- Added the following status details to the **Services** view for Historical services: cloning from another Historical, in turbo loading mode, in decommissioning mode [#19253](https://github.com/apache/druid/pull/19253) +- Added support for resetting a supervisor to the latest offsets and backfilling [#19533](https://github.com/apache/druid/pull/19533) +- Improved handling for new tabs [#19483](https://github.com/apache/druid/pull/19483) +- Improved the Home view's **Services** card. It now reports Overlord, Coordinator, Router, Broker, and Indexer counts on clusters where the web console talks to the Coordinator without SQL access [#19481](https://github.com/apache/druid/pull/19481) + ### Ingestion +* You can now use the expression aggregator at ingestion time for expressions that produce a LONG or DOUBLE for both fold and combine expressions [#19508](https://github.com/apache/druid/pull/19508) +* Added `now()` expression function that returns the current system timestamp in milliseconds since epoch. Useful at ingestion time for troubleshooting pipeline delays (e.g., `now() - __time`). Note: `now()` is non-deterministic as it evaluates for every row, so it can break idempotency. This can be added to any column besides `__time` [#19386](https://github.com/apache/druid/pull/19386) +* Improved resiliency when ingesting from S3. Druid now retries on `SSLException` and transient credential errors instead of failing [#19617](https://github.com/apache/druid/pull/19617) [#19558](https://github.com/apache/druid/pull/19558) +* Improved S3 performance [#19394](https://github.com/apache/druid/pull/19394) +* Updated the default S3 connection pool size so that it's computed based on the number of available processors [#19536](https://github.com/apache/druid/pull/19536) + #### SQL-based ingestion +##### EXTERN for S3 now supports role ARN + +You can now include the role ARN when running an INSERT INTO EXTERN query. For example: + +``` +INSERT INTO +EXTERN( + s3(bucket => 'test2', prefix => 'export', assumeRoleArn => 'arn:aws:iam::00000:role/test-20260520')) +AS CSV +SELECT ... +``` + +[#19317](https://github.com/apache/druid/pull/19317) + ##### Other SQL-based ingestion improvements +- Added storage counters for the amount of bytes and files written to local and durable storage as well as the state of the local `ByteTracker`. Per-worker storage counters have also been added to the web console [#19316](https://github.com/apache/druid/pull/19316) + #### Streaming ingestion +##### Scaling cool down + +You can now configure different cool down durations for scaling up and scaling down streaming task autoscalers. + +[#19286](https://github.com/apache/druid/pull/19286) + +##### Improved supervisor restarts + +Supervisors no longer restart for all changes. Based on the type of change, one of the following can occur: + +- Druid persists the updated spec without a restart. +- Druid restarts the supervisor, but running tasks aren't impacted. +- Druid restarts the supervisor is restarted and its tasks are terminated, which was the default behavior before this change. Review Comment: ```suggestion - Druid restarts the supervisor, terminates the current tasks and launches fresh tasks (default behaviour in older Druid versions). ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
