Myracle opened a new pull request, #133:
URL: https://github.com/apache/flink-connector-elasticsearch/pull/133
This commit introduces a new feature that allows for dynamic index
generation in the Elasticsearch connector. The index name can now be
constructed by appending a suffix derived from a specified field's value to a
prefix.
Key changes include:
* New Configuration Options:
* index.suffix.field.name: Specifies the field whose value will be
used as the suffix for the index name.
* index.suffix.field.length: (Optional) Defines the length of the
suffix to be extracted from the field's value.
* Updated Index Generation:
* The IndexGeneratorFactory has been enhanced to create a
SuffixIndexGenerator when the index.suffix.field.name option is configured.
This new generator handles the logic of constructing the index name with the
specified prefix and the value-derived suffix.
* Comprehensive Testing:
* Unit tests have been added to IndexGeneratorTest to validate the
new suffix-based index generation functionality, covering various scenarios
including length limitation and compatibility with existing index generation
methods.
This feature provides greater flexibility in organizing data within
Elasticsearch, enabling users to partition their data into different indices
based on the values of a specific field.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]