[ 
https://issues.apache.org/jira/browse/SOLR-17065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885476#comment-17885476
 ] 

ASF subversion and git services commented on SOLR-17065:
--------------------------------------------------------

Commit 94a744746dc5d10d8900f30cac7cba9ce3743432 in solr's branch 
refs/heads/branch_9x from Houston Putman
[ https://gitbox.apache.org/repos/asf?p=solr.git;h=94a744746dc ]

SOLR-17065: Absorb the Cross DC project (#2062)

* Migrate Cross DC code into Solr

- The Cross DC Producer + Cross DC Common -> solr/modules/cross-dc
- The Cross DC Consumer -> solr/cross-dc-manager

* Upgrade kafka libraries to 3.7.1

Co-authored-by: Houston Putman <hous...@apache.org>
Co-authored-by: Mark Robert Miller <markrmil...@apache.org>
(cherry picked from commit 8188bf5e0f37ca929e4cebce9e73e50d5d07d86d)


> Migrate Sandbox CrossDC functionality into Solr
> -----------------------------------------------
>
>                 Key: SOLR-17065
>                 URL: https://issues.apache.org/jira/browse/SOLR-17065
>             Project: Solr
>          Issue Type: Task
>          Components: CrossDC, module - crossDC
>            Reporter: Houston Putman
>            Assignee: Houston Putman
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> As a part of [SIP-13: Cross Data Center 
> Replication|https://cwiki.apache.org/confluence/display/SOLR/SIP-13%3A+Cross+Data+Center+Replication],
>  the [solr-sandbox|https://github.com/apache/solr-sandbox] repository was 
> created and a new Cross DC implementation has been developed.
> This CrossDC implementation relies on Kafka (for now, maybe other queues in 
> the future), and has two parts.
>  * A producer, which is a Solr plugin (An updateRequestProcessor), that sends 
> documents to kafka after successfully indexing them.
>  * A consumer, which is a standalone application, that reads documents for 
> kafka and sends them to the mirrored SolrClouds.
> This has been in development for a year now and is used at multiple companies 
> (even in production).
> We believe that the project has reached a level of maturity that it can be 
> "graduated" from the sandbox module and be included in future Solr releases.
>  
> As a part of the move I propose the following:
>  * The Producer will be branded as the "cross-dc" Solr module, and be 
> available just as any other module is.
>  * The Consumer will be branded as the "cross-dc-manager" and be packaged 
> just as the prometheus-exporter is, a standalone application that comes with 
> Solr and uses many of the same Jars. The reason for the name change is that 
> we might expand the role of this application to something beyond just 
> "consuming" from the Kafka queue. In that case its much easier to rename it 
> now than later.
>  
> We will let this bake in the main branch for a while before backporting to 
> 9.x.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org
For additional commands, e-mail: issues-h...@solr.apache.org

Reply via email to