Madhan Neethiraj created ATLAS-5291:
---------------------------------------
Summary: Atlas server to support active-active deployments
Key: ATLAS-5291
URL: https://issues.apache.org/jira/browse/ATLAS-5291
Project: Atlas
Issue Type: Improvement
Components: atlas-core
Reporter: Madhan Neethiraj
Atlas server support High Availability deployment with multiple instances but
only one of these instances will be in active mode while other instances remain
in passive mode. When the active instance is not available or not responsive,
one of the instances in passive mode will become active. Zookeeper is used to
coordinate the election of active instance.
For better scalability, Atlas server should support multiple active-active
instances available for users to search and update metadata, lineage, glossary,
classifications and business metadata. This will require updates/revisions in
few areas like:
* Atlas server instance should become stateless. Caches currently held in
memory (like type-definitions cache) needs to be refreshed if needed from Atlas
database
* Background operations like notification processing, handling of deferred
tasks should be revised to support execution in multiple instances. It might be
useful to separate these activities in different servers altogether, like
atlas-notification-processor, atlas-task-executor - which can further enable
scaling these activies independently.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
