[jira] [Commented] (FINERACT-867) Scalability & Performance Enhancements for Supporting Millions of Clients, High TPS, and Concurrent Users
[ https://issues.apache.org/jira/browse/FINERACT-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205757#comment-17205757 ] Michael Vorburger commented on FINERACT-867: see FINERACT-1170 - IMHO that's really the most important / useful next step here. > Scalability & Performance Enhancements for Supporting Millions of Clients, > High TPS, and Concurrent Users > - > > Key: FINERACT-867 > URL: https://issues.apache.org/jira/browse/FINERACT-867 > Project: Apache Fineract > Issue Type: Improvement >Reporter: Sanyam Goel >Priority: Major > Labels: gsoc, gsoc2020, scalability, technical > > |*Overview & Objectives* > As Mifos X has matured as a core banking platform, it's been adopted and used > by larger institutions serving hundreds of thousands and even millions of > clients. Partners operating cloud-hosted subscription models are also > supporting hundreds of thousands of clients across their multi-tenant > installations. Most recently, more and more digital-first fintechs are using > the platforms for highly scalable wallet accounts needing hundreds and > thousands of TPS. We need to benchmark, analyze and improve the performance > and scalability of the system.| > |*Description* > Enhancements to the back-end platform will include parallelization of all the > jobs with a configurable amount of concurrency, look at the explain plans of > the queries being used in the jobs, paginate input queries for jobs, put lazy > fetching where required, node-aware scheduler and cache, office-wise > configurable jobs to distribute job-load across servers and write some tests > to prove that the concurrency will work for a decent amount of scale. > In addition, you'll provide some metrics which can help mid-sized MFIs (those > having around a million active loans) in adopting Mifos X. > | > |*Helpful Skills* > Java, Javascript, Spring, JAX-RS, JPA,| > |*Impact* > Higher outreach to the unbanked by supporting larger institutions and scaling > more rapidly.| -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FINERACT-867) Scalability & Performance Enhancements for Supporting Millions of Clients, High TPS, and Concurrent Users
[ https://issues.apache.org/jira/browse/FINERACT-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081748#comment-17081748 ] Michael Vorburger commented on FINERACT-867: I agree this is somewhat vague to be directly actionable as is, but perhaps it's useful to have an umbrella issue to coordinate related work if we have e.g. a GSOC student, or other contributor, willing to pick up this important area. There was some write-up on [https://mifosforge.jira.com/wiki/spaces/RES/pages/1118175247/Google+Summer+of+Code+2020+Ideas#GoogleSummerofCode2020Ideas-Scalability,HighTPS,andConcurrentUsers]. I've found 5 earlier issue I've just linked here, contributions to all of those can be considered as progress towards this. The [Performance & Scalability page on the Wiki|https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=133632146] also has some thoughts. I think other than what's already in those issues and Wiki page, what this basically boils down to is conducting real world load testing on Fineract by 1. asking on the list for scenarios, 2. script such stress testing using some REST API load simulation tool which can "hammer" Fineract, 3. optimize any SQL queries which jump out, 4. do Java level code profiling to identify bottle necks - I expect FINERACT-135 to be the first obvious candidate jumping out. > Scalability & Performance Enhancements for Supporting Millions of Clients, > High TPS, and Concurrent Users > - > > Key: FINERACT-867 > URL: https://issues.apache.org/jira/browse/FINERACT-867 > Project: Apache Fineract > Issue Type: Improvement >Reporter: Sanyam Goel >Priority: Major > Labels: gsoc, gsoc2020, perfomance > > |*Overview & Objectives* > As Mifos X has matured as a core banking platform, it's been adopted and used > by larger institutions serving hundreds of thousands and even millions of > clients. Partners operating cloud-hosted subscription models are also > supporting hundreds of thousands of clients across their multi-tenant > installations. Most recently, more and more digital-first fintechs are using > the platforms for highly scalable wallet accounts needing hundreds and > thousands of TPS. We need to benchmark, analyze and improve the performance > and scalability of the system.| > |*Description* > Enhancements to the back-end platform will include parallelization of all the > jobs with a configurable amount of concurrency, look at the explain plans of > the queries being used in the jobs, paginate input queries for jobs, put lazy > fetching where required, node-aware scheduler and cache, office-wise > configurable jobs to distribute job-load across servers and write some tests > to prove that the concurrency will work for a decent amount of scale. > In addition, you'll provide some metrics which can help mid-sized MFIs (those > having around a million active loans) in adopting Mifos X. > | > |*Helpful Skills* > Java, Javascript, Spring, JAX-RS, JPA,| > |*Impact* > Higher outreach to the unbanked by supporting larger institutions and scaling > more rapidly.| -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FINERACT-867) Scalability & Performance Enhancements for Supporting Millions of Clients, High TPS, and Concurrent Users
[ https://issues.apache.org/jira/browse/FINERACT-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080480#comment-17080480 ] Awasum Yannick commented on FINERACT-867: - This is vague to me. Do you have sub tasks which will have to be completed for this to be closed. Can we break this down to make it easy to understand by students? > Scalability & Performance Enhancements for Supporting Millions of Clients, > High TPS, and Concurrent Users > - > > Key: FINERACT-867 > URL: https://issues.apache.org/jira/browse/FINERACT-867 > Project: Apache Fineract > Issue Type: Improvement >Reporter: Sanyam Goel >Priority: Major > Labels: gsoc, gsoc2020 > > |*Overview & Objectives* > As Mifos X has matured as a core banking platform, it's been adopted and used > by larger institutions serving hundreds of thousands and even millions of > clients. Partners operating cloud-hosted subscription models are also > supporting hundreds of thousands of clients across their multi-tenant > installations. Most recently, more and more digital-first fintechs are using > the platforms for highly scalable wallet accounts needing hundreds and > thousands of TPS. We need to benchmark, analyze and improve the performance > and scalability of the system.| > |*Description* > Enhancements to the back-end platform will include parallelization of all the > jobs with a configurable amount of concurrency, look at the explain plans of > the queries being used in the jobs, paginate input queries for jobs, put lazy > fetching where required, node-aware scheduler and cache, office-wise > configurable jobs to distribute job-load across servers and write some tests > to prove that the concurrency will work for a decent amount of scale. > In addition, you'll provide some metrics which can help mid-sized MFIs (those > having around a million active loans) in adopting Mifos X. > | > |*Helpful Skills* > Java, Javascript, Spring, JAX-RS, JPA,| > |*Impact* > Higher outreach to the unbanked by supporting larger institutions and scaling > more rapidly.| -- This message was sent by Atlassian Jira (v8.3.4#803005)
