yasithdev opened a new pull request, #661:
URL: https://github.com/apache/airavata/pull/661

   ## Summary
   
   Makes `airavata-server` start with **no programmatic DB modification** 
outside Flyway, removes the dead orchestration/messaging paths the 
DB-transactional executor replaced, and fixes several issues found while 
verifying a clean `tilt up`/`down` → submit → complete cycle on the docker 
slurm + sftp devstack.
   
   ### DB seeding externalized
   - Schema seeded from external SQL (`conf/db/seed.sql`, via MariaDB 
`docker-entrypoint-initdb.d`); server runs with Hibernate `ddl-auto=validate`.
   - Removed `DBInitConfig`/`DBInitializer` and every `*DBInitConfig` + 
`Dev*Initializer` (UserProfile, Sharing, AppCatalog, ReplicaCatalog, 
WorkflowCatalog, ExpCatalog, DevCompute, DevStorage, DevData).
   - Collapsed `V1` + `V2` migrations into a single baseline.
   
   ### Dead-code removal
   - `KafkaProxyService` (no Kafka on the orchestration run path).
   - Legacy monitors: `EmailBasedMonitor`, `RealtimeMonitor`, 
`ParsingTriggeringTask`, and the process-completion / job-status message 
(de)serializers.
   
   ### Fixes (surfaced via the portal)
   - **Job frozen at QUEUED while experiment COMPLETED** — `MonitoringTask` 
persisted job status under the monitoring task id, but `JobPK = (jobId, 
jobSubmissionTaskId)` and `addJobStatus` silently no-ops on a miss. Now 
captures the job's owning task id and records an `ACTIVE` transition while the 
job runs.
   - **Monitoring reports a stale failure** — slurm reuses job ids across `tilt 
down`/`up` while the accounting DB persists, so `sacct -j N` returned an old 
`CANCELLED` record. Polling now uses `sacct --duplicates` and selects the 
most-recently-submitted record.
   - **Empty "recent experiments"** — `EXPERIMENT_SUMMARY` was a physical table 
nothing populated. `ExperimentSummaryEntity` is now an `@Immutable @Subselect` 
derived live from `EXPERIMENT` + latest `EXPERIMENT_STATUS` + process host.
   - **MapStruct acronym drop** — `ComputeMapper` maps `defaultCPUCount` → 
`defaultCpuCount`.
   
   ### Note
   `conf/sftp/id_*` commits a **fixed throwaway devstack SFTP keypair** so 
fresh worktrees don't crash-loop the local sftp container. It grants access 
only to the ephemeral dev container — flagging it in case you'd prefer 
generating it at setup time.
   
   ## Test plan
   - `tilt up` from clean state → server healthy (`/actuator/health`) with 
`ddl-auto=validate`, no init code.
   - Submit an Echo experiment from the portal → PROCESS/TASK DAG runs to 
completion; job reaches `COMPLETE`; `Echo.stdout` downloads.
   - `tilt down` → `tilt up` again → reused slurm job id still reports the 
correct terminal state.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to