Migration to DIGIT architecture primarily involves the following changes to iFIX-Core:
Transactional DB is switched from MongoDB to PostgreSQL
Analytics DB is switched from Druid to ElasticSearch
Correspondingly, the dashboard is switched from Metabase to the DSS dashboard
Deploy ifix-migration-toolkit-db:develop-b7a2050-13
to ifix
environment
Port forward to the ifix-migration-toolkit pod
The following common request body is used to hit the ifix-migration-toolkit endpoints:
Government master data is moved to MDMS. Please manually copy the government(tenant) data to the tenants
master of tenant
module. Here is a link to a sample tenants master.
First, deploy the latest image of the ifix-master-data-service
(So that the tables get created in PostgreSQL.)
Deploy plain search docker image of ifix-master-data:
Ensure ifix-master-data-persister is configured in the egov-persister
Hit the Chart of Account migrate endpoint of the migration-toolkit
With this, we will be performing migration from MongoDB to both, PostgreSQL and ElasticSearch. Data will be read from MongoDB using fiscal-event-service's plain search api, and pushed to a kafka topic.
From there, the data will reach PostgreSQL using egov-persister.
From kafka-topic data will pass through ifix-es-pipeline. After that ifix-es-pipeline will post the processed data to the next kafka topic in the pipeline. From there, egov-indexer will read from the topic and index the data onto ElasticSearch.
First, deploy the latest image of the fiscal-event-service
(So that the tables get created in PostgreSQL.)
Follow the instructions mentioned in the ifix-es-pipeline project's README to setup the ES mapping before performing the migration.
Deploy plain search docker image of fiscal-event-service:
Deploy the latest image of ifix-es-pipeline
Ensure fiscal-events-persister is configured in egov-persister
Ensure ifix-fiscal-event-indexer is configured in egov-indexer
(Ensure ifix-migration-progress is configured in egov-persister to record the progress of the migration. In case of any failures during migration, with this, it will resume the migration from where it left off. )
Hit the Fiscal Event migrate endpoint of the migration-toolkit
Deploy ifix-migration-toolkit-db:develop-2557812-9
to mgramseva
environment.
Port forward to the ifix-migration-toolkit pod
The following common request body is used to hit the ifix-migration-toolkit endpoints:
First, deploy the latest image of the ifix-department-entity-service
(So that the tables get created in PostgreSQL.)
Deploy plain search docker image of ifix-department-entity-service:
Ensure department-entity-persister.yml is configured in the egov-persister.
(Ensure department-entity-migration-progress is configured in egov-persister to record the progress of the migration. In case of any failures during migration, with this, it will resume the migration from where it left off. )
Hit the Department Hierarchy migrate endpoint of the migration-toolkit
Hit the Department Entity migrate endpoint of the migration-toolkit
First, deploy the latest image of the ifix-department-entity-service
(So that the tables get created in PostgreSQL.)
Deploy plain search docker image of ifix-department-entity-service:
Ensure adapter-master-data-service.yml is configured in egov-persister.
Hit the Department migrate endpoint of the migration-toolkit
Hit the Expenditure migrate endpoint of the migration-toolkit
Hit the Project migrate endpoint of the migration-toolkit
This migration will require the following tasks to be performed:
Copy data to ElasticSearch
Copy data to PostgreSQL
Fiscal Events
Apart from iFIX-Core, the other services relying on MongoDB were also migrated to PostgreSQL. So they will also need to be migrated.
Department Entity Service
Department Hierarchy Level
Department Entity
Adapter Master Data Service
Expenditure
Department
Project