SOR Skill's Migration

Skills Migration to SOR

Skills data is stored as SOR in MDMSv2 and needs mapping. After mapping, update the skills info in individuals' details and muster rolls with SOR. Use the provided migration script to help with this data update.

Migration Steps

To migrate data follow the steps given below:

1. Create Labour-Sor Mapping:

   • Add the following mapping to the expense.sor.migration.mapping field in the application properties: `{"UNSKILLED.CARPENTER":"SOR_000016", "SKILLED.CARPENTER":"SOR

   • You can also override it in the Helm (click here).

2. Use the Specific Build:

   • egovio/expense-calculator-db:sor-migration-8007f0108-142

   • Click here to access the branch and change details.

3. Build and Deploy:

   • Deploy the build provided above or build and deploy from the code linked above if custom changes are required.

   • Use the curl below to migrate the data.

4. Add the below environment variables to the expense-calculator helm:

   • state.level.tenant.id

   • muster.roll.update.topic

   • individual.host

   • individual.context.path

   • individual.update.topic

5. Create table eg_sor_migration( id character varying(128), is_migration_successful boolean) ;

6. Copy

   curl --location 'http://localhost:8090/expense-calculator/_migrate/musterRoll' \
   --header 'Content-Type: application/json' \
   --data '{
       "RequestInfo": {
           "apiId": "Rainmaker",
           "authToken": "e1da5b9d-e9d5-4798-bd25-f5d8fbbd7cc8",
           "userInfo": {
               "id": 176,
               "uuid": "488c2a00-e33f-49f5-932d-239b1ae33e88",
               "userName": "Product UAT",
               "name": "Product UAT",
               "mobileNumber": "7200990110",
               "type": "EMPLOYEE",
               "roles": [
                   {
                       "name": "System",
                       "code": "SYSTEM",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "MUKTA Admin",
                       "code": "MUKTA_ADMIN",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "BILL_VIEWER",
                       "code": "BILL_VIEWER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "MUSTER ROLL APPROVER",
                       "code": "MUSTER_ROLL_APPROVER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "MUSTER ROLL VERIFIER",
                       "code": "MUSTER_ROLL_VERIFIER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "Organization viewer",
                       "code": "ORG_VIEWER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "WORK ORDER APPROVER",
                       "code": "WORK_ORDER_APPROVER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "ESTIMATE VERIFIER",
                       "code": "ESTIMATE_VERIFIER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "OFFICER IN CHARGE",
                       "code": "OFFICER_IN_CHARGE",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "WORK ORDER CREATOR",
                       "code": "WORK_ORDER_CREATOR",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "Employee Common",
                       "code": "EMPLOYEE_COMMON",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "TECHNICAL SANCTIONER",
                       "code": "TECHNICAL_SANCTIONER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "PROJECT VIEWER",
                       "code": "PROJECT_VIEWER",
                       "tenantId": "statea.cityone"
                   }
               ],
               "tenantId": "statea.cityone"
           },
           "msgId": "1684664105678|en_IN",
           "plainAccessRequest": {}
       }
   }'
   

7. Copy

   curl --location 'http://localhost:8090/expense-calculator/_migrate/individual' \
   --header 'Content-Type: application/json' \
   --data '{
       "RequestInfo": {
           "apiId": "Rainmaker",
           "authToken": "e1da5b9d-e9d5-4798-bd25-f5d8fbbd7cc8",
           "userInfo": {
               "id": 176,
               "uuid": "488c2a00-e33f-49f5-932d-239b1ae33e88",
               "userName": "Product UAT",
               "name": "Product UAT",
               "mobileNumber": "7200990110",
               "type": "EMPLOYEE",
               "roles": [
                   {
                       "name": "System",
                       "code": "SYSTEM",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "MUKTA Admin",
                       "code": "MUKTA_ADMIN",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "BILL_VIEWER",
                       "code": "BILL_VIEWER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "MUSTER ROLL APPROVER",
                       "code": "MUSTER_ROLL_APPROVER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "MUSTER ROLL VERIFIER",
                       "code": "MUSTER_ROLL_VERIFIER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "Organization viewer",
                       "code": "ORG_VIEWER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "WORK ORDER APPROVER",
                       "code": "WORK_ORDER_APPROVER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "ESTIMATE VERIFIER",
                       "code": "ESTIMATE_VERIFIER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "OFFICER IN CHARGE",
                       "code": "OFFICER_IN_CHARGE",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "WORK ORDER CREATOR",
                       "code": "WORK_ORDER_CREATOR",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "Employee Common",
                       "code": "EMPLOYEE_COMMON",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "TECHNICAL SANCTIONER",
                       "code": "TECHNICAL_SANCTIONER",
                       "tenantId": "statea.cityone"
                   },
                   {
                       "name": "PROJECT VIEWER",
                       "code": "PROJECT_VIEWER",
                       "tenantId": "statea.cityone"
                   }
               ],
               "tenantId": "statea.cityone"
           },
           "msgId": "1684664105678|en_IN",
           "plainAccessRequest": {}
       }
   }'

8. Verification in DB for muster-roll:

   Query the eg_wms_attendance_summary table and check if “skillCode” in additionalDetails has been migrated from UNSKILLED.CARPENTER -> SOR_000016

   Example:

   Old data: additionalDetails : { …… skillCode : UNSKILLED.CARPENTER …… }

   New data: additionalDetails : { …… skillCode : SOR_000016 …… }

9. Verification in DB for an individual: Query the individual_skill table and check if “type” and “level” are migrated to “SOR” and “SOR_code” respectively.

   Example.:

   Old data:

   Type: CARPENTER

   Level: UNSKILLED

   New data:

   Type: SOR

   Level: SOR_000016

10. Once the migration is complete remove the environment variables added for migration.

The release chart for this version here.

MDMS Changes

NA

Config Changes

NA

Infra Changes

Release Summary

DIGIT-Works release v1.1 release offers no functional changes. The non-functional changes in this release include the capability to migrate the Skills master to the Schedule of Rates master.

Functional changes

• NA

Non-functional changes

• Migration of skills master to SOR master present in mdmsV2 - refer to for the steps for data migration.

Known Issues

Below is the list of known issues that need to be addressed as part of the platform roadmap:

• Multiple measurements can not be created at the same time for one contract.

• Integrated error queue implementation for all services along with the necessary measures for addressing issues, is required. In situations of unrecoverable failures, this setup will provide a means to trigger prompt alerts and implement corrective actions.

• Establishing alert mechanisms for critical errors, particularly in the context of billing, is required.

• Managing offline & low connectivity use cases as a best practice.

• The services should include the workflow as part of the payload and push it into the Kafka topic for persistence.

• Separate SMS-related localization from all services and migrate it to a dedicated service.

• Performance testing and benchmarking of services.

• Security audit.

• Multiple mdms-v2 calls in services are needed because mdms-v2 returns only one master response.

• Code refactoring of works-services like

  • Remove unused models

  • Change package names

  • Remove duplicate validation logic

Document Resources and Links

Technical Documents