Data Validation Layers

This section covers the validations that are imposed on the data that are send for upload.

Validation Layers

1. Excel-Level Validation (Client-Side)

Excel templates contain embedded validation rules that prevent incorrect or incomplete data from being entered at the source. Some of the validations are mentioned below.

• Regular expressions (regex)

• Mandatory field checks

• Drop-down values

• Unique value validations

2. MDMS Schema-Level Validation (Server-Side)

The following activities are executed at the server side once the Excel file is uploaded through Jupyter Notebook-

• The MDMS service validates the data against the predefined schemas.

• It validates for the following-

  • Mandatory fields

  • Data types

  • Enum validations

  • Pattern (regex) constraints

  • Cross-field and cross-sheet relationships

  • Foreign key references

  • Uniqueness at the schema level

• Invalid rows are rejected, and detailed error messages are returned.

3. API-Level Validation (Backend Service Validation)

Once the data passes schema validation, the loader sends it to the appropriate backend services (MDMS, Boundary Service, CRS Master APIs). These services perform the final checks and dependencies at the backend. A few of the validations are as below-

• Duplicate records in the database

• Boundary parent-child hierarchy validation

• Department to designation mapping

• Complaint to the department mapping

• System-level constraints that are defined(Example, invalid tenant ID)

Any failures at this layer are returned in the processed Excel file with appropriate error codes and descriptions.