Browse documentation
HomeDocsTarget Schema & AI Planning
Schemas & Portals

Defining Your Target Schema & AI Planning

Define your data migration's source of truth, then let Elvity's AI generate an automated, human-verified mapping plan.


This section guides you through defining a Target Schema — your data migration’s “Source of Truth” — and outlines how Elvity’s AI processes your schema to generate an automated, human-verified data mapping plan.

3.1

The Target Schema Wizard (User Interface)

You can build, configure, and enforce validation rules on a target schema entirely in the browser using the step-by-step Target Schema Wizard.

1

Step 1 — Create a New Schema

  1. 1Navigate to Target Schemas in the left sidebar (/schemas).
  2. 2Click the Create New Schema button in the top-right corner of the page.
  3. 3On the Target Schema Definition page, select how you want to build the schema:
  • Upload Sample File (Recommended): Reverse-engineer fields instantly from an existing CSV or Excel template. Click Continue.
  • Use Target Templates: Discover and instantiate pre-built industry templates (such as Census, Bill of Materials, Product Catalog, or Member Register) with pre-configured field types and validation rules. Filter by category (e.g., Logistics, HR Tech, RetailTech, FinTech) or search by keyword, then click Instantiate Template. When working with a template schema, you can also leverage built-in sample datasets pre-packaged directly into the product to quickly test mappings and validation rules without uploading external files.
  • Define Manually: Start with an empty schema and add fields yourself. Click Create Blank Schema.
Industry Target Templates catalog with categories and search filtering.
Browse and instantiate pre-built industry schema templates with standard validation rules.
2

Step 2 — Upload Your Sample File

(If “Upload Sample File” was selected)

  1. 1Drag and drop your .csv or .xlsx file into the dashed dropzone, or click Choose file to select one locally.
  2. 2Once the file is processed and the target blueprint is created, continue to the fields step.

(If “Define Manually” was selected, skip to Step 3 — the wizard creates a blank schema and opens the fields editor directly.)

3

Step 3 — Refine Target Fields

On the Refine Your Target Schema page, configure your columns:

  1. 1Schema Identity: Give your schema a recognizable Name (e.g., Partner Data Migration Schema) and an optional Description.
  2. 2Review or Add Fields: Upload paths show inferred columns; manual paths start empty — use + Add Custom Field to create columns.
  3. 3Customize Field Names: Edit names inline in the Target Field Name column.
  4. 4Inspect Sample Data: On upload paths, review the Sample Data column for values parsed from your file.
  5. 5Adjust Data Types: Use the Data Type dropdown: String, Integer, Decimal, Boolean, Date, Timestamp, or JSON.
  6. 6Remove Columns: Use the row delete action to drop columns you do not need (there is no separate include toggle).
  7. 7Click Next: Set Validation Rules to continue.
Refine Your Target Schema page showing inferred columns, data types, and sample data.
Refine field names, inferred data types, and sample data in the schema editor.
4

Step 4 — Configure Validation Rules

In the Validation Rules workspace, configure smart guardrails to protect your target systems from bad data:

  1. 1Select Column: Click on any column in the left Field Rules navigation sidebar.
  2. 2Apply Standard Rules: Toggle and configure constraints on the right side:
  • Required: Enforces that a cell must never be empty.
  • Case Match: Aligns text to UPPER, LOWER, TITLE, or UNCHANGED casing.
  • Content Standardization: Automatically trims leading/trailing whitespace or strips special characters.
  • Date/Time Format: Defines the target format (e.g., YYYY-MM-DD) and provides optional source hints.
  • Timezone: Standardizes timestamps to a specific zone (e.g., UTC or EST).
  • Range: Sets minimum and maximum numerical boundaries.
  • Decimal Precision: Hard-stops float values to a specific number of decimal places.
  • Allowed Values (Enum): Limits accepted values to a comma-separated list.

Once all column rules are configured, click Save & Finish to register your schema in the system.

Validation Rules workspace showing numeric bounds and standard rule toggles.
Configuring per-column validation rules and range constraints to guard data integrity.
3.2

The AI Discovery & Planning Phase (Data Migration)

When you associate a Target Schema with an active project workflow, Elvity does not immediately run the migration. Instead, the autonomous AI Data Migration Engine initiates a formal Discovery & Planning phase.

How AI Discovery Works

  • Structured Feeds: If spreadsheets are provided, the AI identifies anchor columns and structures a mapping strategy. When multi-sheet Excel files are uploaded, the system automatically inspects each worksheet, identifies candidate sheets matching your schema, or prompts you to pick the exact sheet.
  • Unstructured Feeds (PDFs/Images): If no spreadsheet is provided, the AI analyzes document metadata and automatically groups matching files (e.g., multi-page contracts, invoices) into logical rows.
  • Enum & Constraint Enforcement: When your target schema specifies allowed values (Enum), the AI restricts document extraction to valid choices, preventing formatting deviations during data migration.
  • Lineage Mandate: The AI maps extraction variables so that every value can be traced back to its precise source position via deep visual OCR extraction and structure-flattening tools.

Reviewing the On-Screen Data Plan

The AI writes its proposed mapping strategy directly to the workspace, which renders automatically inside your active workflow screen. Always review this plan thoroughly before running your data.

AI Data Migration Engine displaying mapping plan and verification safeguards.
Review the AI mapping plan and unique identifier configuration before executing.

1. Unique Identifier — lists the primary key columns (e.g., customer_id, product_id) the AI will use to track and validate rows.

markdown
## 1. Unique Identifier
[
  "customer_id",
  "product_id"
]

2. Target Schema Columns Strategy Table — a comprehensive table detailing exactly where your target columns are coming from and how they will be transformed.

Column_NameStrategy
First_NameExtract from source field F_NAME if available, else fallback to PDF extraction
Yrs_ExperienceParse from PDF extraction field YRS_EXP, convert string “N/A” to 0
Total_PriceCalculated field: Unit_Price * Quantity (calculations)
Vendor_NameRelational lookup from external vendor cross-reference table

3. Notes — caveats, structural mismatches, or questions (e.g., “PDF invoices contain multiple line items, while the target schema expects single flat rows. Proposing unrolling.”).

Systemic Alignment vs. Localized Discrepancies
The mapping plan focuses strictly on structural alignment (ensuring columns and data relationships exist). Minor field inconsistencies, missing values, or localized formatting cleanups are intentionally handled during the interactive batch processing stage.
3.3

Course Correction & Approving the Plan

The earlier you catch a problem, the better. You have full control over the AI’s execution plan before any data enters the migration pipeline.

Modifying the Strategy

  1. 1Open the AI Assistant panel on the right side of the screen.
  2. 2If any mapping or calculation rule is incorrect, instruct the Assistant in plain English:
    • “Don’t calculate Total_Price; take it directly from the ‘Unit_Cost’ column in the CSV.”
    • “The unique identifier should be invoice_id, not customer_id.”
  3. 3The Assistant will update the underlying migration mapping strategy, update the on-screen data plan, and refresh the rendered workspace.

Final Approval & Interactive Action Buttons

The AI will hold execution until you give explicit consent. Alongside its status updates, the assistant displays interactive action buttons directly in the user interface:

  1. 1Interactive “Approve” Button: Click the Approve button displayed next to the AI’s message (or type “Plan approved” / “Proceed with batch”).
  2. 2“Open Setup Panel” / “Open Error Panel”: If the AI recommends reviewing data sources or inspecting schema settings, click the corresponding action button to immediately jump to that workspace panel.
  3. 3Once approved, the AI locks the mapping strategy and initiates the batch processing engine to begin validating and processing your data in isolated batches.
AI Assistant interactive action buttons allowing one-click approval and panel navigation.
Interactive proposal buttons in the AI Assistant enable seamless one-click approvals.

Ready to put this into practice?

Spin up your first pipeline and watch Elvity map your data in minutes.