Gen AI

1. Data Collection (Data Lake): All data from different systems (like Finance or Banking apps) is stored in one place, called a Data Lake.

2. AI Proposes Data Quality Rules: Gen AI automatically looks at the data and suggests Data Quality Rules based on patterns.

  • Examples of rules:

    • No empty fields for important data like Customer ID.

    • Dates must be in the right format (e.g., YYYY-MM-DD).

    • Transactions over $1M need approvals.

3. Validation with Business Teams: The Data Team and Business Owners review the suggested rules. They approve or adjust rules to match business needs.

4. Apply Rules to Data: The agreed rules are applied to the data in the Data Lake.

  • Results are stored in a table showing:

    • Which rules passed or failed

    • What and why certain records failed

5. Visualize in Tableau: Tableau connects to the results table. (See Data Governance Dashboard)

Previous
Previous

Diversity, Equity, Inclusion Analysis