Gen AI
1. Data Collection (Data Lake): All data from different systems (like Finance or Banking apps) is stored in one place, called a Data Lake.
2. AI Proposes Data Quality Rules: Gen AI automatically looks at the data and suggests Data Quality Rules based on patterns.
Examples of rules:
No empty fields for important data like Customer ID.
Dates must be in the right format (e.g.,
YYYY-MM-DD
).Transactions over $1M need approvals.
3. Validation with Business Teams: The Data Team and Business Owners review the suggested rules. They approve or adjust rules to match business needs.
4. Apply Rules to Data: The agreed rules are applied to the data in the Data Lake.
Results are stored in a table showing:
Which rules passed or failed
What and why certain records failed
5. Visualize in Tableau: Tableau connects to the results table. (See Data Governance Dashboard)