Data Architect

Lesson 1: Enterprise Data Architecture  

• Understand the importance of data architecture in any organisation  
• Learn the benefits of executing a data architecture  
• Learn the business and technical artefacts required  
• Understand business and functional requirements  
• Learn how OLTP, ODS, and OLAP models are being designed  

Lesson 2: Staging Data  

• Build staging areas for data ingestion  
• Learn to organise data assets based on schemes  
• Designing schedules for data processing based on the requirements  
• Learn to manage staging area through metadata 

Lesson 3: Operational Data Store  

• Build an integrated ER model connecting distributed data assets  
• Learn to design data dictionary and master data  
• Apply normalisation rules to eliminate redundancies  
• Learn when to use ETL vs ELT techniques 
• Learn to cleanse data anomalies  

Lesson 4: Data Warehouse  

• Learn two OLAP modelling designs – Star and Snowflake schemas  
• Learn various dimensional and fact table types  
• Build ELT data processing from ODS to data warehouse  
• Write SQL queries for the purpose of reporting 

Lesson 1: Characteristics of Big Data  

• Explain what “big data” is  
• Articulate the business value of big data  
• Describe the characteristics of big data  
• Distinguish between horizontal scaling vs vertical scaling  
• Describe the components of big data ecosystem  

Lesson 2:  Ingestion, Storage and Processing Frameworks  

• Explain how distributed storage works in HDFS  
• Explain how distributed processing works  
• Explain how resources are managed in a Hadoop cluster  
• Distinguish between different distributed processing frameworks  
• Apply frameworks to appropriate use cases  

Lesson 3: NoSQL Databases  

• Explain the difference between SQL and NoSQL databases  
• Explain how distributed processing works  
• Explain how resources are managed in Hadoop cluster  
• Distinguish between different distributed processing frameworks  
• Apply frameworks to appropriate use cases  

Lesson 4: Scalable Data Lake Architecture 

• Explain data lakes and their business value  
• Distinguish between different data formats and their applications  
• Articulate data lake design patterns and challenges  
• Explain how to enable transactional capabilities in data lakes 

Lesson 1: Introduction to Data Governance  

• Understand data governance and its importance  
• Learn about the different disciplines of data governance  
• Understand the different stakeholders involved in data governance projects  

Lesson 2: Metadata management  

• Understand the different types of metadata  
• Understand the components and capabilities of metadata management systems  
• Create conceptual and logical enterprise data models  
• Create an enterprise data catalogue 

Lesson 3: Data Quality Management  

• Perform data profiling using various techniques using data quality dimensions  
• Identify remediation options for data quality issues 
• Measure data quality using data quality scores and thresholds  
• Monitor data quality using dashboards, exception and trend reports  

Lesson 4: Master Data Management  

• Understand the concepts of master data and golden record  
• Understand different types of master data management architectures  
• Create a golden record using various match and merge techniques  
• Understand data governance processes for authoring, monitoring, and approval of master data