Introduction to Data Engineering: Store, Extract, and Organise Your Data

Companies are generating a lot of data everyday. However, it's not always simple or straightforward to grasp the narrative the data tells, which is why many firms rely on data engineering.

Data engineering is the process of developing systems that enable users to gather and analyse unstructured data from various sources and forms. These technologies enable users to discover useful data applications that firms may employ to succeed.

Data engineers create things from scratch. They plan and construct pipelines that convert and interpret data such that it is highly useable when it is received by data scientists or other end users. These pipelines are required to gather data from several unrelated sources and combine it with data from other sources into a single warehouse that acts as a single source of truth for all the data.

This one-day data engineering course provides you with a high-level overview of data engineering with no technical details or jargon. You will explore the big data ecosystem, data pipelines, data architecture, data infrastructure, and data warehouse management. By the end of the course, you will walk away with a comprehensive understanding of data engineering tasks, tools, challenges and needs.

*Learners should have an internet-enabled laptop for this course.

• Define and understand the value of company data
• Introduce the concept of data engineering
• Understand how to convert data using data pipelines
• Frameworks for data infrastructure and data warehouse
• Requirements, challenges & opportunities for data engineering
• Use of technology for data engineering

• Professionals and individuals who seek to understand how data engineering can be used to streamline data flow processes to generate useable and trustworthy data pipelines to generate value
• Beginners with no background in coding, programming, or computer science

"The instructor is patient and clear in his explanation. He uses useful and easy-to-understand examples to illustrate his points."

– Sylvia Sim, Senior Manager (Strategic Engagement), Elections Department

"The trainer provided good references to real-life scenarios. Understanding various data concepts was the key takeaway for this course."

– Peh Jun Zhong, Vice President, GIC Pte Ltd

"Dwight is knowledgeable and gave useful examples to aid in understanding. I have learnt what data engineering is and the important concepts/ keywords in data engineering."

– Norliza Bte Mohamed Gasaly

Dwight Fonseka is the Head Data Analyst at Plano, the world’s first science-based parental control application and an Adjunct Lecturer at the London School of Business and Finance. His interest in the area of data developed sometime in 2014 when he ventured into data analytics and database management. 7 years later, he has achieved an impressive skill set in data. This includes advanced statistics, big data analytics, cloud computing, neural networks, R programming, python programming, business analytics, data storytelling, and more. Dwight has a Masters in Education (Curriculum & Teaching), a Microsoft Certificate of Achievement (SQL), and an Advanced Certificate in Learning and Performance (ACLP).