This badge was issued to Jeroen van Hoof on 05 Jun 2020.
4213 - Automating Data Pipelines - 2020
Issued by
GAIn® - The Global AI network
Automating your data pipeline ensures its speed and quality. This two-day module will teach you how to design a data pipeline that you can apply to all work which involves processing data. We will cover everything from the basics of creating automatable data pipelines, to orchestrating scripts and monitoring an automated data pipeline. You will learn the management of data pipelines including the why, when, and how of making code idempotent and improving scripts.
Skills
Earning Criteria
-
Design data pipelines – Based on design and data flow requirements for E2E AI solution.
-
Orchestrate scripts – Automate data pipelines and define requirements from each component.
-
Write automatable code – Change and improve scripts to make them automatable.
-
Manage quality of automated data pipelines – Define components to monitor data pipeline quality and plan how to act on irregularities.
-
Exam