Data Pipelines IntroductionData pipelines are sets of processes that move and transform data from different sources to a specific destination, […] August 11, 2023 in Data Engineering tagged data / engineering / pipeline by Mike
History of Data EngineeringIn the early 2010s, we had huge increases in data volumes, velocity, and variety leading to the term […] August 10, 2023 in Data Engineering tagged data / history / engineering / DBA by Mike
Data Engineering IntroductionData engineering is the practice of designing and building systems for collecting, storing, and analyzing data. It’s about […] August 10, 2023 in Data Engineering tagged overview / data / introduction / engineering / ETL by Mike
Metadata IntroductionWhat is metadata? Wikipedia says the following about Metadata: “Metadata is “data [information] that provides information about other […] January 28, 2017 in Data Engineering tagged data / metadata / lake / warehouse / Data by Mike