Data Engineering

Data Engineering refers to the design & construction of systems that collect and process large quantities of data. Data Engineering is often involved in the entire data pipeline:

• Designing the proper data collection methodologies
• Building data storage systems
• Deploying the appropriate extraction & transformation infrastructure

This process is often referred to as ETL: Extract, Transform, Load.

This section will discuss content related to data collection, data warehousing, data storage & organization, data extraction, data pipeline design, ETL process design, and the various tools used in Data Engineering.