Analytics

Notes from building analytics platforms.

Data Engineering

• Structuring Jobs
• Partition Testing
• Spark Pipelines
• Pandas and PySpark Dataframes

Databricks

• Production Architecture
• Databricks Connect
• Uploading Application Code

Airflow

• Commands