Octopus Energy

Senior Data Engineer

London · hybrid · Salary not listed

Role overview

Acting as the flexibility team's first full-time data engineer, establish the team's data
Upskill data-literate backend engineers, act as the team's data expert and as a multiplier on other
Establish greenfield data engineering systems in a newly established AWS environment
Provide a foundational layer of high quality data processing and warehousing that will enable
Maintain and develop critical data applications - scoping and implementing architectural
Interface with the established data warehouse, built on Databricks

Strong aptitude with SQL, Python and AWS data stack
Experience building efficient, scalable databases and APIs (e.g. Django, FastAPI)
Experience in Kubernetes, Docker, Spark and related monitoring tools (e.g. DataDog, Grafana
Experience with Airflow
Experience with dbt for pipeline modelling
Skilled at shaping needs into a solid set of requirements and designing scalable solutions

DockerAWSSQLPythonDjangoKubernetesSparkFastAPIData