Entity:

Technology

Job Family Group:

IT&S Group

Job Description:

You will work with

You will join our Digital Trading Analytics department, supporting the Trading Analytics & Insights (TA&I) organisation. This is a high-performing, global team that collaborates closely with traders, trading analysts, business analysts, and engineers to deliver data-driven insights for energy trading. You will lead and mentor a team of data engineers, working in an Agile environment (Kanban/Scrum) and using tools such as Azure DevOps for planning and tracking work. You will also collaborate across borders and time zones to deliver strategic data solutions.

Let me tell you about the role

As a Senior Enterprise Technology Engineer, you will provide technical leadership and strategic direction for building highly scalable and efficient data pipelines. You will design and implement advanced data solutions, optimise performance, and ensure seamless integration across systems. This role combines hands-on engineering with leadership responsibilities, including mentoring team members and driving best practices in data engineering. You will play a critical role in enabling reliable, high-quality data solutions that support trading operations and business intelligence.

What you will deliver

• Design, develop, and implement highly scalable data pipelines using advanced Python (including Pandas, web scraping, and machine learning libraries), SQL, and Apache Airflow.
• Lead ETL processes for large and complex datasets, including time-series data from APIs, databases, and real-time streams.
• Leverage AWS cloud services (S3, Redshift, EC2, Lambda) to build and manage secure, cost-effective data solutions.
• Use Databricks for large-scale data processing and advanced analytics.
• Create compelling data visualisations using tools such as Tableau and Power BI to communicate insights effectively.
• Mentor and coach a team of 3–4 data engineers, fostering a culture of knowledge sharing and continuous learning.
• Drive adoption of Agile methodologies and utilise Azure DevOps for planning and delivery.
• Champion automation and best practices to improve reliability and efficiency.
• Maintain clear technical documentation for pipelines and processes to ensure maintainability and knowledge transfer.

What you will need to be successful (experience and qualifications)

• 7+ years of experience in a Data Engineering role, with proven success in leading and mentoring teams.
• Expertise in Python (Pandas, web scraping libraries like Selenium, Beautiful Soup, Requests, and machine learning libraries such as TensorFlow, PyTorch).
• Advanced SQL skills, including optimisation techniques, and strong experience with relational databases.
• Extensive experience designing and building large-scale, efficient data pipelines for complex and time-series data.
• Proven experience with Apache Airflow for orchestration and scheduling at scale.
• Strong knowledge of AWS cloud services (S3, Redshift, EC2, Lambda).
• Experience with Databricks and advanced data visualisation tools (Tableau, Power BI).
• Comfortable working in Linux environments and proficient with Git version control.
• Excellent communication skills with the ability to present complex concepts to technical and non-technical audiences.
• Demonstrated ability to work in a global environment and build strong relationships across teams.
• Highly responsible, self-motivated, and adaptable in fast-paced environments.
• Strong organisational skills and a passion for automation and continuous improvement.
• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a numerate discipline.

About bp

Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner!

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Travel Requirement

No travel is expected with this role

Relocation Assistance:

This role is eligible for relocation within country

Remote Type:

This position is a hybrid of office/remote working

Skills:

Agility core practices, Agility core practices, Analytics, API and platform design, Business Analysis, Cloud Platforms, Coaching, Communication, Configuration management and release, Continuous deployment and release, Data Structures and Algorithms (Inactive), Digital Project Management, Documentation and knowledge sharing, Facilitation, Information Security, iOS and Android development, Mentoring, Metrics definition and instrumentation, NoSql data modelling, Relational Data Modelling, Risk Management, Scripting, Service operations and resiliency, Software Design and Development, Source control and code management {+ 4 more}

Legal Disclaimer:

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.

If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.