The Role

The Senior Data Engineer will design, build, and maintain robust, scalable, and secure data pipelines and platform that enable Transport for Wales'(TfW) to make data-driven decisions.

Role responsibilities

• Drive the provision of a resilient and future-ready data platform that underpins organisational growth, supports cross-functional analytics, and enables data-driven decision-making by developing and deploying scalable data pipelines leveraging a Microsoft Azure-first approach, utilising tools such as Fabric, Data Factory, Databricks, and Synapse Analytics to ensure workflows are modular, testable, and well-governed
• Implement robust data management practices focused on data domains, quality, and lineage by integrating data from multiple internal and external sources into a cohesive system to ensure that data is comprehensive, accurate, and traceable, supporting reliable business analysis and reporting.
• Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource-efficient data processing, meeting the organisation's evolving analytical and operational demands.
• Transform raw data into meaningful insights by developing and maintaining tailored ETL (Extract, Transform, Load) processes enabling customised processes, empowering stakeholders to make informed decisions based on high-quality, processed information.
• Safeguard organisational data by developing and enforcing data engineering and enterprise cloud standards, creating comprehensive guidelines and frameworks to ensure all solutions adhere to security, privacy, and compliance regulations such as GDPR.
• Work closely with data analysts, architects, DevOps, and business stakeholders through regular communication and collaborative planning to ensure data solutions are closely aligned with business objectives and effectively meet user needs.
• Continuously monitor and optimise the performance of data systems by tracking system health, resolving issues, and enhancing availability to guarantee uninterrupted data access and maintains high operational standards across the organisation.
• Contribute to the development and execution of the Data Strategy by maintaining thorough documentation of data processes, architectures, and workflows to ensure all technical and process information is systematically recorded, updated and data initiatives deliver business value and are aligned with broader technology and organisational goals.

Who we're looking for

• Degree or MSc in Computer/Data Science or Data Engineering or equivalent experience in data engineering, data management, or a related field.
• Proven experience in designing, building, and maintaining data pipelines using tools such as Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles.
• Experience of using programming languages such as Python, Scala and SQL and of data transformation, testing, and automation.
• Demonstrable knowledge of data modelling (star/snowflake schemas, dimensional models) and data warehousing within platforms such as Azure Synapse Analytics.
• Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud-based architectures.
• Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative data delivery.
• Robust understanding of data governance, data quality, and metadata management, aligned to DDaT and UK Government Data Standards.
• Demonstrable experience of analysing complex data sets and deriving actionable insights.
• Experience of communicating technical information and data to a non technical audience and working collaboratively with analysts, architects, and product owners to deliver data solutions that meet user and organisational needs.

Welsh Language Skills

(Change to suit each role whether Welsh Language Skills are essential or desirable)

While not essential for this role, Welsh language skills would make a great addition to your application.

TfW support anyone who wants to learn Welsh or improve their skills. We offer online learning, classroom courses and funding attendance at local community courses.

Equal Opportunities

We're changing the way the transport industry looks. By celebrating and embracing differences, we're building a workforce that represents Wales. We need talented people from all backgrounds and cultures to bring their perspectives and experiences. Diverse teams make better decisions and drive innovation. Join us in transforming the way Wales travels."

Who we are 

Transport for Wales is changing the way Wales travels, making sustainable transport the first choice. We're building a multimodal integrated transport network called the T Network, making it easier for people to travel by train, bus, walking, wheeling and cycling.

Next steps

See attached Job Description for further details and how to apply. If you want to find out more about what we're doing in Wales, see our Annual Report.

We're a Disability Confident Leader. Let us know about  any reasonable adjustments you may need in the recruitment process and as part of the role if you are successful.

This advert will close at 23:59 on the day of the application closing date stated above. However, we reserve the right to close this vacancy early if we receive enough applications. We encourage you to submit your application as early as possible.