Job Summary
PBT Group is seeking an experienced Senior Data Engineer with strong AWS and Databricks expertise to join a data-focused team. The successful candidate will design, build and optimise scalable data pipelines and platforms that support analytics, reporting and advanced data use cases.
Short-term insurance domain experience is a strong advantage.
Key Responsibilities
Design, develop and maintain robust, scalable data pipelines using AWS and Databricks
Build and optimise ETL/ELT processes for structured and unstructured data
Implement and manage data lakehouse architectures (including Medallion or similar layered approaches)
Ensure data quality, reliability, performance and governance across pipelines
Collaborate with data scientists, analysts, architects and business stakeholders
Contribute to technical design, documentation and best practices
Support production deployments, monitoring and troubleshooting of data solutions
Mentor junior engineers and contribute to continuous improvement of the data platform
Required Skills & Experience
Solid experience as a Senior Data Engineer
Strong hands-on experience with AWS (S3, Glue, Lambda, EMR, Redshift, IAM, or equivalent services)
Strong hands-on experience with Databricks (including Spark, Delta Lake, notebooks, jobs and Unity Catalog)
Proficiency in Python and SQL
Experience with data modelling, data quality frameworks and pipeline orchestration
Familiarity with CI/CD, Git and DevOps practices for data solutions
Ability to work in Agile environments and collaborate effectively with cross-functional teams
Strong problem-solving and communication skills
Advantageous
Short-term insurance or financial services domain experience
Experience with other cloud platforms or modern data tools (e.g. dbt, Airflow, Kafka)
Knowledge of data governance, security and cost optimisation on AWS
Databricks certifications
Error!
Success!
You have successfully created your alert.
You will receive an email when a new job matching your criteria is posted.
Please check your email. It looks like you haven't verified your account yet. Here's what you're missing out on:
- Response from employers
- Being able to log in and update your profile
- Apply for more jobs
Didn't receive the link? Resend Verification Link