+2 more
Clear All Filters
Verified Ad
Job Summary
Key Responsibilities:
- Build, optimise, and maintain scalable data pipelines using Databricks and Apache Spark
- Design and implement end-to-end data workflows and CI/CD processes
- Collaborate with cross-functional teams to deliver high-quality data solutions
- Ensure data quality, reliability, and performance across pipelines
- Contribute to architecture decisions and continuously improve existing systems
Job Experience and Skills Required:
Education:
- Relevant tertiary qualification in IT, Computer Science, Data Engineering, or related field
Experience:
- 3–5 years’ experience in data engineering
- Proven experience working with Databricks and big data tools
- Strong experience with Apache Spark and cluster computing
- Background in backend development with solid software engineering fundamentals
- Experience building and maintaining CI/CD pipelines
- Exposure to Azure cloud services and infrastructure
- Experience working with Medallion Architecture and/or Microsoft Fabric
- Must have experience building robust, production-grade pipelines (not just maintenance)
Skills:
- Strong Python (including PySpark) and SQL experience
- Solid understanding of end-to-end data flow design
- Strong attention to detail with a focus on data quality
- Excellent communication and collaboration skills
- Familiarity with Agile methodologies
- Growth mindset with the ability to continuously learn and apply new technologies
Apply now!
For more exciting IT vacancies, please visit: https://www.networkrecruitmentinternational.com/
I also specialise in recruiting in the following:
Data Engineer
Software developer
Data Analyst
Infrastructure
Architecture
... and more!
If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles / positions.
- Build, optimise, and maintain scalable data pipelines using Databricks and Apache Spark
- Design and implement end-to-end data workflows and CI/CD processes
- Collaborate with cross-functional teams to deliver high-quality data solutions
- Ensure data quality, reliability, and performance across pipelines
- Contribute to architecture decisions and continuously improve existing systems
Job Experience and Skills Required:
Education:
- Relevant tertiary qualification in IT, Computer Science, Data Engineering, or related field
Experience:
- 3–5 years’ experience in data engineering
- Proven experience working with Databricks and big data tools
- Strong experience with Apache Spark and cluster computing
- Background in backend development with solid software engineering fundamentals
- Experience building and maintaining CI/CD pipelines
- Exposure to Azure cloud services and infrastructure
- Experience working with Medallion Architecture and/or Microsoft Fabric
- Must have experience building robust, production-grade pipelines (not just maintenance)
Skills:
- Strong Python (including PySpark) and SQL experience
- Solid understanding of end-to-end data flow design
- Strong attention to detail with a focus on data quality
- Excellent communication and collaboration skills
- Familiarity with Agile methodologies
- Growth mindset with the ability to continuously learn and apply new technologies
Apply now!
For more exciting IT vacancies, please visit: https://www.networkrecruitmentinternational.com/
I also specialise in recruiting in the following:
Data Engineer
Software developer
Data Analyst
Infrastructure
Architecture
... and more!
If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles / positions.
Network Finance
Recruiter
Error!
Success!
You have successfully created your alert.
You will receive an email when a new job matching your criteria is posted.
Please check your email. It looks like you haven't verified your account yet. Here's what you're missing out on:
- Response from employers
- Being able to log in and update your profile
- Apply for more jobs
Didn't receive the link? Resend Verification Link