Clarity Partners is working with an industry leading Fintech business with offices across Perth, Melbourne, Brisbane and Sydney.
They are in search of an experienced Data Engineer to join the team.
They are looking for someone who is truly passionate about tech and data.
The ideal candidate; demonstrates their capabilities through personal projects (not just university projects), has commercial quality coding standards, is a team player and strong interpersonal skills.
Responsibilities: Design, Build, and Maintain Data Pipelinesusing AWS services, dbt, and Python.
Integrate diverse data sources into centralized data warehouses or data lakes.
Utilize dbt to develop and manage data models, ensuring data is organized, clean, and ready for analysis.
Implement and manage data storage solutions using Delta Lake to ensure data integrity, reliability, and efficient access.
Design and implement real-time data streaming and processing solutions using Elasticsearch for high-performance data retrieval and analysis.
Write efficient, reusable Python scripts to automate data processing tasks, improving workflow efficiency and reducing manual intervention.
Collaborate with data scientists, analysts, and other stakeholders to ensure data availability and usability, enabling data-driven decision-making across the organization.
Background & Qualifications: Educational Background: Degree in Mathematics, Statistics, Computer Science, Data Science, Engineering, IT, or a related field.
Technical Skills: Advanced knowledge of dbt: Proficient in using dbt for data modeling, transformation, and pipeline management.
Cloud Platforms: Extensive experience with AWS (or other cloud platforms) for building and maintaining scalable data infrastructures.
Programming: Strong proficiency in Python for scripting and automation in data engineering tasks.
Data Storage & Processing: Expertise in working with Delta Lake for efficient data storage solutions.
Search and Analytics: Experience with Elasticsearch for real-time data processing and analytics.
Desirable Skills: Programming: Knowledge of Java for backend development.
Databases: Familiarity with Oracle and SQL Server for database management.
Frontend Development: Experience with React.js for building user interfaces and dashboards.
Soft Skills: Interpersonal Skills: Strong interpersonal skills with the ability to communicate complex technical concepts to both technical and non-technical stakeholders.
Communication: Ability to effectively collaborate across various teams and departments to align on project goals and data needs.
Industry Knowledge: A good understanding of the finance and fintech space, with the ability to apply data engineering solutions within this domain.
Passion: A demonstrated passion for data science, machine learning, AI, and data engineering, with a commitment to continuous learning and professional development.
**Note - Must be based in Perth, Western Australia, with the ability to work onsite as required.
To apply, please follow the link or reach out to Phoebe Weston-Selby on 0485 931 151 or or #J-18808-Ljbffr