Data Engineere

XPT Software Australia Pty Ltd
- Melbourne, VIC
IT
Source:
uWorkin
JOB DESCRIPTION
Requirements
6+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
Expertise with big data technologies
Solid understanding of batch and streaming data processing techniques.
Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
Familiarity with Agile methodologies.
Proven experience as a Data Engineer in a large enterprise environment.
Background in data warehouse design (e.g. dimensional modelling) and data mining
In-depth understanding of database management systems, online analytical processing (OLAP) and ETL framework
Knowledge of SQL queries, SQL Server Reporting Services (SSRS) and SQL Server Integration Services (SSIS)
Expertise in SQL and Data Warehousing on Cloud – Redshift and Databricks
Data transformation and ELT experience using DBT
Programming languages – Python and Pyspark
DevOps – Bitbucket and Jenkins
Orchestration – Control-M
Expertise with big data technologies and Fivetran is nice to have
Promote local employment to your region, community or member organisation with a uWorkin Talent Community. Find out more .
#J-18808-Ljbffr