Data Engineere

XPT Software Australia Pty Ltd - Melbourne, VIC ITSource: u Workin JOB DESCRIPTION Requirements 6+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
Expertise with big data technologies Solid understanding of batch and streaming data processing techniques.
Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
Familiarity with Agile methodologies.
Proven experience as a Data Engineer in a large enterprise environment.
Background in data warehouse design (e.g.
dimensional modelling) and data mining In-depth understanding of database management systems, online analytical processing (OLAP) and ETL framework Knowledge of SQL queries, SQL Server Reporting Services (SSRS) and SQL Server Integration Services (SSIS)Expertise in SQL and Data Warehousing on Cloud – Redshift and Databricks Data transformation and ELT experience using DBTProgramming languages – Python and Pyspark Dev Ops – Bitbucket and Jenkins Orchestration – Control-MExpertise with big data technologies and Fivetran is nice to have Promote local employment to your region, community or member organisation with a u Workin Talent Community.
Find out more.#J-18808-Ljbffr