The Role
We are seeking an experienced Data Engineer or Senior Data Engineer to design, implement, and maintain data solutions using Microsoft Fabric and related technologies. The ideal candidate will bridge the gap between business needs and technical solutions, working within an Agile framework to deliver scalable data platforms.
Key Responsibilities
- Lead the design and implementation of end-to-end data pipelines using Microsoft Fabric, ensuring optimal performance, scalability, and reliability of data infrastructure
- Develop and maintain data transformation processes using Python, implementing best practices for code quality and documentation
- Architect and implement solutions using Microsoft Fabric, creating efficient data warehousing, lakehouse, and analytics solutions
- Collaborate with cross-functional teams using Agile/Scrum methodologies, participating in sprint planning, daily stand-ups, and retrospectives
- Design and implement data quality frameworks and monitoring solutions to ensure data accuracy and reliability
- Mentor junior engineers and contribute to technical decision-making processes
- Optimize existing data pipelines and implement automation solutions for improved efficiency
Required Qualifications & Experience
- Bachelor's degree in Computer Science, Engineering, or related field
- 5+ years of experience in data engineering roles
- Strong expertise in Microsoft Fabric, including Data Factory, Synapse Analytics, and Power BI
- Advanced Python programming skills with experience in data processing libraries (pandas, numpy, pyspark)
- Proven experience with Azure Synapse Analytics, including SQL pools and Spark pools
- Strong understanding of data warehousing concepts and dimensional modelling
- Experience working in Agile environments with Scrum methodology
- Excellent understanding of CI/CD pipelines and DevOps practices
- Strong SQL skills and experience with large-scale data processing
Preferred Qualifications & Experience
- Experience with Databricks and Delta Lake architecture
- Knowledge of data governance and security best practices
- Microsoft Fabric Data Engineer certification and/or Azure Data Engineer Associate certification
- Experience with real-time data processing and streaming technologies
- Familiarity with Infrastructure as Code (IaC) tools
- Experience with version control systems (Git) and collaborative development
- Experience with Generative AI and Large Language Models integration
Technical Skills
- Cloud Platforms: Microsoft Azure, Microsoft Fabric
- Data Processing: Azure Synapse Analytics, Python, SQL
- ETL/ELT Tools: Azure Data Factory, Synapse Pipelines
- Version Control: Git
- Methodologies: Agile, Scrum
- Optional: Databricks, Apache Spark, Generative AI
Soft Skills
- Strong problem-solving and analytical thinking abilities
- Excellent communication and collaboration skills
- Ability to work independently and as part of a team
- Strong project management and organizational skills
- Adaptability and willingness to learn new technologies
Impact and Growth
- Drive innovation in data engineering practices and architectural decisions
- Contribute to the organization's data strategy and technical roadmap
- Opportunity to work with cutting-edge technologies in the Microsoft ecosystem
- Lead technical initiatives and mentor team members
About Tridant
Tridant Pty Ltd is one of Australia's largest specialist consulting firms focused on designing and implementing Financial Performance Management, BI, Financial Reporting, Data Visualisation, Predictive Analytics and Information Management solutions, for both public and private sector organisations throughout Asia Pacific. We partner with multiple market leading technologies to deliver the best solution to our clients.
Our expertise spans a number of market sectors including: Financial Services, Mining, Retail, Education, Media & Entertainment, Oil and Gas, Government and Communications.
We operate from multiple locations across Australia and Singapore. Our consulting team is home to a number of the most experienced and respected consultants, who have implemented solutions across Australia, New Zealand, Singapore and many other countries.
Since our founding in 2007, Tridant has earned an enviable reputation for delivering some of the largest and most successful IT projects in Australia. Our collegiate culture sets us apart from others in our industry, as does the diversity and quality of our people.
Why Tridant
Our company offers a unique culture second to none; our ethos is that we are professional, but we make work an enjoyable experience. Tridant offer a collegiate team environment that embraces diversity and allows our staff the opportunity to grow independently in a supportive environment.
Our team are offered a flexible working arrangements, ongoing learning and development opportunities as well as access to an Employee Assistance Program.
What makes Tridant different? Our culture; our people; access to the leadership team; and the ability to make an impact.
This is a fantastic opportunity to join a reputable, fast-growing company where there is a wealth of opportunity for the right candidate.
If you fill the required selection criteria and hold appropriate work rights, we invite you to apply for this role.
