Senior Data Engineer
Sydney, New South Wales, Australia
Join our team of talented data engineers and take on the exciting challenge of designing, constructing, installing, testing, and maintaining highly scalable data management systems. Not only will you ensure our systems meet business requirements and adhere to industry practices, but you will also have the opportunity to integrate cutting-edge data management and software engineering technologies into our existing data structures. As a Senior Data Engineer, you will have the chance to mentor and guide junior data engineers, while ensuring data governance and security policies are followed. In addition, you will play a crucial role in monitoring the performance of our data processing systems to maintain optimal data accuracy. Embrace this opportunity to make a significant impact in the field of data engineering!
Key Responsibilities
- Design, construct, install, test, and maintain highly scalable data management systems.
- Ensure systems meet business requirements and industry practices.
- Integrate up-and-coming data management and software engineering technologies into existing data structures.
- Lead, mentor, and guide junior data engineers.
- Ensure compliance with data governance and security policies.
- Monitor the performance of data processing systems and data accuracy.
- Maintaining the Cl/CD system and code base as per the acceptable industry standard level
- Establish procedures to maintain a high QA standard
- Maintain the cloud architecture spread across multiple accounts
- Adopt new technologies while also using the expertise you have built on modern big data tools and cloud services
Requirements
- Bachelor's degree or higher in Computer Science, Engineering, or related field.
- At least 5 years of experience in data engineering with a proven track record of designing and implementing complex data solutions.
- Strong programming skills in Python, with experience in developing robust, maintainable, and scalable data processing pipelines.
- Hands-on experience with CI/CD systems, automating workflows, and integrating data quality checks into the deployment process.
- Extensive experience with cloud services, preferably AWS, including the use of AWS data services and an understanding of Snowflake as a data warehousing solution.
- Versatile in working with various forms of data infrastructure, adept at managing both streaming and batch data systems.
- Solid understanding of data modelling, ETL (Extract, Transform, Load) processes, and data warehousing principles, with a commitment to high data quality and accuracy.
Benefits
Fostering a collaborative, open environment that’s conducive to employee success is the #1 priority at TMGM.
- Growth Opportunities - We value your growth as much as we do ours, so we include educational and career growth opportunities at every level.
- People-First Values -We believe building a great company happens by hiring great people. Our employees’ job satisfaction always comes first.
- Shared Success - We offer revenue share opportunities for the right people, allowing our employees to share in company success.
- Worldwide Team - Our worldwide team means you’ll work with others from all over the globe and gain international experience.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture AWS Big Data CI/CD Computer Science Data governance Data management Data quality Data Warehousing Engineering ETL Pipelines Python Security Snowflake Streaming Testing
Perks/benefits: Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Intern jobs
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst Intern jobs
- Open Sr Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Data Engineering Manager jobs
- Open Junior Data Engineer jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open LLMs-related jobs
- Open APIs-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open Hadoop-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs