Data Engineer
Tasks
- Build data pipelines with APIs and databases
- Define data documentation
- Define data mappings
- Develop dashboards and reports
- Execute ETL data migration
- Implement CI/CD with Azure DevOps
- Maintain data lineage
- Maintain data transformation rules
- Perform data cleansing
- Perform data profiling
- Perform post load reconciliation
- Support data validation during mock loads
- Validate migrated data
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Data Cleansing | Data Factory | Data Lineage | Data Mapping | Data Reconciliation | Data Validation | Data profiling | Databricks | ETL | Power BI | PySpark | Python | SQL
Education
N/A
Roles
Related jobs
-
Data Engineer AUD 85K-120KAttribution | BigQuery | Cohort Analysis | Dashboarding | Data LayerFlexible work environment | Learning and training budget | Snacks and drinks | Team eventsMid-level Full TimeBarangaroo, NSW, Australia11h ago
-
Data Engineer AUD 128K-128KAPIs | Azure | Cloud Storage | Data Governance | Data ModelingFlexible working hours | SuperannuationMid-level Full TimeMelbourne, Victoria, Australia1d ago
-
Data Engineer AUD 85K-120KAttribution Limitations | Attribution Modeling | BigQuery | Braze | Cohort AnalysisFlexible working environment | Learning and training budget | Snacks and drinks | Team eventsMid-level Full TimeBarangaroo, NSW, Australia1d ago
-
Senior Data Engineer (Talend & Snowflake) AUD 100K-150KAWS | Azure | Coalesce | Data Modeling | Data SecurityContract to extendSenior-level ContractSydney, New South Wales, Australia1d ago
-
Senior Data Engineer AUD 125K-144KAmazon Redshift | DBT | Data Modeling | Data Quality | Data ReliabilityAdditional leave | Catered breakfast | Flexible time off | Hybrid work | Learning and development budgetSenior-level Full TimeSydney, New South Wales, Australia1d ago
-
AI Engineer – GenAI Platforms & Applications AUD 119K-132KAI Services | AI orchestration | APIs | Agent Engineering | Azure AIMid-level Full TimeHead Office, Australia1d ago
-
AI Assisted Development | Anomaly Detection | Cloud Computing | Data Pipelines | Data QualityCoaching | Flexible work arrangements | Learning opportunities | Paid parental leave | Paid volunteering daysSenior-level Full TimeSydney, NSW, AU1d ago
-
Principal Data Engineer (AWS) AUD 145K-152KAWS | Airflow | Automated testing | CI/CD | EMRFlexible start and finish times | Flexible work arrangements | Flexible work locations | Job share | Part-time optionsSenior-level Full TimeSydney, NSW - CBP North, 1 …1d ago
-
Senior Robotics Software Engineer, Manipulation AUD 170K-205KC++ | Dynamics | Machine Learning | Motion Planning | Optimization401k matching | Dental insurance | Health insurance | Paid Holidays | Unlimited vacationSenior-level Full TimeCharlestown, MA2d ago
-
Senior Robotic Software Engineer, Navigation AUD 160K-224KA Star | Autonomous Recovery | Behavior Cloning | C++ | Collision Avoidance401k contribution | Dental insurance | Health insurance | Paid Holidays | Travel suppliesSenior-level Full TimeCharlestown, MA2d ago
-
AWS Glue | AWS Lake Formation | AWS Lambda | AWS Step Functions | Amazon AthenaAutonomy and ownership | Career growth | Collaborative global team | Flexible work culture | Fully remote workSenior-level Full TimeAustralia R3d ago
-
Senior/Tech Lead - AI Development AUD 150K-180KAI Foundry | AI Search | AWS Bedrock | Amazon SageMaker | Artificial IntelligenceChill-out spaces | Flexible hours | Professional development courses | Remote Working | Social eventsSenior-level Full TimeSydney, New South Wales, Australia3d ago
-
Forward Deployed Engineer III, Conversational AI AUD 149K-191KAPIs | Agent systems | Cloud platform | CrewAI | Data PipelinesSenior-level Full TimeSydney NSW, Australia; Docklands VIC, Australia3d ago
-
API Integration | Agentic Workflows | Conversational AI | Distributed Systems | End to EndFully remote | Global flexibility | High technical autonomy | Startup like iteration cyclesSenior-level Full TimeAustralia R4d ago
-
Senior Data Engineer AUD 150K-170KAccess Control | Audit Readiness | Automation | Backup/Restore | Cause analysisSenior-level Full TimeMelbourne, Victoria 3000, Australia4d ago
-
AI Developer AUD 120K-130KAI Governance | API Integration | Anthropic Claude | Authentication | Azure AIEmployee assistance program | Health and wellbeing programs | Ongoing training and development | Salary packaging benefits | School holidays childcare assistanceMid-level Full TimePerth, Perth CBD, Inner & Western …4d ago
-
Data Platform Engineer AUD 102K-140KAWS | Airflow | CI/CD | DBT | DagsterBirthday leave | Employee assistance program | Hybrid working | Learning and development budget | Meeting-free FridaysEntry-level Full TimeSydney (Hybrid) R4d ago
-
AWS CloudFormation | AWS Glue | AWS IAM | AWS Lake Formation | AWS LambdaCareer growth resources | Flexibility in work schedule | Mentorship | Training and certification opportunities | Work-life balanceSenior-level Full TimePerth, Western Australia, AUS4d ago
-
Staff Engineer, Deep Learning (R5180) AUD 140K-180K3D Reconstruction | C++ | Caffe | Camera Calibration | Computer VisionSenior-level Full TimeMelbourne4d ago
-
Senior-level Full TimeAU-NSW-Sydney4d ago
-
Research Software Engineer AUD 75K-90KC++ | Git | Jupyter | MATLAB | MatplotlibHybrid work | On-site attendanceEntry-level Full TimeSydney, AU R4d ago
-
Platform Engineer AUD 119K-150KAWS | CI/CD | Database performance | Database performance tuning | DockerFlu shots | Free counselling | Hackathons | Higher education sponsorship | Home workspace allowanceMid-level Full TimeSydney, NSW, Australia5d ago
-
Data and Analytics Engineer AUD 96K-119KCloud Data | Cloud Data Platforms | Data Architecture | Data Engineering | Data GovernanceCareer progression opportunities | Family-friendly policies | Flexible working arrangements | Generous leave entitlements | Professional development opportunitiesSenior-level Full TimeWollongong, NSW, Australia5d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Career growth opportunities | Remote-friendly work environment | Supportive teamMid-level Full TimeMelbourne, Australia5d ago
-
AI Solution Designer – Data & AI AUD 60K-140KAI Foundry | AI Search | API Integration | AWS Bedrock | AWS LambdaCareer breaks | Flexible hours | Flexible locations | Health and wellbeing initiatives | Learning and growth opportunitiesSenior-level Full TimeBrisbane, QLD, Australia5d ago