Senior Data Engineer - AWS(Kinesis/Lambda/MSK/Flink)
Tasks
- Automate infrastructure provisioning testing deployment and monitoring
- Build cloud-native data solutions on AWS
- Design ETL and ELT processes
- Design real-time event-driven data pipelines
- Develop CDC based and batch data pipelines
- Implement data quality governance security privacy and compliance controls
- Maintain CI/CD pipelines and infrastructure-as-code
- Optimize Snowflake data models queries and workloads
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon Web Services | Apache Flink | CI/CD | Change Data Capture | Data Capture | Data Ingestion | ELT | ETL | EventBridge | Git | Infrastructure as Code | Kinesis | MSK | Python | SQL | Snowflake | Step Functions | Web Services | “as-code”
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Graduate Data Engineer AUD 90K-93KData Governance | Data Pipelines | Data Quality | Data Security | GitHubBusiness rotations | Career pathways | Employee recognition training | Internal mobility | Learning and developmentEntry-level Contract Full Time2 Market Street, Sydney NSW 20003h ago
-
Senior AI Engineer AUD 121K-135KAWS Bedrock | AWS SageMaker | Amazon S3 | CI/CD | DockerCorporate discounts | Home office financial support | Hybrid work environment | In-house training | Leave optionsSenior-level Full TimeSydney, Australia1d ago
-
Principal Data Engineer AUD 146K-147KAWS | Bash | Cloud Architecture | Cloud Native | CronAccessibility support | Inclusive workplaceSenior-level Full TimeSydney, NSW - CBP North, 1 …1d ago
-
Data Engineer Analyst (Fabric, Power BI) AUD 76K-81KAzure Databricks | Azure Synapse | CI/CD | DAX | Data FactoryMid-level Full TimePerth, Exchange Tower, Australia1d ago
-
Data Engineer Consultant (Fabric, Power BI) AUD 76K-81KAzure Databricks | Azure Synapse | CI/CD | DAX | Data FactoryMid-level Full TimePerth, Exchange Tower, Australia1d ago
-
Embedded Software Engineer AUD 146K-185KARM | Automated testing | C# | C++ | Communications ProtocolsFlexible work arrangements | Free onsite parking | Gym access | Onsite Childcare Room | Staff eventsSenior-level Full TimeAustralia, Adelaide, AU1d ago
-
A/B | A/B Testing | B testing | Cost Optimization | Data PipelinesEquity packages | Flexible leave | Parental leave | Remote within Australia | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R1d ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLCross-functional collaboration | Fully remote work | Ownership over data reliability strategySenior-level Full TimeAustralia R1d ago
-
Senior Data Engineer AUD 116K-136KAWS | DBT | Data Modelling | DataOps | GitHubFlexible working arrangements | Hybrid workSenior-level Full TimeCity Campus, Australia2d ago
-
Data Engineer AUD 130K-140KAccess Control | Agile | Azure Data | Azure Data Factory | Data FactoryCareer growth opportunities | Employee discounts | Employee rewards | Supportive inclusive team | Wellbeing programsSenior-level Full TimeAustralia | SEQ | Brisbane - …2d ago
-
Senior Robotics Software Engineer USD 180K-200KC# | C++ | CAN | Concurrent programming | Design Patterns401k | Commuter benefits | Company-Paid Holidays | Dental insurance | Employer-paid life insuranceSenior-level Full TimeBrisbane, CA2d ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous work culture | Competitive compensation | Flexible management approach | Remote-friendly cultureMid-level Full TimeSydney, Australia3d ago
-
Specialist Solutions Architect AUD 145K-175KAWS | Anomaly Detection | Apache Spark | Azure | Change Data CaptureConference presentations | Continuous learning | Hackathons | Internal training | MentorshipSenior-level Full TimeSydney, Australia4d ago
-
BLE | Bare Metal | C++ | Coverity | DFMEA401k | Commuter benefits | Company-Paid Holidays | Dental insurance | Health coverageSenior-level Full TimeBrisbane, CA4d ago
-
Senior Databricks Consulting Engineer AUD 155K-200KAWS | Ansible | Apache Kafka | Apache NiFi | Apache SparkCertification support | Continuous learning support | Flexible working hours | Remote-friendly work environmentSenior-level Full TimeSydney, New South Wales, Australia4d ago
-
Senior Quantum Engineer - Quantum Processors USD 130K-184KCryogenics | Data Analysis | Dilution refrigerator | Electronics instrumentation | Hardware InterfacesMid-level Full TimeSan Sebastián, ES, London, UK, Sydney, …4d ago
-
Amazon Web Services | Apache Spark | Big Data | Data Analysis | HadoopRemote workSenior-level Full TimeSydney, NSW, Australia R4d ago
-
Senior Data Engineer, CX AUD 147K-185KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon BedrockSenior-level Full TimeAustralia4d ago
-
Embedded Software Engineer GBP 30K-34KAutomated testing | Bare Metal | Bluetooth | C# | C++Annual leave | Community and charity initiatives | Company pension | Cycle to work | Give as you earnMid-level Full TimeMelbourn, United Kingdom4d ago
-
Senior Data Engineer AUD 118K-125KAWS | Airbyte | Airflow | Athena | AzureFlexible work options | Give back day | Global wellness benefits | Virtual yoga or meditation sessions | Wellness paid day offSenior-level Full TimeSydney5d ago
-
Intern AI Engineer AUD 75K-80KAWS | Agile | Azure | CI/CD | CSSDiscounted health insurance | Employee assistance program | Flexible leave options | Mentoring | Novated leasingEntry-level Full Time InternshipAUS VIC DXC Melbourne 360 Collins …5d ago
-
Principal Data Engineer (AWS) AUD 150K-173KAWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftFlexible work arrangements | Flexible work location | Job share | Part-time arrangements | Supportive inclusive workplaceSenior-level Full TimeSydney, NSW - CBP North, 1 …5d ago
-
Amazon Redshift | Cloud Computing | DBT | Data Architecture | Data EngineeringBuddy program | Career development | Coaching & mentoring | Continuous learning | Global career opportunitiesSenior-level Full TimeAustralia5d ago
-
Arbitrary waveform generator | Automation | Cryogenic measurement | Data Analysis | Data acquisitionCycle to work scheme | Life assurance | Pension | Private medical insuranceMid-level Full TimeSydney, AU, London, UK, San Sebastián, …5d ago
-
Senior Data Engineer (Melbourne/Adelaide) AUD 122K-143KApache Airflow | Automation | Azure | Azure Data | Azure Data FactoryFlexible hours | Free food and snacks | Opportunity to drive projects | Socials and Community Groups | Training and developmentSenior-level Full TimeMelbourne, Victoria, Australia6d ago