Senior Data Engineer AWS & GCP
Tasks
- Apply access rules
- Automate data quality validation
- Collaborate with stakeholders on requirements
- Design data pipelines
- Design scalable data architectures
- Develop data ingestion pipelines
- Document processes and solutions
- Implement data governance controls
- Maintain data workflow components
- Model data for analytics
- Monitor pipeline reliability
- Optimize data models and performance
- Participate in sprint planning
- Perform CI CD deployment support
- Perform data transformation
- Secure sensitive data with encryption
- Set data retention strategies
- Track data quality metrics
- Use monitoring tools
- Validate clean enrich data
- Write production code with automated testing
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache Spark | Azure | BigQuery | CI/CD | Data Governance | Data Modeling | Data Quality | Databricks | ELT | ETL | Encryption | GitHub Actions | Google Cloud | Jenkins | PySpark | Python | Relational databases | SQL | Scala
Education
N/A
Roles
Related jobs
-
MLOps Engineering Specialist GBP 55K-58KAWS | AWS CDK | AWS CloudFormation | Alerting | Amazon SageMakerDiscounted mobile and broadband | Equalized maternity paternity adoption leave | Gym memberships | Holiday purchase scheme | Online private GP 24 7Mid-level Full TimeLondon, GB, E1 8EP R2h ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Amazon Redshift | Apache Airflow | Automated Feature EngineeringTelecommuting 100 percentSenior-level Full TimeUS- remote R6h ago
-
AI Document Intelligence | AI content understanding | API Development | Agile Kanban | Agile ScrumFlexible vacation policy | Fully remote | Home office support allowance | Indefinite contract option | Learning and development bonusMid-level Full TimeMexico R6h ago
-
Senior Solutions Engineer - Qatar & S.Africa Fly-in GBP 74K-103KAI Agents | AWS | Apache Spark | Apache Spark architecture | Artificial IntelligenceHybrid schedule | Travel opportunities | Workshops and community engagementSenior-level Full TimeLondon, United Kingdom R7h ago
-
AI Agents | AWS | Apache Spark | Artificial Intelligence | Big DataHybrid work | Travel for customer visits and eventsSenior-level Full TimeParis, France R7h ago
-
Embedded Software Engineer I USD 106K-170KAlgorithms | C# | C++ | DHCP | DNSDental insurance | Emotional & mental wellness support | Employer 401k match | Fitness programs | Learning and development programsMid-level Full TimeSeattle, Washington, United States R10h ago
-
Senior AI Data Engineer | WFH | Dayshift PHP 80K-160KAWS | Azure | CI/CD | Data Governance | DevOpsOn-call rotations | Shift flexibility | Work from homeSenior-level Full TimeTaguig City, PH R11h ago
-
Senior Full-Stack Engineer, Gen AI @MarshTech (Open) RON 295K-387KAgile | Angular | Kubernetes | Language Models | Large Language Models30 days off | Charity days off | Flexible benefits package | Hackathons | Hybrid workSenior-level Full TimeCluj-Napoca - Decembrie, Romania R11h ago
-
Senior AI Engineer CAD 160K-220KCI/CD | Context window | Context window optimization | Contextual compression | Document chunkingHealth benefits | Home internet reimbursement | Learning & development budget | Paid personal days | Paid sick daysSenior-level Full TimeCanada (Remote) R13h ago
-
APIs | AWS ECS | AWS Lambda | AWS S3 | AgentsSenior-level Full TimeOffice Location or Remote - USA R14h ago
-
API Development | AWS | AWS Lambda | Agentic AI | Amazon EC2Senior-level Full TimeOffice Location or Remote - USA R14h ago
-
DevOps Engineer II INR 2500K-3500KAnsible | ArgoCD | Bash | CI/CD | Cloud MonitoringDevelopment reimbursements | Employee referral program | Flexible working hours | Hybrid remote work | Life and accidental insuranceSenior-level Full TimeIndia - Remote R14h ago
-
Lead, Customer Strategy Analytics & Applied AI USD 190K-210KAI workflows | Analytics | Applied AI | DBT | Data ModelingComprehensive health coverage | Equity | Remote-first workplace | Unlimited PTOSenior-level Full TimeRemote - United States R14h ago
-
Software Engineer, Fulfillment CAD 108K-135KAWS | Buildkite | CircleCI | Cloud Platforms | Cloud platformChild care benefits | Disability benefits | Family building benefits | Flexible paid time off | Health and dental coverageMid-level Full TimeToronto, Canada R15h ago
-
Forward Deployed AI Product Engineer USD 180K-230KAI Agents | AI guardrails | API Integration | APIs | AWSAutonomy | Career growth opportunities | Casual work environment | Remote-first culture | Travel for client workSenior-level Full TimeUS-Remote R15h ago
-
AI Security Engineer INR 2000K-3500KAI Foundry | API Security | Access Management | Application Security | AzureGenerous annual leave policy | Medical insurance | Remote work flexibilitySenior-level Full TimeMumbai, MH, India R16h ago
-
Senior Agentic AI Engineer USD 194K-239KAPI Development | Agent systems | Agentic AI | Debugging | Distributed SystemsDental insurance | Flexible work policy | Health insurance | Learning Support | Paid family leaveSenior-level Full Timesan francisconew york R16h ago
-
Software Engineer Senior BRL 210K-210KAWS | Angular | Automated testing | CI/CD | Cause analysisHybrid work modelSenior-level Full TimeSão Paulo, SP, Brazil R16h ago
-
Airflow | CI/CD | DBT | Databricks | GitQuarterly in person surges | Remote-first workSenior-level Full TimeRemote - USA R16h ago
-
Senior Data Engineer I CAD 135K-159KAirflow | Dagster | Data Modeling | Data orchestration | DatabricksComprehensive health plans | Parental leave plans | Professional development stipend | Remote work modelSenior-level Full TimeRemote - Canada R16h ago
-
Senior Data Engineer I USD 119K-201KApache Airflow | Dagster | Data Modeling | Data orchestration | ETLHealth insurance | Parental leave | Professional development stipend | Remote work flexibilitySenior-level Full TimeRemote - US R16h ago
-
Senior AI Engineer USD 160K-185KAgent Orchestration | Agent tracing | Agentic Software | Agentic Software Engineering | AnthropicSenior-level Full TimeRemote (US) R17h ago
-
Senior Cloud Engineer USD 140K-204KAWS | AWS CloudFormation | AWS DMS | AWS Glue | AWS Lake FormationFlexible work arrangements | Professional developmentSenior-level Full TimeRemote - United States R17h ago
-
Senior Staff Engineer BRL 192K-210KAWS | Acceptance Testing | Angular | CI/CD | CheckmarxHybrid work model | Knowledge sharing | MentorshipSenior-level Full TimeSão Paulo, SP, Brazil R18h ago
-
Staff Machine Learning Engineer(Platform - Identity) USD 218K-256KAML | AML Compliance | Attack detection | Biometrics | Computer Vision401k matching | Dental | Medical | Quarterly in person surges | Remote-first workSenior-level Full TimeRemote - USA R18h ago