Senior Data Engineer AWS & GCP
Tasks
- Apply access rules
- Automate data quality validation
- Collaborate with stakeholders on requirements
- Design data pipelines
- Design scalable data architectures
- Develop data ingestion pipelines
- Document processes and solutions
- Implement data governance controls
- Maintain data workflow components
- Model data for analytics
- Monitor pipeline reliability
- Optimize data models and performance
- Participate in sprint planning
- Perform CI CD deployment support
- Perform data transformation
- Secure sensitive data with encryption
- Set data retention strategies
- Track data quality metrics
- Use monitoring tools
- Validate clean enrich data
- Write production code with automated testing
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache Spark | Azure | BigQuery | CI/CD | Data Governance | Data Modeling | Data Quality | Databricks | ELT | ETL | Encryption | GitHub Actions | Google Cloud | Jenkins | PySpark | Python | Relational databases | SQL | Scala
Education
N/A
Roles
Related jobs
-
AI Document Intelligence | AI content understanding | API Development | Agile Kanban | Agile ScrumFlexible vacation policy | Fully remote | Home office support allowance | Indefinite contract option | Learning and development bonusMid-level Full TimeMexico R5h ago
-
Embedded Software Engineer I USD 106K-170KAlgorithms | C# | C++ | DHCP | DNSDental insurance | Emotional & mental wellness support | Employer 401k match | Fitness programs | Learning and development programsMid-level Full TimeSeattle, Washington, United States R8h ago
-
Senior AI Engineer CAD 160K-220KCI/CD | Context window | Context window optimization | Contextual compression | Document chunkingHealth benefits | Home internet reimbursement | Learning & development budget | Paid personal days | Paid sick daysSenior-level Full TimeCanada (Remote) R12h ago
-
DevOps Engineer II INR 2500K-3500KAnsible | ArgoCD | Bash | CI/CD | Cloud MonitoringDevelopment reimbursements | Employee referral program | Flexible working hours | Hybrid remote work | Life and accidental insuranceSenior-level Full TimeIndia - Remote R12h ago
-
Lead, Customer Strategy Analytics & Applied AI USD 190K-210KAI workflows | Analytics | Applied AI | DBT | Data ModelingComprehensive health coverage | Equity | Remote-first workplace | Unlimited PTOSenior-level Full TimeRemote - United States R12h ago
-
Forward Deployed AI Product Engineer USD 180K-230KAI Agents | AI guardrails | API Integration | APIs | AWSAutonomy | Career growth opportunities | Casual work environment | Remote-first culture | Travel for client workSenior-level Full TimeUS-Remote R14h ago
-
Senior Agentic AI Engineer USD 194K-239KAPI Development | Agent systems | Agentic AI | Debugging | Distributed SystemsDental insurance | Flexible work policy | Health insurance | Learning Support | Paid family leaveSenior-level Full Timesan francisconew york R14h ago
-
Software Engineer Senior BRL 210K-210KAWS | Angular | Automated testing | CI/CD | Cause analysisHybrid work modelSenior-level Full TimeSão Paulo, SP, Brazil R14h ago
-
Airflow | CI/CD | DBT | Databricks | GitQuarterly in person surges | Remote-first workSenior-level Full TimeRemote - USA R14h ago
-
Senior Data Engineer I CAD 135K-159KAirflow | Dagster | Data Modeling | Data orchestration | DatabricksComprehensive health plans | Parental leave plans | Professional development stipend | Remote work modelSenior-level Full TimeRemote - Canada R14h ago
-
Senior Data Engineer I USD 119K-201KApache Airflow | Dagster | Data Modeling | Data orchestration | ETLHealth insurance | Parental leave | Professional development stipend | Remote work flexibilitySenior-level Full TimeRemote - US R14h ago
-
Senior AI Engineer USD 160K-185KAgent Orchestration | Agent tracing | Agentic Software | Agentic Software Engineering | AnthropicSenior-level Full TimeRemote (US) R15h ago
-
Machine Learning Engineer, PhD Intern (Fall) USD 100K-125KAlgorithms | Data Management | Distillation | Feedback learning | Generative AIRemote work flexibilityEntry-level InternshipUnited States - Remote R16h ago
-
Machine Learning PhD Intern, Economics (Fall) USD 100K-125KApplied Econometrics | Causal Inference | Experimental data | Keras | Observational dataFlexible work location | In-person events | Remote workEntry-level InternshipUnited States - Remote R16h ago
-
Data Engineer - Data & Analytics USD 150K-205KAWS | Airflow | Amplitude | BigQuery | CI/CD401k match | Dental insurance | Flexible paid time off | Health and wellness stipend | Health insuranceMid-level Full TimeUnited States R16h ago
-
Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Bedrock | Amazon DocumentDB | Amazon EKSAdvanced technology exposure | Career growth opportunities | Comprehensive benefits and rewards | Fully remote | Ownership cultureSenior-level Full TimeMexico R17h ago
-
AI Software Engineer EUR 35K-42KAPI Integration | AWS | AWS SQS | Asynchronous processing | Batch ProcessingMid-level Full TimeTeletrabajo R17h ago
-
STEM Computational Scientific Software & Evaluation Design - Astrophysics & Cosmology A CAD 140K-200KAstroPy | Cosmological Calculations | Data Analysis | Linux | Observational dataFlexible schedule | Fully remote | Independent contractor with autonomous hours | Project-based engagement | Weekly paymentsEntry-level Full TimeCanada R18h ago
-
Senior Applied AI Engineer USD 160K-210KAPI Design | AWS | CI/CD | Circuit Breakers | DockerDynamic work environment | Flexible working hoursSenior-level Full TimeUS - Remote, Canada - Remote R19h ago
-
Senior Data Engineer USD 146K-190KAWS Glue | AWS IAM | AWS Redshift | AWS S3 | AirflowInternational conference attendance | Market exposure | Nontechnical training | Nursery reimbursement | Remote workSenior-level Full TimeRemote R19h ago
-
Knowledge Graph Engineer USD 119K-258KApache Spark | Azure | Azure Data | Azure Data Services | Data ServicesComprehensive healthcare | Fully remote | Long-term B2B contract | Stable project pipelineSenior-level Full TimeRemote R19h ago
-
APIs | Agile | Data Modeling | Data Pipelines | Data WarehouseCollaborative culture | Fully remote | High-performance engineering culture | Work from anywhere in Philippines | Work on scalable systemsSenior-level ContractAnywhere in the Philippines, Philippines R19h ago
-
STEM Computational Scientific Software & Evaluation Design - Pharmacokinetics & Systems Biology A USD 140K-200KCompartmental modeling | Enzyme kinetics | Libroadrunner | Linux | PythonFlexible schedule | Fully remote | Independent contractor paymentsEntry-level Contract Full TimeIndia R20h ago
-
A/B | A/B Testing | Attribution | B testing | CachingLearning and development | Remote workSenior-level Full TimeCanada - Remote (ON, AB, BC, … R20h ago
-
Senior Tech Lead - Data Engineering / Consultant Specialist INR 2040K-4000KAPI | Apache Airflow | Apache Beam | Autoscaling | BigQueryContinuous professional development | Flexible workingSenior-level Full TimeHyderabad, Telangana, India R21h ago