Senior Data Engineer AWS & GCP
Tasks
- Apply access rules
- Automate data quality validation
- Collaborate with stakeholders on requirements
- Design data pipelines
- Design scalable data architectures
- Develop data ingestion pipelines
- Document processes and solutions
- Implement data governance controls
- Maintain data workflow components
- Model data for analytics
- Monitor pipeline reliability
- Optimize data models and performance
- Participate in sprint planning
- Perform CI CD deployment support
- Perform data transformation
- Secure sensitive data with encryption
- Set data retention strategies
- Track data quality metrics
- Use monitoring tools
- Validate clean enrich data
- Write production code with automated testing
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache Spark | Azure | BigQuery | CI/CD | Data Governance | Data Modeling | Data Quality | Databricks | ELT | ETL | Encryption | GitHub Actions | Google Cloud | Jenkins | PySpark | Python | Relational databases | SQL | Scala
Education
N/A
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R5d ago
-
Featured Feat. Software Engineer USD 40K-150K.NET | APIs | AWS | Angular | AzureContractor hours flexibility | Remote workMid-level ContractRemote R11d ago
-
Featured Feat. Senior Software Engineer USD 80K-170KAlgorithms | C++ | Data Structures | Go | JavaContractor flexibility | Remote workSenior-level ContractRemote R11d ago
-
GenAI Engineer EUR 30K-40KAmazon Bedrock | Amazon Lex | Cloud Computing | JavaScript | LangchainAutonomy | Career growth | Collaborative culture | Flexible schedule | Remote workMid-level Full TimeVenezuela Remoto, Venezuela R4h ago
-
AWS | Airflow | Apache Spark | Azure | CI/CDCooptation bonus | Employee committee CSE | Health insurance | Meal vouchers | MentorshipSenior-level Full TimeCourbevoie, IDF, France R9h ago
-
AWS | AWS Glue | Airflow | Azure | Azure DataCooptation bonus | Employee representative council | Health insurance | Meal vouchers | MentoringSenior-level Full TimeCourbevoie, IDF, France R9h ago
-
Computational Designer USD 95K-118KC# | C++ | Computational Geometry | Computer Graphics | Data Pipelines401k plan | Dental insurance | Education assistance | Fertility support | Flexible time offMid-level Full TimePortland, OR, US R12h ago
-
Associate Principal Engineer, Data Engineer (Enterprise Data Architecture- Banking domain) INR 1500K-2500KArdoq | Cloud Data | Cloud Data Platforms | Collibra | Data ArchitectureMid-level Full TimeRemote, India R12h ago
-
Data Platform & Architecture Lead CZK 1135K-1591KAPIs | Airflow | BigQuery | ClickHouse | DagsterCafeteria benefits | Flat hierarchy | Laptop | Meal vouchers | Mental health webinarsSenior-level Full TimeCzech Republic R12h ago
-
Data Platform & Architecture Lead CZK 1135K-1591KAPI Integration | Data Architecture | Data Governance | Data Modeling | Data PipelinesCafeteria benefits | Indefinite period contract | Meal vouchers | Paid sick days | Personal coachSenior-level Full TimeCzech Republic - Prague R12h ago
-
Backend systems | Camera Calibration | Cloud infrastructure | Computer Vision | Data AugmentationCoworking space option | Flexible working hours | Fully remote | Home office equipment allowance | No business travelSenior-level Full TimeRomania R13h ago
-
Camera Calibration | Camera systems | Cloud infrastructure | Computer Vision | Data AugmentationCoworking space option | Flexible working hours | Fully remote | Home office equipment allowance | No business travelSenior-level Full TimeItaly R13h ago
-
Camera Calibration | Cloud infrastructure | Computer Vision | Coordinate mapping | Data AugmentationCareer growth | Coworking space option | Flexible working hours | Fully remote | Home office equipment allowanceSenior-level Full TimePortugal R13h ago
-
Camera Calibration | Computer Vision | Data Augmentation | Deep learning | Domain AdaptationCareer development opportunities | Coworking space option | Flexible working hours | Fully remote | Home office equipment allowanceSenior-level Full TimeNetherlands R13h ago
-
Camera Calibration | Cloud infrastructure | Data Augmentation | Deep learning | Domain AdaptationCoworking space option | Flexible working hours | Fully remote | Home office equipment allowance | No business travelSenior-level Full TimeIreland R13h ago
-
Camera Calibration | Computer Vision | Data Augmentation | Deep learning | Domain AdaptationCoworking space option | Flexible working hours | Fully remote | Home office equipment allowance | No business travelSenior-level Full TimeSwitzerland R13h ago
-
Camera Calibration | Computer Vision | Coordinate mapping | Data Augmentation | Data QualityCoworking space option | Flexible working hours | Fully remote | Home office equipment allowance | No business travelSenior-level Full TimeFrance R13h ago
-
Camera Calibration | Cloud infrastructure | Coordinate mapping | Data Augmentation | Deep learningCoworking space option | Flexible working hours | Fully remote | Home office equipment allowance | No business travel requiredSenior-level Full TimeSpain R13h ago
-
Camera Calibration | Cloud infrastructure | Data Augmentation | Domain Adaptation | Event recognitionCoworking space option | Flexible working hours | Fully remote | Home office equipment allowance | No business travelSenior-level Full TimeGermany R14h ago
-
Senior Software Engineer, Data Foundation USD 189K-256KDjango | Go | High Volume | High-volume APIs | Python401k | Enhanced parental leave | Generous vacation | Holiday Breaks | Medical, dental & vision coverageSenior-level Full TimeSan Francisco, US (Hybrid) R18h ago
-
.NET Web | .NET Web API | AI Safety | AJAX | API DevelopmentGlobal team collaboration | Minimal office visits | Remote-first cultureEntry-level Full TimeIndia - Remote R18h ago
-
Gen AI Engineer (Data science) INR 2000K-4500KAWS | Angular | Apache Spark | Azure | Computer VisionFully remote | Minimal travelSenior-level Full TimeBangalore, KA, IN, 560100 R18h ago
-
AWS | Agile | Avro | Azure | Big DataContinuous learning | Health resources | Hybrid work model | Psychological support | Recognition programsSenior-level Full TimeMalaga, ES, 29590 R18h ago
-
Software Engineer II - Data Platform CAD 103K-129KAirflow | BigQuery | DBT | Data Engineering | Data WarehousingDental coverage | LinkedIn Learning access | Medical coverage | Paid Company Holidays | Paid sick leaveMid-level Full TimeCanada (Remote) R19h ago
-
Software Engineer II - Data Platform USD 116K-162KAirflow | BigQuery | DBT | Docker | GoFlexible time off | In-office workspace | LinkedIn Learning access | Medical insurance | Paid HolidaysMid-level Full TimeUnited States (Remote) R19h ago