Sr Cloud ETL Developer
Gleneagles - 5900, United States
USD 140K-195K (estimate) Senior-level Full Time
Tasks
- Build data ingestion patterns batch and streaming
- Build orchestration workflows
- Design ETL/ELT pipelines
- Design disaster recovery backups and high availability
- Develop CI/CD pipelines
- Enforce data governance data quality and data lineage
- Enforce data validation and observability
- Handle schemas and reconciliation
- Implement BigQuery partitioning and clustering
- Implement IAM access controls with service accounts
- Integrate SaaS on prem and cloud sources
- Mentor junior engineers
- Optimize BigQuery data models
- Orchestrate automated data pipelines
- Perform BigQuery cost performance tuning
- Translate business requirements into data solutions
- Troubleshoot data pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Alation | BigQuery | Cloud Composer | Cloud Storage | Cloud platform | Clustering | Collibra | Data Catalog | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Stewardship | Data Transfer Service | Dataflow | Dataplex | Dataproc | ELT | ETL | Fivetran | Google Cloud | Google Cloud Platform | Google Data Transfer Service | IAM | Microstrategy | Ontology | Partitioning | Power BI | PubSub | Python | SQL | Service Controls | Service accounts | Stored Procedures | Tableau | Transfer Service | VPC Service Controls
Roles
Data Engineer | Developer | ETL Developer | Engineer | Senior ETL Developer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States8h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States8h ago
-
Machine Learning Engineer, Sensor Pipelines USD 175K-215KC++ | Computer Vision | JAX | Machine Learning | PyTorchHybrid work scheduleMid-level Full TimeMountain View, CA, USA8h ago
-
Sr. Embedded Software/Firmware Engineer USD 180K-240KARM | ASPICE | AUTOSAR | C# | C++Competitive compensation | Dental insurance | Flexible hours | Medical insurance | Pre-IPO stock optionsSenior-level Full TimeUnited States - Remote R8h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States10h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA10h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | CI/CD | Cloud Storage | Cloud platformSecurity clearance providedMid-level Full TimeArlington, VA10h ago
-
API Design | Alerting | Data Modeling | Entitlement checks | Low LatencyHybrid work cultureSenior-level Full TimeHQ-San Francisco11h ago
-
API Design | Data Modeling | Low Latency | Low-Latency Systems | Rate LimitingHybrid work culture | In person meeting once per quarterSenior-level Full TimeHQ-San Francisco11h ago
-
API Design | Alerting | Data Modeling | Entitlement checks | Low LatencyHybrid work culture | In person once per quarter for remote rolesSenior-level Full TimeHQ-San Francisco11h ago
-
Senior ECAD Library & Engineering Data Engineer USD 160K-225K3D Component Models | APIs | Altium 365 | Altium Designer | Altium ScriptingOnsite collaborationSenior-level Full TimeSouth San Francisco, California, USA12h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas13h ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R13h ago
-
Security Data Analyst - Parsing USD 111K-144KAPI Gateway | Amazon Web Services | Ansible | Automation | Bash401k employer contribution | Dental insurance | Employer-paid life insurance | Flexible PTO | Health Savings Account employer contributionSenior-level Full TimeAustin, Texas | Remote R13h ago
-
Principal AI Engineer USD 130K-196KAI Safety | AWS | Agentic Workflows | Data Engineering | Evaluation401k match | Dental insurance | Disability insurance | Employee assistance program | Flexible spending accountSenior-level Full TimeDenver, CO13h ago
-
Sr. Data Engineer (HYBRID) USD 145K-160KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDBComplimentary club membership | Hybrid work schedule | Personal training | Pilates | Shop discountsSenior-level Full TimeNew York, NY, United States R13h ago
-
Staff Data Engineer - Data Engineering USD 207K-275KAccess Control | Apache Fluss | Apache Hudi | Apache Iceberg | Apache Paimon401k matching | Dental insurance | Disability insurance | Employee stock purchase program | Flexible PTOSenior-level Full TimeLivingston, NJ / New York, NY …14h ago
-
Cheminformatics | Cloud Computing | Data Analysis | Data Visualization | Deep learningSenior-level Full TimeRedwood City, California, United States14h ago
-
Senior MLOps Engineer I USD 170K-180KAWS | CI/CD | Canary deployments | Data Versioning | Deployment PipelinesAutonomy | Dental insurance | HSA Eligible | Inclusive culture | Medical insuranceSenior-level Full TimeSan Francisco, California, United States14h ago
-
Senior MLOps Engineer I USD 170K-180KAPI Integration | AWS | CI/CD | Canary Deployment | Computer VisionDental insurance | HSA options | Health insurance | Paid training | Stock options (eligibility)Senior-level Full TimeBoston, Massachusetts, United States14h ago
-
AI Developer USD 99K-198KAWS | Agentic AI | Azure | CI/CD | Data LakesHybrid work schedule | Leadership development | Professional developmentMid-level Full TimeWashington, DC14h ago
-
Software Engineer USD 85K-100KBiometrics | Computer Vision | Deep learning | Facial recognition | Image Geolocation401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeSomerville, Massachusetts, United States14h ago
-
Staff Software Engineer, Data Products USD 171K-224KAWS | AWS Lambda | Amazon Athena | Amazon Redshift | Amazon S3401k retirement savings plan | Flexible time off | Generous parental leave | Health, dental, and vision insurance | Lifestyle spending account mental health support solutionsSenior-level Full TimeRemote, USA R14h ago
-
Senior Data Engineer - Agentic AI Engineering USD 138K-173KAWS | Access Control | Airflow | Azure | Batch dataRemote-friendlySenior-level Full TimeUnited States of America R15h ago