Sr Cloud ETL Developer
Gleneagles - 5900, United States
USD 140K-195K (estimate) Senior-level Full Time
Tasks
- Build data ingestion patterns batch and streaming
- Build orchestration workflows
- Design ETL/ELT pipelines
- Design disaster recovery backups and high availability
- Develop CI/CD pipelines
- Enforce data governance data quality and data lineage
- Enforce data validation and observability
- Handle schemas and reconciliation
- Implement BigQuery partitioning and clustering
- Implement IAM access controls with service accounts
- Integrate SaaS on prem and cloud sources
- Mentor junior engineers
- Optimize BigQuery data models
- Orchestrate automated data pipelines
- Perform BigQuery cost performance tuning
- Translate business requirements into data solutions
- Troubleshoot data pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Alation | BigQuery | Cloud Composer | Cloud Storage | Cloud platform | Clustering | Collibra | Data Catalog | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Stewardship | Data Transfer Service | Dataflow | Dataplex | Dataproc | ELT | ETL | Fivetran | Google Cloud | Google Cloud Platform | Google Data Transfer Service | IAM | Microstrategy | Ontology | Partitioning | Power BI | PubSub | Python | SQL | Service Controls | Service accounts | Stored Procedures | Tableau | Transfer Service | VPC Service Controls
Roles
Data Engineer | Developer | ETL Developer | Engineer | Senior ETL Developer
Related jobs
-
Agile | Automated testing | CI/CD | Cloud Computing | CrewAIDental insurance | Health insurance | Vision insuranceMid-level Full TimeAshburn, VA, United States9h ago
-
AI Machine Learning Skill 2-FFPP-8904 USD 78K-250KC# | Data Governance | Data Modeling | Data pipeline | Java401k plan with company match | Dental insurance | Diverse inclusive workplace | Employee referral programs | Flexible spending accountsMid-level Full TimeHanover, MD10h ago
-
AWS | AWS SageMaker | Azure | Cloud Pak for Data | Cloud infrastructureAccess to national security mission work | Hybrid work | Travel opportunitiesSenior-level Full TimeUSA-VA-Herndon10h ago
-
AI-assisted software development | AWS | Agentic AI | Azure | Cloud ComputingSenior-level Full TimeUSA-VA-Herndon10h ago
-
Analytics Engineer USD 115K-150KAgile | Azure DevOps | CI/CD | DBT | Data GovernanceAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountMid-level Full TimeHouston, Texas | Tulsa, Oklahoma | …11h ago
-
AI Engineer USD 180KAgent Orchestration | Cost Management | Data Pipelines | Distributed Systems | LLM401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …11h ago
-
Data & Analytics Specialist USD 87K-135KAPI Integration | Alteryx | DAX | JavaScript | Power AppsAdoption Assistance | Educational assistance | Flexible spending account | Health savings account | Life insuranceMid-level Full TimeWichita, Kansas11h ago
-
Data Platform & Engineering Specialist USD 100K-130KAWS | Amazon Kinesis | Azure | Azure Event | Azure Event HubsDental insurance | Educational assistance | Flexible spending accounts | Health insurance | Health savings accountsMid-level Full TimeLincoln, Nebraska11h ago
-
Machine Learning Leader - Optical Solutions USD 180K-300KAnomaly Detection | Data analytics | Image Processing | Java | Machine LearningAdoption Assistance | Disability insurance | Educational assistance | Flexible spending account | Health savings accountSenior-level Full TimeFremont, California11h ago
-
Process and Analytics Engineer USD 105K-140KAgile | Anomaly Detection | Asset Framework | HYSYS | HYSYS OnlineDental insurance | Disability insurance | Educational assistance | Flexible spending account | Health insuranceMid-level Full TimeWichita, Kansas11h ago
-
Senior Finance Data Engineer / Data Analyst USD 100K-120KDAX | Dashboard Development | Data Modeling | Data Standardization | Data TransformationSenior-level Full TimeAuburn Hills, MI, United States12h ago
-
Software Engineer III, Generative AI USD 147K-211KComputer Vision | Data Processing | Debugging | Language Models | Language ProcessingSenior-level Full TimeKirkland, WA, USA13h ago
-
Staff Software Engineer, AI/ML, YouTube Ads USD 207K-301KA/B | A/B Testing | B testing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA13h ago
-
Machine Learning Engineer USD 120K-140KAI Pipelines | AI Workbench | AI endpoints | Apache Kafka | Automated testingEntry-level Full TimeDenver, Colorado, United States15h ago
-
Senior Software Engineer - Database Engineering USD 200K-287KAutomated testing | Debugging | Distributed Systems | Distributed key-value stores | Failure recoverySenior-level Full TimeUS-CA-Menlo Park18h ago
-
Data Analyst - Forecasting and Optimization USD 124K-187KBacktesting | Deep learning | Feature Engineering | Gurobi | HiGHS401k matching | Disability insurance | Health insurance | Life insurance | Medical savings accountMid-level Full TimePhiladelphia, PA, United States19h ago
-
AWS Glue | AWS Lambda | AWS S3 | Access Control | Data GovernanceCareer growth opportunities | Collaborative and inclusive work environment | Diverse and inclusive culture | Flexible work arrangements | Permanent remote working modelSenior-level Full TimeCanada R19h ago
-
Data Modeling | Data analytics | Language Models | Large Language Models | Machine LearningCoaching | Hybrid work model | Mental health counseling | Mentorship | Paid volunteer timeMid-level Full TimeRaleigh, US, North Carolina20h ago
-
Principal AI Architect Engineer USD 118K-195KAWS | AWS Lambda | Amazon Bedrock | Amazon EC2 | Amazon EKSSenior-level Full TimeNew York, United States1d ago
-
Senior Software Engineer (AI/ML) - Vice President USD 150K-210KAPI Security | Algorithms | Cloud Platforms | Data Structures | DatabricksSenior-level Full Time1 New York Plaza, United States1d ago
-
AI/ML Engineer USD 55K-126KAI architecture | Agile | JavaScript | MLflow | Machine LearningPaid leave | Professional development | Secret clearance eligibility | Tuition assistanceMid-level Full TimeUSA, VA, McLean (8251 Greensboro Dr), …1d ago
-
AI Developer USD 77K-176KAWS | Agentic Workflows | Asynchronous Messaging | Audit Logging | Automated testingDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, TX, San Antonio (3133 General …1d ago
-
AI Developer USD 77K-176KAWS | Agentic Workflows | Asynchronous Messaging | Audit Logging | Automated testingDependent care | Disability insurance | Financial benefits | Health insurance | Life insuranceMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr …1d ago
-
AI Developer USD 77K-176KAWS | Agentic Workflows | Asynchronous Messaging | Audit Logging | Automated testingDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), …1d ago
-
AI Developer USD 77K-176KAWS | Asynchronous Messaging | Audit Logging | Automated testing | CI/CDDependent care | Disability insurance | Health benefits | Life insurance | Paid leaveMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr …1d ago