Data Pipeline Engineer
United States, Washington, Redmond; United States, Texas, Las Colinas; United States, North Dakota, Fargo; United States, North Carolina, Charlotte
USD 86K-169K Senior-level Full Time
Tasks
- Apply data security and governance
- Build ETL/ELT solutions
- Collaborate to deliver trusted datasets
- Design batch data pipelines
- Design data models
- Develop real-time data pipelines
- Ensure data quality controls
- Implement monitoring and alerting
- Maintain data warehouses lakehouses and storage
- Optimize pipeline performance
- Protect enterprise data assets
- Support legacy data migration
- Troubleshoot pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Azure Data | Azure Data Factory | Azure Event | Azure Event Hubs | Azure SQL | Azure SQL Managed Instance | Azure Synapse | CI/CD | Data Factory | ELT | ETL | Event Hubs | Infrastructure as Code | Kafka | Lakehouse | Managed Instance | Microsoft Fabric | Power BI | Python | SQL | SQL Managed Instance | Scala | Spark | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Regions
Countries
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R28d ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation/Search Alliance) - 2027 Start USD 115K-177KAlgorithms | Big Data | Big Data Engineering | Data Engineering | Data StructuresEntry-level Full TimeSeattle, Washington, United States5h ago
-
Algorithms | C plus plus | Causal Inference | Data Structures | DebiasingEntry-level Full TimeSan Jose, California, United States5h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation Live) - 2027 Start (PhD) USD 129K-246KAdvertising | Algorithms | C++ | Causal Inference | Contrastive LearningEntry-level Full TimeSeattle, Washington, United States5h ago
-
C++ | Causal Inference | Contrastive Learning | Debiasing | Deep learningEntry-level Full TimeSeattle, Washington, United States5h ago
-
Security Engineer, Applied AI USD 147K-195KAWS | Adversarial research | Adversary simulation | Agent Orchestration | AndroidSenior-level Full TimeMenlo Park, CA | New York, …5h ago
-
C++ | Compute Allocation | Dashboarding | Data Visualization | Machine LearningMid-level Full TimeMountain View, CA, USA; New York, …6h ago
-
Automation | C# | C++ | CSS | Dashboard DevelopmentMid-level Full TimeAnn Arbor, MI, USA6h ago
-
Software Engineer III, BigQuery USD 147K-210KArtificial Intelligence | BigQuery | Cloud Run | Data Storage | Data StructuresSenior-level Full TimeKirkland, WA, USA6h ago
-
Software Engineer, Supply Chain USD 147K-210KC++ | CSS | Cloud platform | Data Analysis | Data StructuresMid-level Full TimeSunnyvale, CA, USA6h ago
-
Software Engineer, Enterprise AI Capabilities USD 174K-252KAgentic AI | Cloud Computing | Distributed Systems | GCP | Generative AIMid-level Full TimeSan Jose, CA, USA6h ago
-
Staff Software Engineer, Generative AI, Data Analytics USD 207K-300KData Processing | Debugging | Fine Tuning | Generative AI | GoSenior-level Full TimeKirkland, WA, USA6h ago
-
Principal Data Scientist USD 130K-277KAI Agent | AI agent evaluation | Agent evaluation | Bayesian statistics | BenchmarkingSenior-level Full TimeUnited States, Washington, Redmond; United States, …12h ago
-
Staff Software Developer, Machine Learning USD 129K-187KAWS | Argo CD | AutoGluon | Azure | Big DataCareer development | Flexible vacation | Flexible work options | Hackathons | Mentorship programsSenior-level Full TimePerungudi, Chennai, TN, India13h ago
-
Principal Data Scientist Lead USD 130K-277KAI Agent | AI agent evaluation | Agent evaluation | Causal Inference | Data VisualizationSenior-level Full TimeUnited States, Washington, Redmond; United States, …13h ago
-
ML Engineer, Foundation Model Infrastructure USD 175K-215KBayesian Inference | C++ | CI/CD | Distributed Systems | Experiment trackingSenior-level Full TimeMountain View, CA, USA; San Francisco, …14h ago
-
Full Stack Data Engineer USD 85K-143KAgile | Apache Spark | BigQuery | CI/CD | CheckmarxAdditional vacation time option | Child care back up program | Community service time off | Employee resource groups | Flexible family careSenior-level Full TimeDearborn, MI, United States15h ago
-
Staff Machine Learning Engineer – VLM/LLM Evaluation USD 238K-302KC++ | Data Pipelines | Deep learning | Distributed Systems | Evaluation Frameworks401k match | Dental insurance | Disability insurance | Health insurance | HolidaysSenior-level Full TimeMountain View, CA, USA; San Francisco, …16h ago
-
AWS | AWS S3 | Amazon EMR | Amazon Kinesis | Apache Flink401k | Employee discount | Health benefits | Long-term disability | Paid HolidaysSenior-level Full Time7000 Target Pkwy N,NCD-0375 Brooklyn Park,MN …17h ago
-
Agent Orchestration | Data Quality | Deep learning | Generative UI | GoSenior-level Full TimeMountain View, CALIFORNIA, United States17h ago
-
Context engineering | Deep learning | Dynamic Orchestration | Generative AI | Golang401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States17h ago
-
Data Quality | Deep learning | Experimentation | Golang | LLM EvaluationSenior-level Full TimeMountain View, CALIFORNIA, United States17h ago
-
Senior Software Engineer - Machine Learning (Remote US) USD 230K-270KAI workflows | APIs | Backend Development | Cloud Native | Context engineeringRemote workSenior-level Full TimeUSA R17h ago
-
Deployed Engineer (Chicago) USD 150K-250KAWS | Agent architecture | Azure | Cloud Computing | Containerization401k plan | Flexible vacation | Meals on in office days | Medical, dental, and vision coverage | Travel up to 40 percentSenior-level Full TimeChicago, IL18h ago
-
Bioinformatics | C++ | CUDA | Cloud Computing | Computer VisionSenior-level Full TimeBaltimore, MD, United States18h ago