Sr. Data Pipeline Engineer (Remote)
Tasks
- Apply DevOps practices to data engineering
- Architect data transformation pipelines
- Build data ingestion pipelines
- Develop real time and batch ingestion frameworks
- Implement CI/CD automation
- Implement data governance standards
- Improve pipeline reliability
- Integrate data from APIs
- Integrate data from file sources
- Manage multiple data projects
- Monitor pipeline data quality
- Orchestrate data pipelines
- Set up pipeline alerting
- Support AI machine learning workflows
- Support AI product telemetry analytics
Perks/Benefits
- Paid adoption leave
- Paid parental leave
- Paid time off
- Professional development opportunities
- Wellness programs
Skills/Tech-stack
API Integration | Airflow | Alerting | Batch Processing | CI/CD | DBT | Data Governance | Data Quality | Data orchestration | DevOps | Kafka | Monitoring | Netsuite | Observability | Python | Real Time | Real-time Streaming | SQL | Salesforce | Snowflake | Workday
Education
Related jobs
-
Principal Data Engineer USD 200K-240KAWS | Agentic Workflows | Anomaly Detection | Batch pipelines | CCPA401k plan | Commuter benefits | Flexible vacation | Life insurance | Long-term disabilitySenior-level Full TimeBoulder, Colorado or New York City, … R12h ago
-
Lead Data Engineer, Marketing Operations and Engineering USD 139K-257KAWS | Apache Airflow | Apache Spark | Cloud Computing | Cloud platformSenior-level Full TimeSan Jose, United States R16h ago
-
AI/ML Implementation Engineer USD 93K-155K8D | APQP | AWS | AWS Lambda | Amazon Bedrock401k matching | Dental insurance | Disability benefits | Employee assistance program | Health coachingMid-level Full TimeRemote, United States R16h ago
-
Business planning | Change Management | Continuous Improvement | Customer Service | Cycle managementContinuous education | Dental insurance | FSA | HSA | Medical insuranceSenior-level Full TimeRochester, MN, United States R17h ago
-
Senior Machine Learning Engineer USD 200K-230KBatching | Cloud Inference | Computer Vision | Deep learning | Edge ComputingDental insurance | Flexible PTO | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote, US or Canada - NYC … R19h ago
-
Senior Data Engineer USD 150K-165KAPIs | AWS | Automation | CI/CD | Data Pipelines401k matching | Birthday day off | Fitness stipend | Floating holidays | Health benefitsSenior-level Full TimeUnited States R19h ago
-
Sr Software Engineer II, Storage USD 148K-237KArchitecture | Design by Contract | Distributed Systems | Error Handling | Incident ResponseDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeWashington, United States R20h ago
-
Senior Embedded Systems Engineer USD 170K-226KACAP | Ansible | Bash | Cellular networking | DNS401k match | Dental insurance | Medical insurance | PTO | Sick days without limitSenior-level Full TimeChicago / Remote R20h ago
-
Senior Data Engineer, Data Foundations & AI Platform USD 153K-207KAPIs | Alerting | Apache Spark | CI/CD | Data Lineage401k with company match | Disability insurance | Flexible time off | Health, dental, and vision insurance | Leave of absenceSenior-level Full TimeUnited States (Remote) R20h ago
-
Manager, Data Science - AI Product USD 235K-348KAI tools | Analytics | Data Accessibility | Data Frameworks | Data PipelinesCell phone reimbursement | Dental insurance | Health insurance | Learning stipend | Mental health and wellness benefitsMid-level Full TimeSan Francisco, CA • New York, … R20h ago
-
AI/ML Engineering Manager USD 140K-215KAWS | AWS CDK | AWS CloudFormation | AWS Glue | Agent systems401k plan | Company laptop | Dental insurance | Equipment and office stipend | Flexible spending accountMid-level Full TimeUSA R21h ago
-
Senior Data Engineer USD 160K-190KA/B | A/B Testing | B testing | Clickstream | DBT401k match | Health and welfare benefits | Hybrid work | Paid Holidays | Paid vacationSenior-level Full TimeUnited States R22h ago
-
AI Engineer - Model Performance USD 165K-250KAttention Backend | Audio Processing | Batching | CUDA | CUDA graphAsync communication | Innovation-focused culture | Remote work | Startup environment | Supportive teamMid-level Full TimeSF Hybrid R22h ago
-
Senior Data Engineer USD 95K-135KAWS | Airflow | C++ | Cassandra | Cloud platform401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeChicago, IL R23h ago
-
Senior Data Engineer USD 95K-135KAWS | Airflow | C++ | Cassandra | Cloud platform401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeDenver, CO R23h ago
-
Senior Data Engineer USD 137K-170KAWS | Airflow | Apache Spark | Azure | C++401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeHouston, TX R23h ago
-
Senior Data Engineer USD 137K-170KAWS | Airflow | Apache Spark | C plus plus | Cassandra401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeDallas, TX R23h ago
-
Senior Software Engineering Manager, Lab Data Platform USD 180K-250KAgile | BigQuery | CI/CD | Cloud platform | Django401k employer match | Generous paid time off | Health, dental, and vision insurance | Professional development | Work-life balanceSenior-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R23h ago
-
Pricipal Fullstack Engineer (Java,React,LLMs) USD 200K-220KAPI Development | AWS | Azure | CI/CD | Cloud platformSenior-level Full TimeRemote (United States) R1d ago
-
Senior Analytics Engineer USD 160K-200KAWS | Amazon Redshift | Apache Airflow | Apache Spark | AzureDental insurance | Disability insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeNew York, NY, US R1d ago
-
Sales Analytics Manager USD 133K-192KAI Proof of Concept | Business Intelligence | DBT | Data Dictionary | Data GovernanceMid-level Full TimeRemote - USA R1d ago
-
AI | Ab Initio | Alation | Collibra | Data CatalogDiversity and inclusion | Employee resource groups | Health and safety support | Work-life balanceSenior-level Full Time500 Woodward Avenue, MI, 601 S. … R1d ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R1d ago
-
Data Engineer AI II USD 120K-145KAWS | Amazon S3 | Apache Hadoop | Apache Kafka | Apache Spark401k | Dental insurance | Disability insurance | Flexible work schedule | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R1d ago