PL Ops - Data Engineer (Worcester or Remote)
Tasks
- Build and enhance ADF ETL pipelines
- Coordinate upstream dependency readiness and orchestration
- Create operational runbooks and documentation
- Establish SDLC practices for data engineering
- Implement data validation and reconciliation checks
- Implement incremental load and backfill strategies
- Monitor pipeline execution and triage incidents
- Optimize SQL tables views for refresh performance
- Own ADF pipeline reliability and health
- Perform root cause analysis and preventative controls
Perks/Benefits
- 401k match
- Career development and coaching
- Company-Paid Holidays
- Flexible work arrangements
- Medical, Dental, Vision, Life, & Disability insurance
- On site medical wellness center
- PTO
- Tuition reimbursement
Skills/Tech-stack
APIs | Alerting | Automation | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Blob Storage | CI/CD | Data Factory | Data Lake Storage | Data Modeling | Data Validation | ELT | ETL | Git | Monitoring | Notebooks | Power BI | Powershell | Python | Release Management | SFTP | SQL Server | T-SQL
Education
Roles
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R23d ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R23d ago
-
Sr Software Engineer INR 2400K-3500KAI Builder | Anomaly Detection | Azure Data | Azure Data Services | Azure DevOpsSenior-level Full TimeRemote Pune-Baroda, India R1d ago
-
Principal Software Engineer INR 2000K-4500K.NET | Active Directory | Agentic AI | Angular | App ServiceSenior-level Full TimeRemote Bangalore-Baroda, India R1d ago
-
Sr Operations Consultant INR 1800K-3000KAPI Integration | DAX | Data Modeling | Functions | Generative AISenior-level Full TimeRemote Pune-Baroda, India R1d ago
-
Senior Machine Learning Engineer USD 198K-287KData Engineering | Fine Tuning | Foundation Models | GenAI | Incident ResponseOn-call rotationSenior-level Full TimeRemote - US R1d ago
-
Member of Technical Staff, AI/ML USD 175K-240KData Pipelines | Data Quality | Deep learning | Distributed Computing | Fine TuningFlexible work environment | Remote-firstSenior-level Full TimeRemote R1d ago
-
Senior AI Engineer EUR 55K-79KAgentic AI | Agile | Amazon Web Services | FastAPI | GitFlexible work schedule | Hybrid work from homeSenior-level Full TimeMalta R1d ago
-
Senior AI Engineer HUF 13320K-16680KAI Agents | Agile Scrum | Amazon Web Services | FastAPI | GitBreakfast fruits and lunch | Career development | Fitness-wellness allowance | Hybrid work model | Private health insuranceSenior-level Full TimeBudapest R1d ago
-
Senior-level Full TimeRemote, US R1d ago
-
Staff Software Engineer - Database Engineering INR 2475K-3100KAmazon Aurora | Ansible | Backups | Cassandra | CitusSenior-level Full TimeBangalore, India R1d ago
-
Sr. Staff Machine Learning Engineer, Content Ecosystem USD 227K-469KCausal Inference | Data Quality | Experimentation | Game theory | Language ModelsSenior-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Senior Data Platform Engineer USD 133K-197KAWS | Amazon IAM | Amazon Redshift | Ansible | Apache IcebergDental benefits | Free 1Password account | Generous paid time off | Health benefits | Maternity and Parental Leave Top-UpSenior-level Full TimeRemote (United States | Canada) R1d ago
-
AI Engineer I - Hybrid USD 125K-135KAI Services | API Development | Agentic Workflows | Azure | Azure AIHealth insurance | Hybrid work | Paid time off | Remote work options | Retirement planSenior-level Full TimeWindsor, Colorado, United States R1d ago
-
API Integration | AWS | Airflow | Anthropic API | AutogenLong-term project opportunity | Opportunity with innovative company | Remote work environment | Work with modern AI technologiesMid-level Full TimeRemote job R1d ago
-
API Integration | AWS | Anthropic API | Apache Airflow | AutogenRemote workMid-level Full TimeRemote job R1d ago
-
Senior Machine Learning Engineer, Vector Bidding Science USD 148K-229KA/B | A/B Testing | B testing | BigQuery | Control TheoryCommute subsidy | Disability insurance | Employee assistance program | Employee resource groups | Employee stock ownershipSenior-level Full TimeRemote, Washington, USA R2d ago
-
Staff Machine Learning Engineer, Vector Bidding Science USD 172K-266KA/B | A/B Testing | B testing | BigQuery | Control TheoryCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation | Global employee assistance programSenior-level Full TimeRemote, Washington, USA R2d ago
-
AI/ML Engineering CZK 1040K-1200KAWS | Algorithms | CI/CD | Databricks | Docker25 days vacation | Company hardware | Height adjustable desk | Meal vouchers | Pension fund contributionSenior-level Full TimeRemote, Remote, Czechia R2d ago
-
Senior ML Engineer USD 152K-228KAmazon SageMaker | Baseten | Batching | CI/CD | Google Vertex401k matching | Dental insurance | Fertility assistance | Flexible time off | Health insuranceSenior-level Full TimeRemote - US & Canada (see … R2d ago
-
Data Engineer - Assistant Vice President USD 100K-135KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureEmployer-Matched Retirement Plan | Parental leave | Remote work Friday flexibility | Subsidized healthcare | Unlimited paid time offExecutive-level Full TimeSalt Lake City, Utah, United States R2d ago
-
Sr AI Engineer USD 124K-171KAPIs | Agentic Workflows | Event Driven | Event-driven architecture | JavaScriptFlexible time off | Learning and development stipend | Medical, dental, and vision insurance | Mental wellbeing resources | Paid HolidaysSenior-level Full TimeRemote - United States R2d ago
-
Lead Data Engineer - Data Platform Engineering (Hybrid) USD 128K-168KApache Airflow | Apache Hadoop | Apache Spark | BigQuery | Cloud Healthcare APISenior-level Full TimeMelville, Suffolk, United States R2d ago
-
Staff Machine Learning Engineer, Ads Conversion USD 222K-389KA/B | A/B Testing | B testing | Computer Vision | Data MiningSenior-level Full TimeSan Francisco, CA, US; Palo Alto, … R2d ago
-
Senior Solution Engineer Optimization USD 109K-150KAI machine learning | APIs | Advanced Analytics | Algorithms | Analytical problem-solvingHybrid option | Remote work | Travel for customer engagementsSenior-level Full TimeRemote (United States) R2d ago