DataOps Engineer
Remote South Carolina, Remote South Carolina, SC, United States
R
USD 120K-150K Senior-level Full Time
Tasks
- Administer and govern Databricks workspace
- Build Delta Live Tables pipelines
- Build agentic monitoring workflows
- Coordinate releases with cross functional stakeholders
- Design ADF ingestion pipelines
- Develop AI assisted root cause analysis
- Enforce automated testing gates and rollback procedures
- Enforce data contracts and quality SLAs
- Implement AI-powered observability
- Implement CI CD deployment pipeline
- Instrument data quality checks across medallion layers
- Integrate AI tooling into production DataOps
- Manage Databricks Unity Catalog governance
- Operate Azure data services stack
- Optimize Spark jobs performance and cost
- Participate in on-call rotation
- Produce technical documentation runbooks and post mortems
- Promote changes across dev staging production
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | Azure | Azure Cost Management | Azure Data | Azure Data Factory | Azure Key Vault | Azure Monitor | Azure SQL | CI/CD | Cosmos DB | Cost Management | Data Factory | Data Governance | Data Quality | Databricks | Databricks Genie | Delta Lake | Delta Lake ZORDER | Delta Live Tables | Delta Live) | Delta table | Event Hub | GitHub Actions | GitHub Enterprise | Jobs | Key Vault | Lakehouse | Log Analytics | Medallion Architecture | Microsoft Azure | Mosaic AI | PySpark | Python | SLA monitoring | SQL | Scala | Schema evolution | Spark | Unity Catalog | Workflows | ZORDER
Education
N/A
Roles
Related jobs
-
Senior Data Engineer-JT0224 USD 120K-180K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R4h ago
-
Senior ML/AI Modeler, Risk Automation Machine Learning USD 160K-283KAPI Integration | AWS | Airflow | Artificial Intelligence | Batch ProcessingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeSeattle, WA, United States of America R15h ago
-
Autonomy | C++ | DDS | Edge Computing | Embedded Systems401k | Health insurance | Paid time offMid-level Full TimeSan Carlos - Hybrid R19h ago
-
Autonomy | C++ | DDS | Edge Computing | Embedded Systems401k plan | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R19h ago
-
AI Engineer USD 132K-205KBatch inference | CI/CD | Continuous Evaluation | Data Drift | Data Drift Detection401k retirement plan | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote - Michigan, United States R21h ago
-
Data Engineer USD 119K-165KAutomated testing | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeRemote, United States R21h ago
-
Staff Software Engineer - Data Services USD 184K-230KAKS | Apache Airflow | Apache Iceberg | Apache Spark | CeleryCareer development | Employee resource groups | Flexible WFH | Generous PTO | Internet reimbursementSenior-level Full TimeUS-Massachusetts-Remote, United States R21h ago
-
Staff Data Engineer, Ads USD 248K-279KAPI Integration | Airflow | Alerting | Anomaly Detection | BigQuerySenior-level Full TimeRemote (U.S.) R22h ago
-
Senior Solution Engineer USD 165K-216KCloud Computing | Data Lake | Data Warehouse | Data fabric | Data mesh401k matching | Flexible PTO | Health, dental, vision coverage | Professional development budgetSenior-level Full TimeUS-MN-Remote R23h ago
-
Applied AI Engineer USD 205K-282KAMS Integration | API Integration | Carrier Portal | Carrier Portal Integration | Data integration401k plan | FSA | Flexible vacation | HSA | Health insuranceExecutive-level Full TimeAustin - HQ R1d ago
-
Distinguished AI Engineer USD 350K-600KAgent systems | DBT | EHR Integration | Fine Tuning | GuardrailsSenior-level Full TimeNew York, NY R1d ago
-
Distinguished AI Engineer USD 350K-600KAgent systems | DBT | Data integration | Deep learning | EHR IntegrationHybrid workSenior-level Full TimeNew York, NY R1d ago
-
A/B | A/B Testing | AWS | Alerting | B testingAnnual refresh grants | Equity grant | Flex First Work Options | On-call rotation | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Platform Engineer USD 110K-156KAWS CloudWatch | AWS EMR | AWS Glue | AWS Lambda | Agent coreHealth and life insurance | Hybrid work model | Paid time off | Pension or retirement benefits | Personal/family care leaveMid-level Full TimeDallas, TX, United States R1d ago
-
Senior Data Analytics Engineer USD 100K-140KAWS | Apache Airflow | Azure | BigQuery | DBT401k match | Flexible work arrangements | Health insurance | Life insurance | Paid time offSenior-level Full TimeRemote - US R1d ago
-
Senior Data Engineer USD 100K-140KAmazon Web Services | Apache Airflow | Cloud platform | Data Modeling | Data Validation401k match | Flexible benefits | Health insurance | Life insurance | Lifestyle spending accountSenior-level Full TimeRemote - US R1d ago
-
Senior Staff Machine Learning Engineer, Notifications USD 266K-372KAgentic AI | Data Pipelines | Generative AI | Go | LLM integration401k employer match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R1d ago
-
Senior Data Engineer USD 135K-165KAWS Kinesis | Access Controls | Apache Airflow | Apache Kafka | Audit Logging401 K | Healthcare benefits | Paid time offSenior-level Full TimeVirtual, United States R1d ago
-
Staff Data Engineer- Data Lake USD 170K-190KAWS | AWS EMR | AWS Glue | Airflow | Amazon AthenaFlexible work hours | Health insurance | Paid time off | Retirement options | Wellness holidaysSenior-level Full TimeNew York R1d ago
-
Staff Data Engineer - Emerald USD 170K-190KAWS | Amazon EMR | Amazon Redshift | Amazon S3 | Apache AvroFlexible work hours | Health and charitable donation stipends | Health insurance options | Paid time off | Retirement optionsSenior-level Full TimeNew York R1d ago
-
Engagement Manager USD 170K-190KAWS | Azure | Clustering | Computer Vision | ConfluenceFlexible work location | Telecommuting allowedMid-level Full TimeUnited States R1d ago
-
Senior AI/ML Engineer USD 125K-156KAWS | Access Control | Agent Orchestration | Audit Logging | CI/CD401k plan | Commuter benefits | Dental insurance | Disability plans | Fertility care benefitsSenior-level Full TimeUS Remote R1d ago
-
Software Engineer - Reliability USD 200K-250KAWS | Bash | Cluster management | Containerization | DCGMSenior-level Full TimeSF Bay Area, CA, Remote, US R1d ago
-
Senior-level Full TimeWork from home, VA, United States R1d ago
-
Machine Learning Engineer USD 150K-250K.NET | AWS | Azure | C# | GitCollaborative office space | Occasional onsite team summits | Remote-first environment | Work-life balanceSenior-level Full TimeUSA, USA R1d ago