DataOps Engineer (AWS / Databricks)
Miami, United States
A USD 180K-247K (estimate) Senior-level Full Time
Tasks
- Build and maintain CI/CD pipelines
- Catalog data
- Define and implement DataOps strategy
- Define and operationalize data quality practices
- Define repository structure and organization
- Design PySpark based data pipelines
- Design and implement cloud data infrastructure
- Enable encryption
- Ensure data security controls
- Implement access management
- Implement data governance policies
- Implement deployment versioning and rollback strategies
- Lead architectural decisions for data stack
- Manage data lineage
- Migrate data from on-premise to cloud
- Monitor data pipelines
- Provide data observability
- Separate environments
- Set data ownership and data layers
- Set data validation and SLAs
- Standardize development workflows
Perks/Benefits
Skills/Tech-stack
AWS | Access Management | Amazon IAM | Amazon S3 | Amazon VPC | CI/CD | Data Engineering | Data Governance | Data Lineage | Data Quality | Data Security | Data Validation | Data orchestration | DataOps | Databricks | Encryption | Monitoring | Observability | PySpark | Repository Organization | Terraform
Education
Roles
Related jobs
-
Senior Data Engineer - Full Stack USD 166K-190KAPIs | CI/CD | Command Line | Command-line Interface | DatabricksHybrid workSenior-level Full TimeNew York, New York, United States …3h ago
-
Senior Snowflake Developer USD 176K-216KAWS Lambda | AWS S3 | Amazon CloudWatch | Azure Blob | Azure Blob StorageSenior-level Full TimeChicago Heights3h ago
-
Senior-level Full TimeHuntsville, United States4h ago
-
Mid-level Full TimeArlington/Rosslyn, Virginia, United States5h ago
-
Ads Targeting Data Engineer, Ads Core USD 212K-389KAccess Control | Apache Kafka | Apache Spark | Batch Processing | Data EngineeringSenior-level Full TimeSan Jose, California, United States5h ago
-
API Design | Agentic Workflows | C plus plus | C# | Computer VisionSenior-level Full TimeRedmond, WA6h ago
-
Fullstack - Data Platform (Autonomy) USD 170K-210KAWS | Amazon RDS | Database Indexing | Database Query | Database Query OptimizationBonuses | Equity compensation | Medical/Dental/Vision insurance | Overtime pay | Paid time offSenior-level Full TimeSouth San Francisco, California, USA13h ago
-
Senior-level Full TimeSouth San Francisco, California, USA13h ago
-
Senior Software Engineer (Cloud & Data Platforms) USD 140K-165KAPI Design | AWS CloudWatch | AWS Copilot | AWS Lambda | Amazon DynamoDB401k matching | Disability insurance | Health insurance | Life insurance | Medical savings accountSenior-level Full TimePhiladelphia, PA, United States14h ago
-
Data and AI Software Engineer II USD 170K-201KAgile | Angular | Artificial Intelligence | CI/CD | Cloud technologiesBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersMid-level Full TimeJersey City, NJ, United States15h ago
-
Machine Learning Engineer (Active Secret Clearance) USD 175K-205KAgile | Algorithms | Asynchronous programming | CI/CD | Data Structures401k plan | FSA | HSA | Medical/Dental/Vision insurance | Paid disability insuranceMid-level Full TimeSchofield Barracks, Hawaii, United States16h ago
-
Senior Data Engineer - AI Platforms USD 145K-200KAWS Glue | Amazon Redshift | BigQuery | CI/CD | DBTLearning and growth | Professional development | Remote workSenior-level Full TimeUSA - Remote, United States R18h ago
-
Agile | Apache Spark | Beeline | Data orchestration | HDFS401k match | Dental insurance | Educational assistance | Health insurance | Paid time offSenior-level Full TimeDallas Innovation Center - Luna Rd …18h ago
-
Senior Machine Learning Engineer, AI Personalization USD 194K-343KAWS | Agentic Engineering | Automated testing | Code generation | Data ExperimentationFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of …18h ago
-
Data Analytics Analyst USD 172K-202KAWS | Computer Vision | Data Analysis | Data Pipelines | Deep learningBackup childcare | Financial coaching | Health insurance | Mental health support | On-site health and wellness centersMid-level Full TimeNew York, NY, United States19h ago
-
Senior-level Full TimeChicago, Illinois, USA R19h ago
-
Mid-level Full TimeUnited States19h ago
-
MLOps / AI Platform Engineer Subject Matter Expert USD 120K-160KAI Foundry | Azure AI | Azure AI Foundry | Azure Cloud | Azure Machine LearningFlexible schedule | Remote workSenior-level Full TimeU.S. Remote R20h ago
-
Applied AI ML Engineer Associate USD 175K-215KAPI Integration | Autogen | Big Data | CI/CD | CloudFormationBackup childcare | Financial coaching | Health care coverage | Mental health support | Retirement savings planSenior-level Full TimeColumbus, OH, United States20h ago
-
Data Engineer USD 115K-120KAzure | Data Performance Optimization | Data Quality | Data Security | Data StorageEntry-level Full TimeRedmond, WA20h ago
-
Entry-level Full TimeRedmond, WA20h ago
-
Software Engineer, Machine Learning Infrastructure USD 190K-300KAWS Kinesis | AWS Lambda | AWS SageMaker | Amazon DynamoDB | Amazon EC2Cell phone and internet allowance | Childcare allowance | Dental insurance | Flexible time off | Health insuranceMid-level Full TimeSan Francisco, CA20h ago
-
AWS | Benchmarking | Code Quality | Code review | Data Pipelines401k matching | Dining | Flexible spending accounts | Healthcare | Life insuranceSenior-level Full TimeBoston Office R21h ago
-
AI Engineer USD 200K-260KAWS | Agentic Workflows | Anthropic API | Claude | Claude Code401k profit-sharing plan | Dependent Care Account | Flexible spending account | Health savings account | Long-term disability insuranceMid-level Full TimeNew York City21h ago
-
Automation | Buildkite | C++ | CI/CD | Data PipelinesHybrid work | Inclusive work environment | Work from homeSenior-level Full TimeSunnyvale21h ago