Data Platform Engineer
Tasks
- Analyze data for performance optimization
- Automate deployments with Azure DevOps
- Automate exception reporting
- Build Infrastructure as Code modules
- Build data pipelines
- Create cloud data objects
- Deploy data solutions
- Execute cutover planning
- Handle schema drift
- Implement data cleansing
- Maintain database components
- Perform post-migration optimization
- Plan cloud migrations
- Promote environments from DEV to PROD
- Provision backups and validate backups
- Provision cloud resources with Terraform
- Run database schema migrations
- Set data retention policies
- Support rollback planning
- Troubleshoot database issues
- Validate data quality controls
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Access Control as Code | Agile | Aurora | Automation | Azure Blob | Azure Blob Storage | Azure DevOps | Azure Files | Azure SQL | Backup Automation | Blob Storage | CI/CD | Containers | Control as Code | Cosmos DB | Data Lake | Data Lake Storage | Data Lakes | Data Pipelines | Data Quality | Data Retention | Data Warehousing | DynamoDB | EBS | EC2 | EFS | Encryption | FSx | Infrastructure as Code | Lambda | Managed Disks | Networking | NoSQL | Oracle Database | PostgreSQL | Python | RDS | Redshift | Replication | S3 | SQL | Schema migration | Scrum | Storage Spaces Direct | Storage spaces | Synapse | Terraform | “as-code”
Education
Related jobs
-
Senior AI Engineer USD 130K-150KAI Governance | AI Services | AI/ML | API Integration | AWS AI401k match | Dental insurance | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeCentennial, CO; Westminster, CO R12h ago
-
Machine Learning Engineer, Relevance and Personalization USD 166K-195KA/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeUnited States R13h ago
-
Data Platform Software Engineer USD 125K-194KCI/CD | Cloud Computing | Data Lakes | Data Modeling | Data Structures401k match | ESPP | Family leave programs | Flexible time off | Health plansEntry-level Full TimeSan Diego, CALIFORNIA, United States R13h ago
-
Data Engineer USD 150K-160KApache Iceberg | Cloud Data | Cloud Data Warehouses | Data Lakes | Data Warehouses401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R14h ago
-
Senior Machine Learning (ML) Engineer USD 175K-200KAI Search | Artificial Intelligence | Attention Mechanisms | Autogen | Azure AI401k plan | Dental insurance | Flexible paid time off | Flexible work hours | Medical insuranceSenior-level Full TimeSeattle, WA R14h ago
-
Software Engineer, Data Runtime USD 29KAWS | Admission Policy | Arrow | Azure | Benchmarking401k | Additional company holidays | Enhanced parental leave | Generous vacation policy | Holiday breakSenior-level Full TimeSan Francisco, US (Hybrid) R14h ago
-
Staff Software Engineer, Fleet Optimization USD 251K-310KAlgorithm Design | Backend Development | C++ | Constraint Optimization | Control SystemsSenior-level Full TimeSan Francisco, CA ; Mountain View, … R15h ago
-
Apache Iceberg | Apache Spark | Avro | Concurrency | Data Ingestion401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSan Diego, CALIFORNIA, United States R15h ago
-
AI Engineer I USD 90K-119KAPI Integration | Azure | CI/CD | Docker | Embeddings401k match | Dental insurance | Holiday pay | Medical insurance | Paid time offEntry-level Full TimeRemote, CA, USA R15h ago
-
API | AWS | Automated testing | Cloud Computing | Code generation401k | Dental insurance | Discounts and perks | Fully remote | Medical insuranceSenior-level Full TimeUniversal City, CALIFORNIA, United States R15h ago
-
Staff Backend Engineer, Data Platform USD 140K-175KAsynchronous Service Design | Audit Logging | BigQuery | Cloud Run | Cloud Storage401k match | Company holidays | Dental insurance | Flexible paid time off | Health insuranceSenior-level Full TimeElizabeth, NJ R15h ago
-
Senior Software Engineer (Data Platform) USD 185K-185K.NET | AWS | Authentication | Authorization Code | Authorization Code GrantSenior-level Full TimeUnited States (EST) R16h ago
-
Lead GenAI Engineer USD 150K-170KAgile | Azure | Cloud platform | Containerization | Cybersecurity401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilitySenior-level ContractMinneapolis, Minnesota, USA R16h ago
-
Staff, Analytics Engineer, GTM Data Science & Analytics USD 155K-194KCI/CD | Cause analysis | DBT | Data Governance | Data ModelingCorporate Bonus Plan | Equity plan | Generous time off | Healthcare | Paid personal time offSenior-level Full TimeRemote - US R16h ago
-
A/B | A/B Testing | Agent workflows | B testing | Celery401k match | Family leave | Medical/Dental/Vision insurance | Unlimited vacationSenior-level Full TimeRemote (United States) R17h ago
-
Senior Analytics Engineer USD 155K-170KBigQuery | DBT | Data Governance | Data Modeling | Data Monitoring401k retirement savings | EAP | Fully remote | Hardware provided | Healthcare (Medical Dental Vision)Senior-level Full TimeUnited States R17h ago
-
AI Automation Engineer USD 85K-105KAPI Development | AWS | Autogen | Azure | ChromaDB401k employer match | Employee Assistance Program Tuition Reimbursement | Health, dental, vision coverage | Learning and development programs | Life insuranceMid-level Full TimeChicago, Illinois, United States R17h ago
-
Associate Data Scientist USD 100K-140KClickHouse | GitHub | Jupyter | Metabase | Python401k match | Dental insurance | Health insurance | Paid parental leave | Paid time offMid-level Full TimeNew York, New York R18h ago
-
Software Engineer II - Data Security USD 149K-214KAudit Logging | Authentication | Authorization | CAP Theorem | Cloud infrastructureCross-functional collaboration | Leadership opportunities | Remote-first work environmentMid-level Full TimeRemote - USA R18h ago
-
Applied AI Research (Capabilities) USD 300K-405KDeep learning | Evals | Evaluation | Finetuning | Language ModelsCompetitive benefits | Flexible working hours | Generous vacation | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R19h ago
-
Senior Data Scientist, Simulation Capacity Optimization USD 213K-263KAutomation | Data Pipelines | Forecasting | Machine Learning | OptimizationBonus program | Equity incentive plan | Generous company benefits program | Remote work eligibilitySenior-level Full TimeMountain View, CA, USA R20h ago
-
Software Engineer Level 2 -FFPP-8911 USD 78K-250KAccumulo | BSON | Bigtable | HBase | HDFS401k match | Bonus opportunities | Dental insurance | Diverse Inclusive Workplace Culture | Employee referral programSenior-level Full TimeHanover, MD; Information Technology; Hanover, MD; … R20h ago
-
Senior-level Full TimeRemote, USA, United States R20h ago
-
Data Engineer USD 120K-150KAPIs | Access Control | Airbyte | Amazon Redshift | Apache AirflowFully remote workMid-level Full TimeUnited States (Remote) R20h ago
-
Enterprise - Software Engineer - Python, PySpark, AWS USD 185K-200KAWS Glue | AWS Lambda | Amazon DynamoDB | Amazon Web Services | PySparkBirthday off | Company events | Dental coverage | Flexible work schedule | Group life insuranceSenior-level Full TimeAnnapolis Junction, MD R20h ago