Databricks Platform Engineer (AWS)
USA VA Home based (CSC Location), United States
R
USD 115K-213K Senior-level Full Time
Tasks
- Apply Unity Catalog tags at ingestion time
- Build CDC ingestion pipelines
- Build CI/CD pipelines
- Build batch ingestion pipelines
- Build incremental ingestion pipelines
- Embed data quality rules
- Enforce platform standards for configuration
- Enforce platform standards for error handling
- Enforce platform standards for schema evolution
- Enforce platform standards for tagging
- Implement data quarantine patterns
- Implement metadata driven ingestion frameworks
- Implement pipeline alerting
- Implement pipeline metrics
- Implement pipeline monitoring
- Manage secrets with AWS Secrets Manager
- Promote environments
- Rollback deployments
- Support failure simulation
- Support operational validation
- Test recovery and rollback
- Validate configuration in pipelines
- Write governance metadata to governed schemas
Perks/Benefits
- Dental insurance
- Disability insurance
- Employee wellness
- Health insurance
- Life insurance
- Paid Holidays
- Paid time off
- Remote US work model
- Retirement savings plan
- Vision insurance
Skills/Tech-stack
AWS | AWS Secrets | AWS Secrets Manager | CI/CD | Databricks | Delta Lake | Git | GitHub Actions | PySpark | SQL | Secrets Manager | Unity Catalog
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R4d ago
-
APIs | AWS Glue | AWS Redshift | Amazon Web Services | Apache AirflowFully remote | Health insurance | On call production support | Paid time off | Retirement plansSenior-level Full TimeOrlando, FL, United States R7h ago
-
Data Engineer, Engineering & Operations USD 115K-145KAccess Control | Aggregation Thresholds | Airflow | Alerting | Anonymization401k | Dental insurance | Discounts | Fully remote | Medical insuranceMid-level Full TimeNew York, NEW YORK, United States R12h ago
-
Sr. Databricks Consultant USD 175K-250KAWS | Amazon S3 | Apache Spark | Azure | Azure DataRemote work | Travel as neededSenior-level Full TimeWork from home, VA, United States R12h ago
-
GCP/Linux Data Engineer (Remote) USD 95K-170KAPIs | Agile | CI/CD | Cloud automation | Cloud platformFully remote | W2 Candidates OnlyMid-level Full TimeRochester, MN R15h ago
-
Hiring: Senior Principal AI Software Engineer – Agentic & Industry Solutions | Full-Time | Remote USD 138K-208KAWS | AWS Bedrock | Agent systems | Anthropic API | Autogen401k matching | Adoption Assistance | Dental insurance | Fertility treatments | Flexible work scheduleSenior-level Contract Full TimeRemote, OR, United States R15h ago
-
A/B | A/B Testing | AI Model Deployment | AI model | App ServiceRemote workMid-level ContractHartford, United States R15h ago
-
Senior Data Engineer USD 90K-110KAgile | Amazon Web Services | Apache NiFi | Data Modeling | Data WarehousingAutonomy | Employee assistance program | Flexible working hours | Inclusive community | Online training videosSenior-level Full TimeNew York, United States R20h ago
-
Data Engineer, Go To Market (Remote) USD 100K-155KAmazon Redshift | Apache Airflow | CI/CD | CRM | DBTSenior-level Full TimeUSA CA Remote, United States R1d ago
-
Senior Data Engineer USD 97K-185KAWS Batch | Agile | Amazon EC2 | Amazon EKS | Amazon RDSEducational assistance | Health care coverage | Paid time off | Parental leave | Retirement planSenior-level Full Time245 Summer St, Boston MA, United … R1d ago
-
Senior Data Engineer USD 91K-163KAI | Automation | Backup and Recovery | Capacity Planning | Change ManagementCareer development | Comprehensive benefits | Telecommute within United StatesSenior-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
Machine Learning Engineer USD 196K-196KApache Airflow | CI/CD | Containerization | Docker | Experiment trackingFully remoteSenior-level Full TimeSan Francisco, CA R1d ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | BigQuery | Cloud Composer | Cloud Data401k retirement plan | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R1d ago
-
Senior Staff Data Engineer - Platform Data and Analytics USD 268K-368KAirflow | Alerting | Apache Spark | Capacity Planning | Cost OptimizationSenior-level Full TimeSan Francisco, CA R1d ago
-
Staff Data Engineer USD 185K-220KAWS | Apache Airflow | Apache Kafka | Benthos | Big DataDental insurance | Disability insurance | Flexible work hours | Health insurance | Health savings accountSenior-level Full TimeRosslyn, VA or Remote R1d ago
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R1d ago
-
IT Infrastructure Engineer II USD 139K-178KAWS Organizations | Access Management | Amazon Web Services | Ansible | Application FirewallHealth and wellness resources | Remote work | Wellness FridaysSenior-level Full TimeRemote - United States R1d ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Data Analysis | Data AssociationDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R1d ago
-
Senior Data and AI Platform Engineer USD 150K-230KAnalytics engineering | CI/CD | DBT | Data Engineering | Data GovernanceCross-functional collaboration | Learning opportunities | Occasional travel | Technical mentorshipSenior-level Full TimeRemote - US R1d ago
-
Analytics Engineer USD 110K-135KDBT | Data Architecture | Data Modeling | Data Quality | Data Warehouse401k | Dental insurance | Employee discounts | Fully remote | Medical insuranceEntry-level Full TimeNew York, NEW YORK, United States R1d ago
-
Senior Data Engineer - Databricks USD 180K-248KAWS | Access Control | Amazon Web Services | Apache Spark | Automated testing401k match | Corporate Benefit Program | Discounted pet insurance | Educational resources | Employee Referral Bonus ProgramSenior-level Full TimeUS - Remote R1d ago
-
Software Engineer, ML Dev Enablement USD 123K-163KAWS | Agentic AI | C++ | DDP | Data pipeline401k with company match | Dental insurance | Health savings account | Hybrid schedule | Life insuranceSenior-level Full TimeLas Vegas, Nevada, United States; Remote … R1d ago
-
Data Manipulation | Distributed Systems | Embeddings | Java | KubernetesCollaborative flat culture | Direct access to technical leadership | Exposure to cutting edge generative AI | Flexible schedule | High autonomyEntry-level Full TimeCanada R1d ago
-
Cloud Data | Cloud Data Platforms | DBT | Data Architecture | Data ProcessingCoworking allowance | Flexible paid time off | Health, dental and vision coverage | Home office stipend | Mental health resourcesSenior-level Full TimeCanada R1d ago
-
Azure Data | Azure Data Lakehouse | Azure SQL | DBT | Data GovernanceCareer growth | Continuous learning | Dental insurance | Flexible work arrangements | Global collaborationSenior-level Full TimeCanada R1d ago