Platform Engineer - Databricks and Cloud
Tasks
- Apply AWS Well-Architected Framework principles
- Automate Databricks job and workflow deployments
- Build CI/CD pipelines
- Create reusable templates and standard operating procedures
- Design scalable AWS infrastructure
- Enable data engineering pipeline execution
- Implement cloud and data platform governance and security
- Implement infrastructure as code with Terraform
- Manage Databricks workspaces and clusters
- Monitor platform reliability and performance
- Troubleshoot platform connectivity and workload issues
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | AWS | AWS CDK | AWS CodeBuild | AWS CodeDeploy | AWS Glue | AWS IAM | AWS Lambda | AWS Well Architected | AWS Well-Architected Framework | Amazon API | Amazon API Gateway | Amazon DynamoDB | Amazon EC2 | Amazon EKS | Amazon Redshift | Amazon VPC | ArgoCD | Batch Processing | CI/CD | Cloud Governance | CloudWatch | Data Lakes | Databricks | Databricks Jobs | ELK | ELT | ETL | GitHub | GitHub Actions | Grafana | Infrastructure as Code | Load balancers | Prometheus | Security groups | Terraform | Unity Catalog | Well-Architected Framework | Workflow Orchestration | “as-code”
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R14d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R27d ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgo CD | ArgoCD | Block Storage | CSI | Cluster APISenior-level Full TimeBoston, MA, United States R6h ago
-
C++ | DistributedTraining | ETL | Go | Huggingface401k matching | ESPP | Family leave | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States7h ago
-
Sr. Data and AI Engineer USD 180K-200KAWS | Agentic AI | Artificial Intelligence | Big Data | Cloud NativeHybrid workSenior-level Full TimeARLINGTON, VA, United States12h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract award contingent | Remote workMid-level Full TimeWork from home, VA, United States R12h ago
-
Senior-level Full TimeWork from home, VA, United States R12h ago
-
Data Engineer USD 145K-160KAWS | AWS Glue | Apache Airflow | Apache Spark | Data QualityContract award contingent | Hybrid work | Public trust clearance support | Technical documentation updates | Travel 15 percent or lessMid-level Full TimeFAIRFAX, VA, United States13h ago
-
Sr. Databricks Consultant USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDRemote work | Secret clearance | Travel as neededSenior-level Full TimeWork from home, VA, United States R13h ago
-
Mid-level Full TimeFAIRFAX, VA, United States13h ago
-
Senior Databricks Migration Engineer USD 130K-158KActive Directory | Apache Spark | Azure Active Directory | Data Quality | Data SkippingOnsite work | Public Trust background investigationSenior-level Full TimeArlington, VA, United States13h ago
-
Senior-level Full TimeWork from home, VA, United States R13h ago
-
Data Engineer USD 110K-165KCause analysis | Data Formats | Data Pipelines | Data Processing | Data TransformationCompetitive benefits | Hybrid remote onsite work | TS SCI clearance with poly eligibilitySenior-level Full TimeFAIRFAX, VA, United States13h ago
-
AI Requirements Engineer USD 120K-145KAI Model Integration | AI model | API Integration | AWS | AgileMid-level Full TimeArlington, VA, United States13h ago
-
Senior Finance Data Engineer USD 78K-98KAccess Management | Azure Data | Azure Data Platform | Azure DevOps | CI/CD401k company contribution | Community involvement events | Disability benefits | Flexible paid time off | Flexible spending accountsSenior-level Full TimeAtlanta, Georgia, United States13h ago
-
Data Engineer – Microsoft D365 F&O USD 119K-200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Platform | Azure DevOpsMid-level Full TimeSaint Louis, MO, United States13h ago
-
Associate Principal - Data Engineering | Senior Data Analyst or Business Analyst | Onsite | 12+ years of experience USD 97K-125KAdobe | Analysis Services | Attribution Modeling | Azure Analysis | Azure Analysis ServicesOnsite workMid-level Contract Full TimeOrlando, FL, United States14h ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-250KAir-gapped | Argo CD | ArgoCD | Bash | Cluster APIAttend conferences and working groups | Company outings | Hackathons | Professional development and training | Tech talksExecutive-level Full TimeBoston, MA, United States R14h ago
-
Strategy & AI Consulting USD 129K-172KAWS | Artificial Intelligence | Azure | Cloud Computing | Cloud platformMid-level Full TimeAtlanta, United States14h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL17h ago
-
Data Engineer, gUP Engineering USD 106K-151KApache Flume | Apache Spark | Cloud Dataflow | Data Analysis | Data ModelingMid-level Full TimeBoulder, CO, USA17h ago
-
Data Engineer, GCS Data Science USD 106K-151KBig Data | C plus plus | Data Documentation | Data Modeling | Data ValidationEntry-level Full TimeNew York, NY, USA; Mountain View, …17h ago
-
Senior DevOps Engineer (Storage) - remote, US/EU USD 202K-290KAir-gapped | Air-gapped environments | Argo CD | ArgoCD | BashConference attendance | Hackathons | Professional development and training | Remote work | Tech talksExecutive-level Full TimeAustin, TX, United States R21h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | ClickHouse | Data Contracts | Data Modeling401k | Catered lunches | Commuter benefits | Continued education benefit | Equity compensationSenior-level Full TimeNew York, New York, United States23h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | Data Contracts | Data Modeling | Data Quality401k | Catered lunches | Commuter benefits | Company wellness day off | Continued education benefitSenior-level Full TimeLos Angeles, California, United States23h ago