Senior AWS/Databricks Infrastructure Engineer
Tasks
- Automate infrastructure provisioning
- Build CI/CD pipelines
- Configure logging and monitoring
- Deploy workloads with Helm
- Design AWS networking environments
- Develop infrastructure with Terraform
- Implement AWS VPC architecture
- Maintain CI CD deployment automation
- Manage Databricks IP allocation for job clusters
- Manage enterprise data platform integrations
- Manage multi account connectivity
- Operate EKS Kubernetes environments
- Optimize Databricks compute clusters
- Own Databricks deployments on AWS
- Perform change management and RFC governance
- Support incident response and root cause analysis
- Troubleshoot cloud networking issues
- Troubleshoot cluster and application issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS IAM | Address Management | Amazon Redshift | CI/CD | CIDR | Change Management | Databricks | Databricks Lakehouse | Databricks Lakehouse Platform | Delta Lake | EKS | GitHub Actions | Helm | IP Address Management | IP address | Incident Management | Infrastructure as Code | Jenkins | Kubectl | Kubernetes | Lakehouse platform | Logging | MLflow | Monitoring | Multi-account | Multi-account AWS | Networking | Observability | Snowflake | Snowflake Integrations | Subnetting | Terraform | Unity Catalog | VPC | VPC Peering | “as-code”
Education
N/A
Related jobs
-
AI Systems & ML Engineering Industry Expert USD 140K-209KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible schedule | Fully remote | Hourly payment | International teamSenior-level Part TimeNew York City, NY, US R8h ago
-
Project GenAI Engineer III USD 113K-188KAWS | Bedrock | Data Management | Fine Tuning | Generative AISenior-level Full TimeRosslyn, Virginia, United States8h ago
-
Data Engineer USD 109K-160KAccess Control | Agile | Amazon Web Services | Apache Airflow | Azure401k savings plan | Company holidays | Employee assistance program | Healthcare coverage | Paid time offMid-level Full TimeWoburn, MA, United States9h ago
-
Postgres Database Engineer USD 155K-232KAnsible | Automation frameworks | Backups and restores | Bash | CloudNativePGSenior-level Full TimeAustin, TX, United States9h ago
-
Principal Engineer - Supply Chain AI Solutions USD 125K-183KAWS | Agentic Workflows | Airflow | Authentication | AuthorizationSenior-level Full TimeNovi - Michigan, USA - Cabot …9h ago
-
Principal Engineer - Partner with Customers AI Solutions USD 125K-183KAWS | AWS Bedrock | Anthropic | Azure | Azure OpenAISenior-level Full TimeNovi - Michigan, USA - Cabot …9h ago
-
Principal Engineer - HR AI Solutions USD 125K-183KAWS | AWS Bedrock | Anthropic | Azure | Azure OpenAIBackground investigation and drug screen required | Employee discounts | Hybrid work | Training opportunitiesSenior-level Full TimeNovi - Michigan, USA - Cabot …9h ago
-
Principal Engineer - Future of Engineering AI Solutions USD 125K-183KAPIs | Access Control | Agent Frameworks | Agentic AI | Artificial IntelligenceSenior-level Full TimeNovi - Michigan, USA - Cabot …9h ago
-
Principal Engineer - Finance AI Solutions USD 125K-183KAWS | Access Control | Airflow | Auditability | AzureEmployee discounts | Training opportunities | Wellness benefitsSenior-level Full TimeNovi - Michigan, USA - Cabot …9h ago
-
Machine Learning Engineer USD 100K-120KAWS | Apache Spark | Classification | Data Quality | Data Quality ChecksHybrid work model | Onsite 1 to 2 days per week | Opportunities for growthMid-level Full TimeOakbrook Terrace, IL, US R9h ago
-
Research Scientist / Software Engineer, LLM/Agent Platform - TikTok - Content Ecology AI Innovation & Platform USD 160K-230KAccelerator optimization | Deep learning | DeepSpeed | Distributed Systems | Evaluation FrameworksSenior-level Full TimeSan Jose, California, United States10h ago
-
Autonomous Agents | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA11h ago
-
Staff Software Engineer, Data Protection USD 207K-300KArtificial Intelligence | C++ | Data Governance | Data Privacy | Data StorageBonus | Equity | Health insurance | Paid time offSenior-level Full TimeSan Jose, CA, USA11h ago
-
Dev and AI Infra Software Engineer, Releases, XR USD 207K-300KAI Software Engineering | AI software | Automation frameworks | Bug detection | Build AutomationSenior-level Full TimeSan Jose, CA, USA11h ago
-
Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | CI/CDCollaborative team environment | Learning & Mentorship | On-the-job training | Onsite work opportunityEntry-level Full TimeIrvine, CA, US13h ago
-
AI Integration Engineer USD 130K-160KAI Search | AI Services | API Keys | AWS | AWS Bedrock401k match | Dental insurance | Flexible spending accounts | Health insurance | Paid HolidaysSenior-level Full TimeWashington, DC, US14h ago
-
Senior Data Engineer USD 119K-250KApache Spark | Automation | Azure | Azure Data | Azure Data Factory401k matching | Adoption Assistance | Childcare tuition discounts | Company bonus | Dental insuranceSenior-level Full TimeAnn Arbor, MI, United States20h ago
-
Lead Software Engineer - Data and Payments Data Platform USD 170K-201KAWS Glue | AWS S3 | Amazon Athena | Amazon EMR | Amazon RedshiftBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeAustin, TX, United States21h ago
-
Senior Data Engineer (Data Architecture) USD 105K-135KAPIs | AWS Glue | Airflow | Azure Data | Azure Data Factory401k matching | Dental insurance | Extended holiday break | Flexible schedules | Life insuranceSenior-level Full TimeRemote, United States R21h ago
-
Staff Engineer, Data Platform (R5659) USD 131K-215KAPI Design | Analytical Databases | AsyncAPI | Cloud infrastructure | Columnar StorageSenior-level Full TimeSan Diego, California22h ago
-
Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R22h ago
-
Software Engineer II - Embedded Networking, Amazon Leo USD 165K-223KC# | C++ | CI/CD | Code review | Design Patterns401k matching | Employee assistance program | Flexible spending accounts | Health insurance | Mental health supportMid-level Full TimeSunnyvale, California, USA22h ago
-
Principal Engineer - AI Engineering USD 159K-254KAgent systems | Agentic AI | Ansible | Azure Machine Learning | ChainlitOn-site work | Relocation assistance not available | Visa sponsorship not availableSenior-level Full Time109562-CA-1755 Grant, Concord, United States22h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Airflow | Anomaly DetectionSenior-level Full TimeNew York R22h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Amazon Redshift | Apache AirflowSenior-level Full TimeSan Francisco R22h ago