Data Platform DevOps Engineer
Tasks
- Automate infrastructure as code with Terraform
- Build data platform infrastructure on AWS
- Configure monitoring alerting and logging
- Deploy and maintain Databricks workspaces
- Design policy guardrails for governance and cost
- Implement Unity Catalog governance
- Manage identity and access permissions
- Manage release branching and promotion
- Oversee GitLab CI/CD pipelines
- Provide incident escalation support
- Provision workspace lifecycle across environments
- Secure and monitor platform compliance
- Standardize deployments with Databricks Asset Bundles
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Asset bundles | Bash | CI/CD | CloudWatch | DataOps | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Unity Catalog | Delta Lake | EKS | Fargate | GitLab CI | GitLab CI/CD | IAM | Pandas | PrivateLink | PySpark | Python | S3 | SDLC | Serverless compute | Terraform | Unit Testing | Unity Catalog | VPC | Workflow Orchestration
Education
Related jobs
-
Data Science Engineer INR 2400K-3500KCloud Database | Data Modeling | Database Design | ELT | ETLCommercial awareness | Onshore Offshore model experience | UK client experienceSenior-level Full TimeMumbai, MH, India5h ago
-
Engineering Manager- DevOps(Vendor) INR 2200K-4000KAWS Lambda | Agile | Amazon S3 | Amazon Web Services | AnsibleSenior-level Full TimeNoida, Uttar Pradesh5h ago
-
Engineering Manager- Data Devops(Vendor) INR 1500K-2000KAWS CloudFormation | AWS IAM | AWS Lambda | Amazon CloudFront | Amazon CloudWatchMid-level Full TimeNoida, Uttar Pradesh5h ago
-
Senior-level Full Timebangalore, India5h ago
-
Senior Data Engineer INR 2516K-3356KAWS | Airflow | Apache Iceberg | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India5h ago
-
Lead Machine Learning Engineer INR 3100K-4500KApache Airflow | Argo Workflows | Deep learning | GenAI | JavaSenior-level Full TimeBangalore, India R6h ago
-
Senior-level Contract Full TimeBengaluru, Karnataka, India7h ago
-
Senior-level Full TimeIND - Bengaluru - Esko-Graphics India …11h ago
-
Data Engineer (5+ Years of Exp in Data Warehouse Modeling + Big Data + SSIS + BI + Agile + PowerApps + Shell + SQL) INR 1500K-2000KAI | AWS | Agile | Azure | Azure DevOpsMid-level Full TimeBengaluru, India11h ago
-
IN_Associate_Chatbots/Voicebots_GCC_Advisory_Bangalore INR 1000K-1400KAPI | AWS | AWS Lex | Agent Assist | Auto-QAMid-level Full TimeBengaluru Millenia, India11h ago
-
Mid-level Full TimeIndia Offsite (ZIN99) R11h ago
-
Cloud Engineer AIOps INR 2000K-2700KApache Spark | Auto Scaling | CI/CD | Compliance | Data LineageAccident insurance | Childcare assistance reimbursement | Coaching | Continuous learning culture | Employee assistance programEntry-level Full TimePune - Business Bay, India11h ago
-
Mid-level Full TimeNew Delhi15h ago
-
Mid-level Full TimeNew Delhi15h ago
-
Software Architect - Data Platform INR 2800K-4000KAlerting | Amazon RDS | Amazon S3 | Apache Druid | Apache PinotFlexible work schedule | Healthcare | Internet reimbursement | Paid time off | Parental leaveSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Principal Engineer INR 2500K-4500KAPI Integration | AWS Glue | Amazon Redshift | Apache Airflow | Apache KafkaSenior-level Full TimeNoida1d ago
-
C Engineer - Bangalore/Pune INR 2000K-2500KBash | C# | Character sets | Code generation | Compiler WritingMid-level Full TimeBangalore, India1d ago
-
Lead Data Engineer - R01553055 INR 1500K-2000KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CDCompetitive benefits | Growth opportunities | Remote flexibilitySenior-level Full TimeBangalore, Karnataka, India1d ago
-
Staff Software Developer, AI/ML INR 2500K-3100KAWS | Argo CD | Automation Testing | Azure | Big DataFlexible vacation | Flexible work options | Hackathons | Mentorship programs | Recognition programsSenior-level Full TimeBangalore, KA, India1d ago
-
IN_Associate_AI Engineer_GCC_Advisory_Bangalore INR 3000K-4800KAPI Development | Agent evaluation | Anthropic API | Async Programming | AutogenFlexibility programmes | Inclusive benefits | Mentorship | Work-life balance supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
Artificial Intelligence | Audit | Compliance | Data Analysis | Data ModelingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 8 B, India1d ago
-
Python Developer INR 300K-420KAgile | CSS | Git | HTML | JavaScriptCareer growth | Health insurance | Performance bonuses | Professional developmentEntry-level Full TimeAhmedabad, India1d ago
-
Mid-level Full TimeHyderabad, Telangana, India1d ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2500K-5000KAPI Integration | Agent Development | Agent Development Kit | Agent systems | Cloud platformSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India2d ago
-
AWS With GenAI INR 1300K-1700KAPI Gateway | AWS Fargate | AWS Glue | AWS IAM | AWS KMSRemote Working | Work-life balanceMid-level Full TimeBangalore, KA, IN, 5601002d ago