Data Platform DevOps Engineer
Tasks
- Automate identity and access permissions
- Automate security and compliance controls
- Configure observability monitoring alerting and logging
- Deploy and maintain data platform infrastructure on AWS
- Document best practices and conduct workshops
- Implement data governance with Unity Catalog
- Implement policy and cost guardrails
- Implement release management and environment promotion
- Manage service principals and workspace roles
- Operate GitLab CI CD pipelines for data projects
- Provide incident escalation support
- Provision and manage Databricks workspaces across environments
- Standardize Databricks deployment using asset bundles
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Asset bundles | Bash | CI/CD | DataOps | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Unity Catalog | Delta Lake | EKS | Fargate | Git | GitLab CI | IAM | Lambda | PrivateLink | PySpark | Python | S3 | SDLC | Shell Scripting | Terraform | Unit Testing | Unity Catalog | VPC
Education
Related jobs
-
Associate Process Manager INR 1800K-2800KAgentic AI | Agile methodologies | Causal Inference | Cypher | Experimental DesignMid-level Full TimeMumbai, Maharashtra, India3h ago
-
Partner Engineer, Generative AI INR 2500K-3000KAI infrastructure | AWS | Azure | C plus plus | Cloud platformSenior-level Full TimeBangalore, India | Mumbai, India3h ago
-
Principal Consultant - Data & AI INR 2500K-3200KAI Services | Agile | Apache Kafka | Apache Spark | Artificial IntelligenceSenior-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN; …3h ago
-
IT Support Specialist 1 (Regional) INR 2000K-2000KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeBengaluru, KA, IN6h ago
-
Executive-level Full TimeIndia6h ago
-
Senior Database Engineer (3+ years, Aurora, Dynamo, Redis) INR 1244K-2200KAmazon Aurora | Amazon Aurora MySQL | Amazon Aurora PostgreSQL | Amazon Web Services | Aurora MySQL24x7 support rotation | Hybrid workSenior-level Full TimeBengaluru, INDIA, India7h ago
-
AI Senior Engineer INR 2520K-4500KAgent Orchestration | Amazon Web Services | Autogen | Azure | Cloud platformSenior-level Full TimePune, MH, IN7h ago
-
Senior-level Full TimePune, Maharashtra, India8h ago
-
Software Engineer (6months to 2 Years of experience - JAVA/Python Backend, CICD, APIs, GEN AI, Microservices, Cloud) INR 1430K-2000KAgile | Apache Kafka | Automated testing | C++ | CI/CDContinued learning opportunities | MentorshipEntry-level Full TimeBengaluru, INDIA, India10h ago
-
Senior AI Engineer INR 2100K-3380KAuditability | Azure | CI/CD | Cloud Computing | Cloud platformCareer development | Collaborative workspaces | Flexible working arrangements | Learning platform accessSenior-level Full TimeMumbai, MH, India10h ago
-
Teamcenter AI Development Engineer INR 2500K-4225KActive Workspace | BMIDE | ITK | Machine Learning | Manufacturing ProcessSenior-level Full TimePune, MH, India10h ago
-
Lead - Data Platform Engineering INR 2156K-2400KAlerting | Bash | CPU performance | Capacity Planning | Concurrency ControlSenior-level Full TimeChennai, India11h ago
-
Data Engineer INR 1500K-1800KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkGlobal induction program | Talent development programs | Time off for digital disconnect days | Time off for volunteering | Wellbeing programsMid-level Full TimeBengaluru, KA, India12h ago
-
Convolutional Neural Networks | Deep learning | Generative AI | Google Gemini | LLM PromptsFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India14h ago
-
API | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataFlexibility programs | Inclusive benefits | MentorshipMid-level Full TimeKolkata DN 57, India14h ago
-
Apache Airflow | Apache Hadoop | Apache Spark | App Service | Azure AppFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India14h ago
-
Apache Airflow | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataSenior-level Full TimeKolkata DN 57, India14h ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | App ServiceSenior-level Full TimeKolkata DN 57, India14h ago
-
IN_Manager_Data Analyst_Data and Analytics_Advisory_Bangalore INR 1500K-2000KApache Airflow | Apache Flink | Azure | Azure DevOps | CI/CDMid-level Full TimeBengaluru Millenia, India14h ago
-
API Integration | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India14h ago
-
Amazon Web Services | Apache Airflow | Apache Databricks | Apache Hadoop | Apache SparkSenior-level Full TimeKolkata DN 57, India14h ago
-
API ingestion | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India14h ago
-
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platformFlexible work arrangements | Inclusive workplace culture | MentorshipSenior-level Full TimeBengaluru Millenia, India14h ago
-
Ab Initio | BigQuery | Cloud Composer | Cloud Storage | Cloud platformFlexible work programs | Inclusive workplace culture | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India14h ago
-
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India14h ago