Data Platform DevOps Engineer
Tasks
- Automate identity and access permissions
- Automate security and compliance controls
- Configure observability monitoring alerting and logging
- Deploy and maintain data platform infrastructure on AWS
- Document best practices and conduct workshops
- Implement data governance with Unity Catalog
- Implement policy and cost guardrails
- Implement release management and environment promotion
- Manage service principals and workspace roles
- Operate GitLab CI CD pipelines for data projects
- Provide incident escalation support
- Provision and manage Databricks workspaces across environments
- Standardize Databricks deployment using asset bundles
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Asset bundles | Bash | CI/CD | DataOps | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Unity Catalog | Delta Lake | EKS | Fargate | Git | GitLab CI | IAM | Lambda | PrivateLink | PySpark | Python | S3 | SDLC | Shell Scripting | Terraform | Unit Testing | Unity Catalog | VPC
Education
Related jobs
-
Software Engineering Lead Analyst - HIH - Evernorth INR 1800K-2300KAWS IAM | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon RDSAccountability and collective achievement | Agile team environment | Opportunities for continuous learningSenior-level Full TimeHIH - Hyderabad, India-1d ago
-
SDE - Robotics Engineer INR 180K-420KAlgorithms | C++ | Control Systems | Data Structures | Driver DevelopmentCollaborative environment | Hands-on real-world projects | Mentorship | Professional developmentMid-level Full TimeBengaluru, India11h ago
-
Mid-level Full TimeIndia, West Bengal, Kolkata11h ago
-
Mid-level Full TimeIN-TN-Chennai11h ago
-
AWS Data Engineering - Consultant INR 2000K-2700KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India11h ago
-
Lead Software Engineer - Agentic AI, Java/ Python INR 2000K-3500KAWS | Autogen | CI/CD | DevOps | EC2Senior-level Full TimeHyderabad, Telangana, India12h ago
-
REF82383U - Databricks, Python, PySpark, Azure 4- 6 yrs exp INR 1500K-2000KAzure | Databricks | Machine Learning | PySpark | PythonSenior-level Full TimeBangalore, KA, India12h ago
-
Software Engineering INR 1800K-2800KAlgorithm Design | Artificial Intelligence | C# | C++ | Data-drivenOnsite work 3 days per weekEntry-level Full TimeBengaluru, KA, IN12h ago
-
Senior Software Engineer, AI/ML, Google Cloud INR 2500K-4725KC++ | Data Processing | Debugging | ML Infrastructure | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
AI Strategic Cloud Engineer, Google Cloud INR 2500K-4800KApache Beam | C++ | Data Validation | Data Warehousing | DataflowSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India12h ago
-
Mid-level Full TimeHyderabad, TS, IN13h ago
-
Software Engineer III - Python, Spark, AWS INR 2000K-4000KAmazon CloudWatch | Amazon EMR | Amazon Redshift | Amazon Web Services | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Principal Engineer INR 3000K-4000KAWS | AWS CLI | AWS Glue | AWS Lambda | Amazon EMREnhanced medical benefits | Family well-being benefits | Health Safety and Wellbeing | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India13h ago
-
Staff Engineer - Java,Scala,Python INR 2829K-4000KAWS | Agile | Amazon Aurora | Amazon Aurora MySQL | Apache HadoopEnhanced medical benefits | Family well-being benefits | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India13h ago
-
Senior Analyst INR 2040K-4500KAPI Design | AWS | Adapter Versioning | Adapter-Tuning | C++Shift timing alignment | WFO WFH alignmentSenior-level Full TimePune, Maharashtra, India14h ago
-
Senior Lead Software Engineer - Python, AWS, Snowflake INR 2000K-4000KAWS | Agile | Amazon Web Services | Application Resiliency | CI/CDSenior-level Full TimeHyderabad, Telangana, India14h ago
-
Senior-level Full TimeHyderabad, Telangana, India14h ago
-
Cybersecurity Architect III - Databricks, AI, Offensive Security INR 2000K-3500KAgile | Application Resiliency | Artificial Intelligence | Continuous Delivery | Continuous integrationSenior-level Full TimeHyderabad, Telangana, India14h ago
-
Applied AI /ML INR 1068K-1496KAlgorithms | Amazon Web Services | Apache Spark | Azure | Computer VisionMid-level Full TimeHyderabad, Telangana, India14h ago
-
Mid-level Full TimeMumbai, Maharashtra, India15h ago
-
Software Test Engineer (Databricks, Pyspark, Automation, SQL) INR 2156K-2209KAPI Testing | Apache Airflow | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India15h ago
-
AI Engineer (Manager level) INR 1000K-1250KAI Services | Apache Spark | Azure AI | Azure AI Services | Azure CIMid-level Full TimeHyderabad, India15h ago
-
Senior Lead Engineer INR 2500K-4500KAPI Integration | Agent systems | Agentic AI | Autogen | CrewAISenior-level Full TimeRemote Working, India R15h ago
-
Senior-level Full TimePune, Maharashtra, India16h ago
-
Mid-level Full TimeHyderabad, Telangana, India16h ago