Data Platform DevOps Engineer
Tasks
- Automate identity and access permissions
- Automate security and compliance controls
- Configure observability monitoring alerting and logging
- Deploy and maintain data platform infrastructure on AWS
- Document best practices and conduct workshops
- Implement data governance with Unity Catalog
- Implement policy and cost guardrails
- Implement release management and environment promotion
- Manage service principals and workspace roles
- Operate GitLab CI CD pipelines for data projects
- Provide incident escalation support
- Provision and manage Databricks workspaces across environments
- Standardize Databricks deployment using asset bundles
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Asset bundles | Bash | CI/CD | DataOps | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Unity Catalog | Delta Lake | EKS | Fargate | Git | GitLab CI | IAM | Lambda | PrivateLink | PySpark | Python | S3 | SDLC | Shell Scripting | Terraform | Unit Testing | Unity Catalog | VPC
Education
Related jobs
-
Data Scientist (GenAI/Core DS) INR 2000K-3000KAWS | Data Analysis | Data Modeling | Data Visualization | LangchainSenior-level Full TimeGurugram, Haryana, India2h ago
-
Senior-level Full Timebangalore, India3h ago
-
Python AI Engineer INR 1800K-3500KAPI Development | AWS | AWS Lambda | Amazon Bedrock | Amazon SageMakerHybrid workSenior-level Full TimeIndia3h ago
-
Gen AI Engineer INR 2500K-4500KAWS Extract | Document processing | Langchain | Language Models | Large Language ModelsSenior-level Full TimeHyderabad, Telangana, India3h ago
-
Mid-level Full Timebangalore, India4h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2040KApache Kafka | Data Warehousing | Dimensional Modeling | Flink | GitSenior-level Full Timebangalore, India4h ago
-
Sr. AI Engineer, Backend (Altium) INR 2000K-4500KAPI Development | Agentic Systems | Algorithms | CI/CD | Data StructuresEmployee resource groups | Remote work optionSenior-level Full TimeBangalore, India6h ago
-
Software Engineering INR 1400K-1820KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure EventMid-level Full TimeHyderabad, TS, IN6h ago
-
AWS | AWS CloudWatch | Alerting | Backups | BashSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 2000K-3630KAWS | Apache Spark | Azure | C++ | Convolutional Neural NetworksSenior-level Full Timebengaluru, India7h ago
-
Senior-level Full TimePune, Maharashtra, India8h ago
-
AI Engineer - Acon - BLR INR 2000K-4500KAI Search | AI Studio | Application Security | Arize Phoenix | AzureSenior-level Full TimeIndia8h ago
-
Software Engineer - Spark, scala, Python, SQL, Databricks INR 1500K-2500KAirflow | Apache Spark | Automated testing | Azure Data | Azure Data LakeEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India8h ago
-
Senior-level Full TimeMumbai, Maharashtra, India9h ago
-
Senior Staff Machine Learning Engineer (Java + LLM) INR 2500K-3500KAlgorithms | Design Patterns | Java | Machine Learning | Object-OrientedSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Associate Engineer - Agentic AI Developer INR 2000K-3000KAgent systems | Azure | CI/CD | Docker | FastAPIMid-level Full TimeMumbai, MH, India9h ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3000KAnthropic | Azure OpenAI | CI/CD | Code Analysis | CypressMid-level Full TimePune, Maharashtra, India9h ago
-
ERDS-MJ - Gen AI Engineer INR 2000K-3000KAI Governance | Data Governance | Data Quality | Data Security | Deep learningCareer growth | Diversity and inclusion | Inclusive cultureMid-level Full TimeIndia10h ago
-
AWS Data Engineer INR 1500K-2500KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimePune, Maharashtra, India10h ago
-
Azure | CSV | ETL | Python | SQLSenior-level Full TimeBangalore, India10h ago
-
FinOps Data Engineer INR 2000K-3000KAPI Gateway | AWS Glue | Agile | Amazon Athena | Amazon RedshiftSenior-level Full TimeGurugram, India12h ago
-
Senior Data Engineer INR 1500K-2500KApache Airflow | Apache Hive | Apache Oozie | Apache Spark | BigQueryAdditional voluntary benefits | Disability programs | Flexible working hours | Life insurance | Private medical careSenior-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India15h ago
-
GenAI Support Lead - Manager INR 2000K-3465KAI Agents | AI Governance | API Testing | Bias detection | CI/CDEmployee networks | Hybrid work model | Paid volunteer daysSenior-level Full TimeHyderabad, India15h ago
-
Principal QA Engineer – GenAI Testing - Manager INR 1500K-2500KAI Governance | Adversarial Testing | Artificial Intelligence | BDD | Bias detectionFlexible work/life support | Hybrid work model | Paid volunteer daysSenior-level Full TimeHyderabad, India15h ago
-
Generative AI Quality Engineer - Senior Associate INR 1500K-2600KArtificial Intelligence | BDD | CI/CD | Gherkin | GitEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India15h ago