Sr.DataOPS Developer
Tasks
- Architect and manage message broker systems
- Automate data workflows testing validation and deployments
- Build APIs and microservices
- Build enterprise integration patterns
- Design and maintain end to end data pipelines for batch and streaming
- Design edge based data processing solutions
- Develop ETL/ELT frameworks
- Develop integration services dashboards and edge applications with Node.js
- Develop lightweight edge services
- Develop scalable backend systems with Python
- Ensure data quality, consistency, and availability
- Ensure resiliency fault tolerance at the edge
- Establish data governance lineage tracking and observability
- Implement DataOps practices with CI CD
- Implement event driven data streaming architectures
- Integrate structured and unstructured data sources
- Monitor and tune broker performance
- Monitor data systems performance and health
- Optimize data flow between edge on prem and cloud
- Schedule and monitor data pipelines with orchestration tools
- Write maintainable, testable code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Greengrass | Airflow | Apache Flink | Apache Kafka | Apache Kafka Streams | Apache Spark | Azure IoT | Azure IoT Edge | CI/CD | Cedalo | Data Governance | Data Lineage | Docker | ELK Stack | ELT | ETL | Event Driven | Event-driven architecture | Grafana | HighByte | HiveMQ | IoT Edge | JavaScript | Kafka | Kafka Streams | Kubernetes | Mqtt | Node.js | Observability | Prefect | Prometheus | Python | RabbitMQ
Education
N/A
Roles
Data Engineer | DataOps Engineer | DevOps | DevOps Engineer | Engineer | Platform | Platform Engineer
Related jobs
-
Data Scientist INR 3000K-5000KAWS | Airflow | Amazon SageMaker | Apache Spark | Azure Machine LearningSenior-level Full TimeIN-MH-Pune3h ago
-
Net Core Azure Cosmos DB Gen AI INR 1800K-3300K.NET | API Management | ASP.Net Core | App Service | Application InsightsMid-level Full TimeIN-KA-Bangalore3h ago
-
Senior-level Full TimeIN-AP-Hyderabad3h ago
-
Senior Applied AI/ML Engineer INR 3500K-5000KAgentic Systems | Autonomous Agents | Bias Mitigation | Data Analysis | Deep learningSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
DE&A - Core - Advanced Data Engineering - Ab Initio INR 3000K-4200KAb Initio | Checkpointing | Data Lineage | Data Manipulation | Data Manipulation LanguageSenior-level Full TimeIndia5h ago
-
Assistant Manager- Python Gen AI with GCP- Bangalore INR 1500K-2500KADK | AI Agents | API Development | Agile | Cloud platformWork from client office 5 days per weekMid-level Full TimeBangalore, Karnataka, India5h ago
-
Senior-level Full TimeBangalore, Karnataka, India5h ago
-
Database Engineering Associate - Snowflake Developer INR 1500K-2000KAPI Integration | AWS | Access Management | Agile | Batch ProcessingFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R5h ago
-
Data Engineer (.NET Specialist) INR 2400K-3380K.Net Core | ASP.NET | Angular | App Service | Azure AppCustomer-facing role | On call support rewardsSenior-level Full TimePune, MH, India5h ago
-
Business Intelligence Engineer - Snowflake Developer INR 2500K-4132KAgile | Airflow | Bitbucket | CI/CD | Common table expressionsFlexible remote days | Health insurance | Hybrid work model | Life insurance | Paid time offSenior-level Full TimeHyderabad, India R6h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India7h ago
-
Data Engineer (AWS+Pyspark) INR 1500K-2000KAWS Glue | Amazon Athena | Amazon Aurora | Amazon DynamoDB | Amazon EC2Mid-level Full TimeHyderabad, Telangana, India7h ago
-
Mid-level Full TimeMumbai, Maharashtra, India8h ago
-
AM - Cloud Data Engineer INR 1500K-2500KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimePune, Maharashtra, India9h ago
-
QE for AI Engineer INR 3000K-4000KAdversarial Testing | Benchmarking | CI/CD | Data Lineage | EvaluationSenior-level Full TimePune, Maharashtra, India9h ago
-
Data & Analytics Engineer - Consultant INR 1500K-3000KData Director | Data Governance | Data Management | Data Quality | ETLSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Digital Finance CoE - Azure Data Engineer - Executive INR 1500K-6000KAWS Glue | Azure | Azure Data | Azure Data Factory | Azure DatabricksExecutive-level Full TimeBangalore, Karnataka, India9h ago
-
Compliance Engineering - Data Eng - Analyst - Bengaluru INR 1685K-2700KAI code generation | API | Automated testing | Code generation | DatabaseMid-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Manager of Software Engineering - Data Engineer INR 4000K-6000KAPI Development | AWS | AWS Glue | AWS Lambda | Apache KafkaSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Asst Mgr - AI Solutions INR 96K-180KAPIs | Artificial Intelligence | Feature Engineering | Generative AI | GitEntry-level Full TimeMumbai A.O, MUM-KND-AFS(FD), IN9h ago
-
Software Engineer, Evals INR 1500K-3000KBackend Engineering | C++ | Cloud Native | Dashboards | Data PipelinesMid-level Full TimeBangalore, India9h ago
-
Senior-level Full TimeBangalore, India9h ago
-
IN_RBIN_Assistant Manager/Senior Engineer_Data Scientist INR 3000K-4200KAgentic AI | Agile | Application development | Azure Databricks | Big DataSenior-level Full TimeNashik, Maharashtra, India9h ago
-
Senior Data Engineer INR 3000K-4000KAPI Development | AWS | Algorithms | Amazon Redshift | AzureDiscounted gym memberships | Flexible working | Hybrid working | Life assurance | Life assurance and community involvementSenior-level Full TimeHyderabad, India9h ago
-
Principal Software Engineer INR 2500K-5000K.Net Core | .Net Framework | AI Agents | AI code analysis | AI code generationSenior-level Full TimeBengaluru, India10h ago