Data Engineer
Maharashtra, Pune, India
INR 2000K-3100K (estimate) Mid-level Full Time
Tasks
- Build BMS protocol connectors
- Build CMMS integration connectors
- Build Grafana data quality dashboards
- Build Prometheus metrics export pipeline
- Build data quality monitoring pipeline
- Build historian adapter
- Build tag auto mapping engine
- Design TimescaleDB schema
- Implement MQTT ingestion pipeline
- Implement data lineage tracking
- Implement data retention and archival policies
- Implement feedback ingestion worker
- Implement tag freshness monitoring
- Implement training data snapshot pipeline
- Manage MinIO or S3 data lake
- Monitor database performance
- Monitor ingestion health
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Apache Kafka | BACnet | CI/CD | Data Lineage | Data Quality | Data quality monitoring | Docker | ELT | ETL | Grafana | Kubernetes | MLflow | Minio | Mqtt | OPC UA | PostgreSQL | Prometheus | Python | Quality monitoring | TimescaleDB
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeHyderabad, India3h ago
-
Senior-level Full TimeHyderabad, India3h ago
-
A/B | A/B Testing | Allocation Optimization | B testing | BacktestingFlexible hours | Remote workSenior-level ContractNoida, India3h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Cloud Computing | Data Modeling | Git | MicroservicesEducation budget | Local compliance support | Local connection | Periodic meet ups | Personal growth budgetSenior-level Full TimeHyderabad, India3h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Clean Code | Cloud Computing | Data Modeling | GitEducation budget | Local compliance support | Periodic team meetups | Professional development budget | Remote workSenior-level Full TimeCoimbatore South, India3h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KCI/CD | Docker | GitHub | Java | KubernetesEducation budget | Local team meetups | Professional development support | Remote work | Wellness supportSenior-level Full TimeGurgaon Kty., India3h ago
-
Lead Consultant - Level 2 Storage & Backup Engineer INR 2500K-4144KAWS | Automation | Azure | Change Management | Cyber ResilienceSenior-level Full TimeIndia-Hyderabad4h ago
-
Senior Data Engineer INR 2000K-2040KAWS | Automation | Data Warehousing | Databricks | Development Life CycleSenior-level Full TimeIN-MH-Mumbai4h ago
-
Mid-level Full TimeIN-TN-Chennai4h ago
-
Enablement Manager, Associate INR 1524K-2100KAWS | Azure | CI/CD | Cloud platform | Computer VisionInclusive work environment | Learning opportunities | State-of-the-art computing resourcesMid-level Full TimeHyderabad, Telangana, India4h ago
-
Data Engineer Manager INR 1500K-2000KAPI Development | API Integration | API Publishing | AWS | Apache SparkHybrid workMid-level Full TimeBengaluru, INDIA, India5h ago
-
Software Engineer III INR 2486K-3000KAI Gateways | Alerting | Amazon Elastic Container Service | Automated rollback | CI/CDSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Mid-level Full TimeBangalore, Karnataka, India6h ago
-
Mid-level Full TimeBangalore, Karnataka, India6h ago
-
Mid-level Full TimeBangalore, Karnataka, India6h ago
-
Mid-level Full TimeBangalore, Karnataka, India6h ago
-
Sr Data Engineers - AI/ML - Chennai INR 2500K-4500KAPI Security | Agent systems | Asynchronous programming | CI/CD | Docker401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeIndia6h ago
-
Infrastructure Engineer III- Cloud Database Administrator (DBA) INR 2486K-3200KAWS DMS | AWS EC2 | AWS ECS | AWS EKS | AWS RDSSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Senior Data Engineer INR 2520K-3380KAmazon Web Services | Apache Airflow | Azure | Bash | CI/CDHybrid work environmentSenior-level Full TimeBangalore, INDIA, India6h ago
-
AI ML Data Engineer for ADAS Sr Full Stack Developer INR 2500K-2800KAPIs | Apache | Apache JMeter | Azure | CI/CDSenior-level Full Timebangalore, India7h ago
-
Senior Database Administrator INR 2520K-3380KComputer Networking | DNS | Database Reliability | Database performance | FirewallsFlexible Working ProgramSenior-level Full TimeIndia7h ago
-
Lead Software Engineer – Python, ETL, GLUE, Spark, AWS. INR 2000K-2200KAWS CDK | AWS CloudWatch | AWS Glue | AWS IAM | AWS KMSSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
AI ML Data Engineer for ADAS Sr Backend Developer INR 2535K-4225KAWS | Apache Kafka | Azure | CI/CD | Cloud platformSenior-level Full Timebangalore, India9h ago
-
AWS | Azure | Business Rules | Data Catalog | Data CleansingAgile work culture | Learning opportunities | Team collaborationEntry-level Full Timepune, India10h ago
-
Senior-level Full TimePune, Maharashtra, India10h ago