Systems & Data Infrastructure Engineer
Bengaluru, Karnataka, India
INR 1500K-3000K (estimate) Senior-level Full Time
Tasks
- Build async backend services
- Design crash safe binary data formats
- Design streaming file format writes
- Enforce role-based access control
- Ensure cluster filesystem coherency
- Implement server sent events and backpressure handling
- Integrate external AI analytics service calls
- Manage HPC batch and interactive job lifecycle
- Model relational data schemas
- Monitor subprocesses and poll job status
Perks/Benefits
Skills/Tech-stack
Access Control | Alembic | Asyncio | Backpressure | Binary data | Cluster Filesystem | Crash Safe Writes | FastAPI | File Formats | Function Calling | Go | GraphQL | HDF5 | HPC | JWT | Kafka | Linux | Message Queues | Migrations | NumPy | OAuth | PBS | Parquet | PostgreSQL | Python | REST API | RabbitMQ | Redis | Role-Based Access | Role-Based Access Control | SQL | SQLAlchemy | Server-Sent Events | Slurm | Streaming File Formats | Subprocess management | Tortoise ORM | WebSockets
Education
N/A
Related jobs
-
Senior-level Full TimeBengaluru, Karnataka, India R5h ago
-
Senior ML Operations Engineer INR 2500K-5000KAI Governance | AWS | Automated retraining | Azure | Azure MLSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Software Development Specialist INR 940K-940KAmazon CloudWatch | Amazon DynamoDB | Amazon S3 | Amazon Web Services | Azure DevOpsMid-level Full TimeBangalore, KA, IN R9h ago
-
Senior Manager INR 1500K-2800KAWS Glue | AWS Secrets | AWS Secrets Manager | Adaptive Query | Adaptive query executionHybrid work modeSenior-level Full TimePune, Maharashtra, India R10h ago
-
Senior Consultant - Data Engineering- INR 2000K-3500KApache Kafka | Apache Spark | Cloud Computing | Data Modeling | Data PipelinesSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Mid-level Full TimeBengaluru, Pune10h ago
-
Mid-level Full TimeIndia, Telangana, Hyderabad10h ago
-
Senior Data Engineer INR 3000K-4200KAPI Management | AWS | Application Architecture | Azure API | Azure API ManagementSenior-level Full TimeIndia10h ago
-
Data Science Chief Expert - Finance INR 3000K-4000KAWS | Azure | Cloud platform | Cypher | Data PreprocessingExecutive-level Full TimeBangalore, IN, 56006617h ago
-
Sr Technical Lead-BI INR 1500K-3000KAgile | BI Data modeling | DAX | Data Modeling | Data WarehousingSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
Technical Lead-BI INR 1500K-2700KDAX | Data Modeling | Data Warehousing | Dimensional Modeling | ETLSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
IN_Sr Associate_Java Full Stack Engineer_D&A_Advisory_Bangalore INR 1200K-2500KAngular | Apache Kafka | App Service | Azure | Azure AppFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India17h ago
-
IN_Senior Associate_ Data Scientist_D&A_Advisory_Bangalore INR 3000K-4000KBig Data | Causal Inference | Data Manipulation | Data Modeling | Data VisualizationSenior-level Full TimeBengaluru Millenia, India17h ago
-
EY - GDS Consulting - AIA - AI Engineer- Senior INR 2500K-5000KAI Foundry | AI Observability | AWS Bedrock | Access Controls | Asynchronous programmingCoaching and confidence | Continuous learning | Diverse and inclusive culture | Flexible tools and supportSenior-level Full TimeChennai, TN, IN, 60003217h ago
-
API Integration | Access Control | Agent Orchestration | CI/CD | Change ManagementContinuous professional development | Flexible working | Inclusive workplaceMid-level Full TimeHyderabad, TG, IN, 50003217h ago
-
ESP Security Data Engineer INR 2000K-2700KAccess Controls | Automation | Cloud Platforms | Continuous Improvement | Data ArchitectureMid-level Full TimeBengaluru, KA, IN, 56004817h ago
-
APM | AWS | Ansible | Asynchronous programming | AzureSenior-level Full TimeIND - Chennai, Neville Towers, India17h ago
-
Java API & Microservices Engineer / Architect INR 2500K-3500KAPI Testing | Azure | CI/CD | Cassandra | DatadogSenior-level Full TimeBangalore, KA, IN R17h ago
-
EY - GDS Consulting - AIA - AI Platform Engineer- Senior INR 3000K-5449KAI Search | AI Services | Agent SDK | Autogen | Azure AISenior-level Full TimeBengaluru, KA, IN, 56004817h ago
-
Senior-level Full TimeBangalore, KA, IN R17h ago
-
Cloud AI / Agentic AI Developer - Manager INR 1860K-2500KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon BedrockEmployee networks | Flexible work/life support | Paid volunteer daysMid-level Full TimeHyderabad, India17h ago
-
Data Engineer- Azure Databricks- Senior Associate INR 1500K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore (SDC) - Bagmane Tech Park, …17h ago
-
Data Engineer- Azure Databricks- Senior Associate INR 1500K-2000KAnalysis Services | Apache Mahout | Apache Spark | Azure Analysis | Azure Analysis ServicesMid-level Full TimeBangalore (SDC) - Bagmane Tech Park, …17h ago