Lead Integration Engineer
Pune - Maharashtra - India
INR 1500K-3000K (estimate) Senior-level Full Time
Tasks
- Collaborate to integrate streaming data with downstream systems
- Deploy and manage CI CD pipelines with GitLab
- Design streaming pipelines
- Develop Kafka producers consumers connectors schemas
- Develop automation and streaming applications with Python
- Ensure availability fault tolerance and performance tuning
- Ensure security and compliance for streaming platform
- Implement Kafka topic management
- Manage AWS services
- Monitor troubleshoot and optimize streaming pipelines
- Provision cloud infrastructure with Terraform
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EC2 | AWS IAM | AWS VPC | Amazon CloudWatch | Amazon MSK | Amazon S3 | Apache Kafka | CI/CD | Confluent Kafka | Distributed Systems | Event Driven | Event-driven architecture | GitLab | Kafka Connect | Kafka Streams | Python | Schema Registry | SnapLogic | Terraform
Education
Roles
Data Engineer | Engineer | Integration Engineer | Lead | Lead Integration Engineer
Related jobs
-
Data Science - Senior Architect (Healthcare & Life Sciences) INR 2500K-5000KAWS | Amazon SageMaker | CI/CD | Containerization | Data ModelingSenior-level Full TimeChennai, India3h ago
-
Sr. Data Engineer INR 1500K-2500KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimePune City, India3h ago
-
Lead Data Engineer - Fabric INR 1400K-2700KAPI Integration | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure SynapseEmployee referral bonuses | Flexible work options | In-house technology training | Learning and development programs | Medical insuranceSenior-level Full TimePune City, India3h ago
-
Senior-level Full TimeIndia5h ago
-
Senior-level Full TimeBangalore - Karnataka - India6h ago
-
Senior-level Full TimeBangalore - Karnataka - India6h ago
-
Senior GenAI Engineer — Claude INR 2000K-5000KAPI Development | AWS | Embeddings | Function Calling | GuardrailsSenior-level Full TimeNoida, Uttar Pradesh, India6h ago
-
Senior GenAI Developer — OpenAI INR 2000K-5000KAssistants API | Azure | Azure OpenAI | Azure OpenAI API | CI/CDSenior-level Full TimeNoida, Uttar Pradesh, India6h ago
-
Senior Software Engineer - (Backend,AI) INR 3242K-5000KAPI Gateway | AWS | AWS Lambda | Agent Orchestration | Amazon APIFamily well-being benefits | Health benefits | Hybrid work | Paid time off | Wellbeing supportSenior-level Full TimeHyderabad, India R6h ago
-
Mid-level Full TimePune, Maharashtra, India7h ago
-
GCP Data Engineer INR 2800K-4000KAirflow | Apache Spark | BigQuery | Cloud Composer | Cloud FunctionsSenior-level Full TimeIndia7h ago
-
Senior Data Engineer INR 1500K-2700KApache Airflow | Apache Hadoop | Apache Iceberg | Apache Spark | DBTSenior-level Full TimeHyderabad, TS, India9h ago
-
Databricks Engineer INR 1500K-2800KADLS Gen2 | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, TS, India9h ago
-
Sr Generative AI Engineer (Agentic AI & RAG) INR 3264K-5000KAI Agent Builder | Agent Builder | Agent Orchestration | Apex | BigQuerySenior-level Full TimePune, MH, India10h ago
-
Software Engineer, Machine Learning INR 3242K-4580KClassification Models | Data Mining | Deep learning | Distributed Training | Embedding ModelsFlexible work hybrid work arrangementSenior-level Full TimeBengaluru, KA, India R10h ago
-
Robotics Engineer Fresher INR 300K-400KArduino | Artificial Intelligence | Automation | C plus plus | C#Career growth in EdTech and robotics | Exposure to robotics competitions | Mentorship opportunities globallyEntry-level Full TimeBangalore, Karnataka, India10h ago
-
Software Developer (Python, Skywise, Pyspark, AWS) INR 2000K-3500KAPI | AWS Lambda | Agile | Airbus Values | Amazon RDSSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Software Engineer III, Big Data INR 2040K-3465KApache Flink | Apache Hive | Apache Spark | Cloud Composer | Cloud StorageHybrid workSenior-level Full TimeHyderabad, Telangana 500081, India R11h ago
-
AWS | CD tools | CI/CD | CI/CD Tools | Data QualitySenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3300KAPIs | Agent Frameworks | Azure | Azure OpenAI | BERTMid-level Full TimeBangalore, Karnataka, India11h ago
-
Associate Engineer INR 1500K-2500KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN11h ago
-
Forward Deployed AI Scientist INR 2500K-4200KAWS Bedrock | Agentic Workflows | Artificial Intelligence | CI/CD | Crew AICommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, -12h ago
-
Customer Engineer INR 1436K-1820KAPI Integration | AWS | Algorithms | Cassandra | Cloud platform24/7 on-call rotation | Flexible work arrangements | Weekend shift rotation as neededMid-level Full TimeBangalore12h ago
-
Full Stack Data Engineer INR 1500K-2000KAirflow | Batch Processing | BigQuery | CI/CD | Cloud BuildMid-level Full TimeChennai, Tamil Nadu, India12h ago
-
Senior-level Full TimeBengaluru, KA, IN12h ago