Senior Software Engineer – Data Platform (Tech Lead)
Bengaluru, KA, India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Collaborate on secure compliant system design
- Create lakehouse architecture patterns
- Define API design standards and contract management
- Define and evolve data interface standards
- Define ingestion frameworks for batch streaming and event driven architectures
- Define interface specifications and integration strategies
- Design ingestion patterns with fault tolerance observability and performance
- Drive consistency and reuse across ingestion patterns
- Enable ingestion for data science machine learning and AI integrations
- Escalate complex ingestion and integration issues
- Establish CI CD testing and observability standards
- Govern structured and unstructured data standards
- Guide engineers on production ingestion services
- Lead design reviews for complex ingestion pipelines
- Maintain reusable libraries templates and framework components
- Optimize scalability resource utilization and performance
- Own data ingestion and integration architecture
- Promote code reviews testing strategies and CI CD pipelines
- Provide technical leadership for ingestion and integration components
- Support cost transparency and usage optimization
- Support error handling retry orchestration and monitoring
Perks/Benefits
Skills/Tech-stack
API Design | Application Programming | Application Programming Interfaces | Automated testing | Azure | CI/CD | CSV | Change Data Capture | Data Capture | Data Warehousing | Data integration | Databricks | Error Handling | Event Driven | Event-driven architecture | Fault Tolerance | JSON | Java | Lakehouse | Monitoring | Observability | Orchestration | Performance optimization | Programming interfaces | Python | Resource utilization | Retry Mechanisms | Scala | Schema evolution | Streaming | Version control | XML
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Entry-level Full TimeHyderabad, India5h ago
-
Data Science - Senior Architect (Healthcare & Life Sciences) INR 2500K-5000KAWS | Amazon SageMaker | CI/CD | Containerization | Data ModelingSenior-level Full TimeChennai, India6h ago
-
Sr. Data Engineer INR 1500K-2500KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimePune City, India6h ago
-
Lead Data Engineer - Fabric INR 1400K-2700KAPI Integration | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure SynapseEmployee referral bonuses | Flexible work options | In-house technology training | Learning and development programs | Medical insuranceSenior-level Full TimePune City, India6h ago
-
Senior-level Full TimeIndia8h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-4800KAWS | Agile | Deep learning | Embedding Models | Hugging FaceCompany-paid certifications | Financial consultations | Internal training workshops conferences meetups | Language courses | Legal consultationsSenior-level Full TimeIndia8h ago
-
Lead Integration Engineer INR 1500K-3000KAWS EC2 | AWS IAM | AWS VPC | Amazon CloudWatch | Amazon MSKSenior-level Full TimePune - Maharashtra - India8h ago
-
Mid-level Full TimeBangalore - Karnataka - India8h ago
-
Senior-level Full TimeBangalore - Karnataka - India8h ago
-
Senior-level Full TimeBangalore - Karnataka - India8h ago
-
Senior GenAI Engineer — Claude INR 2000K-5000KAPI Development | AWS | Embeddings | Function Calling | GuardrailsSenior-level Full TimeNoida, Uttar Pradesh, India8h ago
-
Senior GenAI Developer — OpenAI INR 2000K-5000KAssistants API | Azure | Azure OpenAI | Azure OpenAI API | CI/CDSenior-level Full TimeNoida, Uttar Pradesh, India8h ago
-
Senior Software Engineer - (Backend,AI) INR 3242K-5000KAPI Gateway | AWS | AWS Lambda | Agent Orchestration | Amazon APIFamily well-being benefits | Health benefits | Hybrid work | Paid time off | Wellbeing supportSenior-level Full TimeHyderabad, India R9h ago
-
Mid-level Full TimePune, Maharashtra, India9h ago
-
GCP Data Engineer INR 2800K-4000KAirflow | Apache Spark | BigQuery | Cloud Composer | Cloud FunctionsSenior-level Full TimeIndia9h ago
-
Senior-level Full TimeIndia9h ago
-
Senior Data Engineer INR 3000K-4000KAI | AWS | Amazon Aurora | Automated reporting | AzureBike to work | Educational assistance | Employee assistance programme | Employee discount | Enhanced maternity/paternity leaveSenior-level Full TimeMumbai, MH, India R12h ago
-
Senior Data Engineer INR 1500K-2700KApache Airflow | Apache Hadoop | Apache Iceberg | Apache Spark | DBTSenior-level Full TimeHyderabad, TS, India12h ago
-
Databricks Engineer INR 1500K-2800KADLS Gen2 | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, TS, India12h ago
-
Sr Generative AI Engineer (Agentic AI & RAG) INR 3264K-5000KAI Agent Builder | Agent Builder | Agent Orchestration | Apex | BigQuerySenior-level Full TimePune, MH, India12h ago
-
Software Engineer, Machine Learning INR 3242K-4580KClassification Models | Data Mining | Deep learning | Distributed Training | Embedding ModelsFlexible work hybrid work arrangementSenior-level Full TimeBengaluru, KA, India R12h ago
-
Robotics Engineer Fresher INR 300K-400KArduino | Artificial Intelligence | Automation | C plus plus | C#Career growth in EdTech and robotics | Exposure to robotics competitions | Mentorship opportunities globallyEntry-level Full TimeBangalore, Karnataka, India13h ago
-
Software Developer (Python, Skywise, Pyspark, AWS) INR 2000K-3500KAPI | AWS Lambda | Agile | Airbus Values | Amazon RDSSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Software Engineer III, Big Data INR 2040K-3465KApache Flink | Apache Hive | Apache Spark | Cloud Composer | Cloud StorageHybrid workSenior-level Full TimeHyderabad, Telangana 500081, India R13h ago
-
AWS | CD tools | CI/CD | CI/CD Tools | Data QualitySenior-level Full TimeMumbai, Maharashtra, India14h ago