Senior Software Engineer – Data Platform (Tech Lead)
Bengaluru, KA, India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Collaborate on secure compliant system design
- Create lakehouse architecture patterns
- Define API design standards and contract management
- Define and evolve data interface standards
- Define ingestion frameworks for batch streaming and event driven architectures
- Define interface specifications and integration strategies
- Design ingestion patterns with fault tolerance observability and performance
- Drive consistency and reuse across ingestion patterns
- Enable ingestion for data science machine learning and AI integrations
- Escalate complex ingestion and integration issues
- Establish CI CD testing and observability standards
- Govern structured and unstructured data standards
- Guide engineers on production ingestion services
- Lead design reviews for complex ingestion pipelines
- Maintain reusable libraries templates and framework components
- Optimize scalability resource utilization and performance
- Own data ingestion and integration architecture
- Promote code reviews testing strategies and CI CD pipelines
- Provide technical leadership for ingestion and integration components
- Support cost transparency and usage optimization
- Support error handling retry orchestration and monitoring
Perks/Benefits
Skills/Tech-stack
API Design | Application Programming | Application Programming Interfaces | Automated testing | Azure | CI/CD | CSV | Change Data Capture | Data Capture | Data Warehousing | Data integration | Databricks | Error Handling | Event Driven | Event-driven architecture | Fault Tolerance | JSON | Java | Lakehouse | Monitoring | Observability | Orchestration | Performance optimization | Programming interfaces | Python | Resource utilization | Retry Mechanisms | Scala | Schema evolution | Streaming | Version control | XML
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Data Engineer - II (Biometrics) INR 700K-1500KAWS | Amazon EC2 | Amazon S3 | Amazon SageMaker | Apache AirflowMid-level Full TimeBangalore8h ago
-
Senior Data Engineer INR 3000K-4000KCI/CD | Cloud Storage | Column-Level Security | DBT | Data GovernanceHybrid work environment | Mentorship and growth opportunitiesSenior-level Full TimeChennai, India9h ago
-
AI Engineer (M/F/D) INR 2000K-4000KAgents SDK | Azure | CI/CD | Docker | FastAPICareer development | Flexible working models | International networking | Learning opportunities | Modern inclusive work environmentMid-level Full TimeHyderabad, IN9h ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2500K-4000KAI Models | APIs | Active Directory | Authentication | AuthorizationSenior-level Full TimeHyderabad, IN9h ago
-
Data Engineer INR 1500K-2000KAWS Glue | AWS Glue Data Catalog | Access Control | Apache Airflow | Apache KafkaMid-level Full TimeBangalore, Karnataka, IN India, 56008715h ago
-
Junior AI Developer INR 180K-192KClassification | Clustering | ETL | Excel | GitCareer guidance | Hands-on experience | Mentorship | Work on live projectsEntry-level Full TimeDGS India - Bengaluru - Manyata …15h ago
-
Data Engineer-Staff Software Engineer INR 1500K-2500KApache Spark | Azure Data | Azure Data Factory | Continuous Delivery | Continuous integrationSenior-level Full TimeSpoke - Hyderabad, India15h ago
-
Staff Software Engineer INR 2000K-3500KAPI Gateway | API Versioning | AWS | Asynchronous processing | CAP TheoremSenior-level Full TimeBengaluru, KA, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, IN1d ago
-
Senior Robotics Engineer INR 2500K-5000KC++ | CAD | Cloud processing | Computer Vision | Dataset EngineeringSenior-level Full TimeBangalore, Karnataka, IN1d ago
-
Lead - Data Scientist INR 3715K-5449KAnomaly Detection | Calculus | Deep learning | Distributed Systems | GenAISenior-level Full TimeBengaluru, India2d ago
-
Senior-level Full TimeIN-KA-Bangalore2d ago
-
AES - DE - Generative AI Application Developers INR 1500K-2500KAWS | Data Ingestion | Inferencing | LLM workflow | Language ModelsMid-level Full TimePune, Maharashtra, India2d ago
-
Senior Forward Deployed Engineer II (AI/ML) INR 1800K-3500KAgents SDK | CUDA | Cache optimization | Continuous batching | CrewAIMid-level Full TimeBengaluru2d ago
-
Senior Forward Deployed Engineer I (AI/ML) INR 3000K-4800KAgents SDK | CUDA | Continuous batching | CrewAI | Data CompressionHybrid work | Travel up to 30%Senior-level Full TimeBengaluru2d ago
-
Lead Data Science INR 3000K-6000KAWS | Agent to Agent | Airflow | Amazon Bedrock | Amazon SageMakerSenior-level Full TimeBangalore, KA, IN, 5600762d ago
-
AI Backend Engineer (SDE-2) INR 4000K-5500KAPI Design | Agent Orchestration | Chunking | Concurrency | Data ModelingSenior-level Full TimeBengaluru Office2d ago
-
Senior AI and Machine Learning Engineer INR 3584K-4600KConvolutional Neural Networks | Data Mining | Data Preprocessing | Data Visualization | Decision TreesMentorship and guidance | Onsite work arrangement | Professional development programsSenior-level Full TimeBengaluru, Karnātaka, India2d ago
-
Senior AI and Machine Learning Engineer INR 3584K-4600KCalculus | Convolutional Neural Networks | Data Mining | Data Preprocessing | Data VisualizationCareer Development Programs | Flexible work options | Health & wellbeing programs | Inclusive work environmentSenior-level Full TimeBengaluru, Karnātaka, India2d ago
-
Principal Analytics Engineer- Azure data warehouse, ADF/Synapse, T-SQL, data pipeline design INR 2520K-3500KAnalysis Services | Azure | Azure Analysis | Azure Analysis Services | Azure DataHybrid work flexibility | Virtual work supportSenior-level Full TimeGurgaon - Cyber Park, India2d ago
-
Embedded Test Engineer INR 600K-1400KAgile | Debugging | Embedded Systems | Embedded firmware | Functional testingMid-level Full Time(HE)Office Commerzone, India2d ago
-
Data Engineer INR 1500K-2500KCloud technologies | Cognite Data Fusion | Data Fusion | Data Modeling | Data QualitySenior-level Full TimeChennai, CDC2F, India2d ago
-
Senior Deep Learning Research Engineer – Multimedia GPU team INR 2500K-4500K3D Gaussian Splatting | Audio signal processing | CUDA | CUDNN | Diffusion ModelsSenior-level Full TimeIndia, Bengaluru2d ago
-
Mid-level Full TimeBengaluru, BDC11A, India2d ago
-
Mid-level Full TimeBengaluru, BDC11A, India2d ago