Software Engineer – Data Platform
Bengaluru, KA, India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Build enhance extraction services
- Build production metadata driven data handling components
- Define and version control data quality rules and validation frameworks
- Design secure scalable fault tolerant data ingestion pipelines
- Develop reusable version controlled platform components APIs and data interfaces
- Establish data quality management monitoring and reporting
- Implement CDC, delta, and event-based patterns
- Implement automated data quality monitoring with quarantining logic
- Implement observable data pipelines with logging alerting and failure handling
- Implement structured data access request workflows with audit trails
- Integrate Unity Catalog for lineage and dataset discoverability
- Integrate with SAP Salesforce SharePoint and API or file endpoints
- Maintain web accessible data catalog metadata management and integration
- Operate services APIs and data pipelines
Perks/Benefits
Skills/Tech-stack
APIs | Alerting | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | CDC | CI/CD | Data Lake Storage | Data Lakes | Data Quality | Databricks | Debezium | Distributed Systems | ETL | Git | HTTP | Integration Services | Java | Kerberos | Logging | Metadata Management | Monitoring | Python | Rclone) | SQL | SQL Server | SQL Server Integration Services | SQL Server integration | Scala | Server Integration Services | Theobald Extract Universal | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Partner Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-5000KAPIs | Agent Development | Agent Development Kit | Agent systems | Cloud platformSenior-level Full TimeMumbai, Maharashtra, India1h ago
-
Lead AI/ML Engineer – Security AI & LLMs INR 3000K-5000KAPI Design | AWS SageMaker | Azure ML | Deep learning | DockerSenior-level Full TimePune, Maharashtra, India4h ago
-
Senior-level Full TimeMitratech India6h ago
-
Genetics Data Engineer 1 INR 3000K-4600KAPI Development | AWS | Agentic AI | Azure | BcftoolsCareer development opportunities | Flexible work culture | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, IN, 5600376h ago
-
APIs | Airflow | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru6h ago
-
Senior-level Full TimeHyderabad7h ago
-
Node JS Developer - Senior Consultant INR 2200K-3500KAWS OpenSearch | Agile | Apache Kafka | Bull queue | CI/CDSenior-level Full TimeBangalore, IN, 5600667h ago
-
Tech Lead - Java (Java, React, Kong) INR 1500K-3000KAPI Development | API Gateway | API Management | API Security | AgileSenior-level Full TimePune, IN, 4110577h ago
-
Senior-level Full TimeHyderabad, IN, 5000817h ago
-
Senior AI Engineer INR 2500K-5000KA2A | AI Foundry | AI Search | AI guardrailing | Agent architectureCollaboration | Documentation | Startup mindsetSenior-level Full TimeHyderabad7h ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R7h ago
-
Data Analytics/Engineer (Python and MS Fabric exp) INR 2500K-4720KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseCross-functional collaboration | Mentorship | Professional developmentSenior-level Full TimeIND-Pune-Smartworks, India12h ago
-
AI Architect INR 3000K-5000KAPIs | Artificial Intelligence | Cloud Computing | Data Management | Data integrationSenior-level Full TimeMumbai (ex Bombay), IN12h ago
-
AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure DataSenior-level Full TimeBengaluru Millenia, India12h ago
-
API | Agentic AI | Anthropic | Bagging | BoostingFlexibility programmes | Hybrid work | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India12h ago
-
Technical Lead-Azure Databricks INR 1500K-2700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN12h ago
-
Software Engineer - Python Expert, API Frameworks, RAG, Gen AI, Devops, Frontend Frameworks (5+ Years) INR 2500K-5000KAgentic AI | Alerting | Angular | CI/CD | Cause analysisSenior-level Full TimeIND-BANGALORE, India12h ago
-
Snowflake Data Engineer INR 2000K-2600KAmazon Web Services | Apache Spark | Bitbucket | CI/CD | Cloud platformSenior-level Full TimeBangalore, KA, IN12h ago
-
Senior-level Full TimeBangalore, KA, IN12h ago
-
Senior-level Full TimeBangalore, KA, IN12h ago
-
Senior-level Full TimeBengaluru, KA, IN12h ago
-
EY - GDS Consulting - AI And DATA - Databricks - Senior INR 2400K-4000KAPI | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeTrivandrum, KL, IN, 69558112h ago
-
TTT-.NET-Angular-Full Stack with Gen AI-Staff INR 2000K-3500K.NET | AI Agent | AI Agent Frameworks | AI Search | Agent FrameworkSenior-level Full TimeKolkata, WB, IN, 70009112h ago
-
TTT - .NET - Angular-Full Stack with Gen AI - Senior INR 2000K-4500K.NET | AI Foundry | AI Search | App Service | Azure AISenior-level Full TimeKolkata, WB, IN, 70009112h ago
-
Senior Data Engineer - PySpark & Python INR 1500K-2500KApache Airflow | Apache Spark | CI/CD | Data Cleansing | Data LinkingSenior-level Full TimeBengaluru, Karnataka, India12h ago