Software Engineer – Data Platform
Bengaluru, KA, India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Build data catalog backend services and metadata management
- Build extraction services
- Build metadata driven data components
- Create fault tolerant observable pipelines
- Define and implement data quality framework
- Design data ingestion pipelines
- Design structured access request workflows
- Develop data lake transfer delivery components
- Develop reusable version controlled components
- Ensure documentation and compliance for data ingress
- Establish SAP extraction using Theobald Extract Universal
- Implement CDC delta event based patterns
- Implement CI CD delivery pipelines
- Implement audit trail and traceability
- Implement data platform APIs
- Integrate data lineage and Unity Catalog
- Integrate with SAP Salesforce SharePoint and APIs
- Set up automatic DQ monitoring severity levels
- Set up logging alerting failure handling
Perks/Benefits
Skills/Tech-stack
APIs | Alerting | Audit Trail | Azure | CDC | CI/CD | Data Catalog | Data Ingestion | Data Lake | Data Pipelines | Data Quality | Data Warehousing | Databricks | Distributed Systems | ETL | Event Driven | Git | HTTP | Java | JavaScript | Kerberos | Logging | Metadata Management | Monitoring | Python | SQL | Scala | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior IT Project Manager/ Prompt Engineer INR 2500K-3600KAgile | CI/CD | Case Routing | Copado | Data ArchitectureSenior-level Full TimeBangalore, Karnataka, IN, 5601007h ago
-
Senior-level Full TimeBangalore, KA, IN,8h ago
-
Senior Machine Learning Engineer, Content Platform INR 3264K-5000KAmazon EMR | Amazon S3 | Apache Airflow | BERT | Big Data401k retirement plan | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India10h ago
-
Sr Software Engineer l Java, AWS, Python, Microservices INR 3242K-4000KAWS | Agile | Architecture | Debugging | DesignSenior-level Full TimeMumbai, India10h ago
-
AI/ML Specialist - Agentic AI & Generative AI INR 2000K-5000KAgentic AI | Agile Scrum | Azure Machine Learning | Data Engineering | Data PipelinesSenior-level Full TimeHyderabad, TG, IN, 50003214h ago
-
Technical Lead-AI/ML, Generative AI & Agentic AI INR 2000K-4680KAgentic AI | Agile | Azure Machine Learning | Data Engineering | Data PipelinesSenior-level Full TimeHyderabad, TG, IN, 50003214h ago
-
Senior-level Full TimeChennai, India16h ago
-
Senior Staff Data Analytics Engineer INR 3242K-4500KAI Operations | AI gateway | API Management | Agentic Frameworks | AutomationSenior-level Full TimeBengaluru, KA, India18h ago
-
Senior-level Full TimePune, India20h ago
-
Solutions Engineer - Data Engineering INR 2000K-3000KApache Airflow | CI/CD | DAG | Data Transformation | DockerHybrid work model | Office in HyderabadMid-level Full TimeHyderabad21h ago
-
Senior-level Full TimeMumbai, Maharashtra, India21h ago
-
Staff Software Engineer (Python) INR 3500K-5000KAWS | Authentication | Batch Processing | Data Pipelines | Distributed SystemsCollaborative team environment | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India21h ago
-
Compute-Hyd 169229 INR 2000K-3000KAI Agents | API Development | Embeddings | LLM orchestration | Language ModelsMid-level Full TimeHyderabad, IND-TG, India22h ago
-
Lead Data Engineer - CDP INR 2500K-4500KAPI Gateway | Analytics.js | CCPA | CI/CD | CPRAArchitecture workshops | Client stakeholder management | Technical mentorshipSenior-level Full TimeHyderabad, TS, India22h ago
-
Senior Data Engineer - AWS INR 1500K-4000KAWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon RedshiftSenior-level Full TimeBangalore, India23h ago
-
Mid-level Full TimeBangalore - Karnataka - India Pune …1d ago
-
Business Analyst- Automation & AI Solutions (m/f/d) INR 1200K-1800KAuthentication | CI/CD | Databases | JSON | LLMCounseling | Hybrid work model | Learning and development | Mentoring program | Travel vouchersMid-level Full TimeGurugram1d ago
-
Mid-level Full TimeHyderabad, TS, 500032, IN1d ago
-
Attention Mechanisms | CUDA | Compute Graphs | Data Flow | Distributed SystemsEngineering excellence culture | Equity participation | Ownership | Remote workSenior-level Full TimeIndia1d ago
-
Principal Data Engineer INR 1500K-2500KAgile | Apache Airflow | Apache Kafka | Automated testing | CI/CDSenior-level Full TimeIN-MH-Pune1d ago
-
Senior-level Full TimeIN-MH-Pune1d ago
-
Network Data Scientist INR 2500K-4500KApplication Traffic Analysis | CI/CD | DNS | Data Pipelines | GitLab CISenior-level Full TimePune, IN1d ago
-
Algorithm Development | Automated trading | C++ | Electronic Trading | Financial MathematicsMid-level Full TimeHyderabad, Telangana, India1d ago
-
API Design | Anthropic | Automation | CRM Integrations | CrewAIDistributed work flexibility | Fully remote | High ownership roleMid-level Full TimeIndia R1d ago
-
Agentic AI Engineer INR 1200K-2500KAgentic architecture | Distributed Systems | Docker | LLM | LanggraphMid-level Full TimeKarnataka, Bengaluru, India1d ago