SDE III - Data Engineering
Tasks
- Build ETL/ELT frameworks
- Build feature generation frameworks for machine learning and recommendations
- Build ingestion and enrichment pipelines for affiliate feeds merchant catalogs and D2C integrations
- Build internal AI powered tools and self service platforms for developer productivity
- Build user identity resolution and cross surface signal aggregation
- Create low latency feature pipelines for training and online inference
- Create user profiling audience creation segmentation and personalization datasets
- Debug data pipelines and implement data quality triage
- Design batch and real-time data pipelines
- Design commerce catalog schemas and taxonomy frameworks
- Develop data products for analytics experimentation recommendations and personalization
- Develop deterministic and probabilistic identity stitching
- Generate and optimize SQL and improve metadata discovery
- Implement catalog quality deduplication normalization and enrichment systems
- Implement observability monitoring lineage alerting reconciliation and quality checks
- Lead architecture and design discussions and drive engineering best practices
- Mentor junior engineers and maintain code quality testing documentation CI CD and infrastructure
- Own production services and ensure reliability and SLAs
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Alerting | Apache Flink | Apache Kafka | Apache Spark | Audience Segmentation | Batch Processing | BigQuery | CI/CD | Cost Optimization | Customer 360 | Data Lineage | Data Processing | Data Validation | Data Warehousing | Databricks | Deduplication | Dimensional Modeling | Distributed data | Distributed data processing | ELT | ETL | Feature Stores | GCP | Identity resolution | Infrastructure Management | Infrastructure as Code | Java | MLOps | Machine Learning | Monitoring | Performance Tuning | Personalization | Python | Real Time | Real-time Processing | Recommendations | Reconciliation | SQL | Scala | Schema Design | Taxonomy | Time processing | User Profiling | “as-code”
Education
N/A
Roles
Related jobs
-
Manager – Forward Deployed Engineer, Agentic AI INR 2000K-5000KAPIs | Agent memory | Asynchronous processing | Authentication | AuthorizationSenior-level Full TimeHyderabad, TS, India1d ago
-
Senior Software Engineer (Infra) INR 2400K-3500KC++ | Distributed Systems | Java | Networking | PythonSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer - Search INR 2500K-4200KInformation Retrieval | Language Models | Language Processing | Large Language Models | Machine LearningSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer - Data Platform INR 2500K-3584KAWS | Agentic AI | Apache Airflow | Apache Druid | Apache FlinkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India R1d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Tech Lead Software Engineer – AI Ops/Support INR 2500K-4500KAIOps | API Gateway | AWS | Amazon Bedrock | Amazon SageMakerSenior-level Full TimeIndia Office1d ago
-
Senior BI & AI Engineer INR 3000K-4000KDAX | LLM | Langchain | Llamaindex | PandasAccess to Headspace app | Flexible vacation | Hybrid work model | Mental health days | Paid volunteer days offSenior-level Full TimeIndia, Hyderabad, Telangana R1d ago
-
Senior-level Full TimeBengaluru - GTP, India1d ago
-
AI / Generative AI Sr. Associate INR 2000K-4500KAI Governance | AI guardrails | AWS Bedrock | Agentic AI | Azure OpenAIFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - GTP, India R1d ago
-
Senior-level Full TimeChennai, Tamil Nadu, India2d ago
-
Data Engineering Manager - GCP INR 1500K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerSenior-level Full TimeHyderabad, TS, India2d ago
-
Anthropic Claude | Application Insights | Asynchronous programming | Automated testing | Azure Application InsightsFlexible working environment | Long-term engagement | Mentorship opportunities | Remote workSenior-level Contract Full TimeIndia R2d ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE)2d ago
-
Senior-level Full TimeHyderabad, Noida, Chennai, India2d ago
-
DATA Architect - Lead Systems Engineer INR 2771K-4132KAgile | Apache Airflow | Apache Kafka | Apache Spark | Audit LoggingSenior-level Full TimeIndia2d ago
-
Lead Salesforce Full Stack AI Engineer INR 3715K-5449KAPI Design | Agile | Apex | Automated testing | Azure DevOpsFlexible schedule | Generous vacation days | Health coverage | Parental leave | Volunteer timeSenior-level Full TimeBangalore, India2d ago
-
AI Foundry | AWS | AWS SageMaker | Agentic AI | Amazon Bedrock401k match | Career development resources | Dental insurance | Flexible work arrangements | Health Savings Account medical planSenior-level Full TimeIndia2d ago
-
Engineer, Storage and Data Protection INR 1500K-2600KAlerting | Ansible | Automation | Backup | BashMid-level Full TimeGurugram, Haryana2d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EMRSenior-level Full TimeNoida, India2d ago
-
Associate Engineer - Data engineer INR 1000K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksCollaborative work environment | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …2d ago
-
Senior-level Full TimeGurugram, India2d ago
-
Mid-level Full TimeHyderabad, India2d ago
-
AI Transformation Engineer INR 2000K-4408KAPI Integration | Agent Frameworks | Agents SDK | Automated testing | Backend DevelopmentMid-level Full TimeBengaluru, India2d ago
-
Senior Forward Deployed Engineer INR 1500K-2800KAI APIs | AWS | Apache Spark | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeBengaluru, India2d ago
-
Senior Software Engineer, AI/ML INR 2000K-5000K3D mathematics | Agent systems | Autonomous Agents | C plus plus | Computational GeometrySenior-level Full TimeBengaluru, Karnataka, India2d ago