SDE III - Data Engineering
Tasks
- Build ingestion and enrichment pipelines for commerce catalogs
- Build low latency feature pipelines for training and online inference
- Build user identity resolution and cross surface signal aggregation
- Create datasets for user profiling audience creation segmentation and personalization
- Design and build batch and real-time data pipelines
- Design scalable schemas and taxonomy frameworks
- Develop ETL/ELT frameworks
- Develop feature generation frameworks for ML and recommendation systems
- Develop internal AI powered developer tools and self service platforms
- Drive architecture and design discussions
- Implement catalog quality deduplication normalization and enrichment systems
- Implement observability monitoring lineage alerting reconciliation and quality checks
- Improve code quality testing documentation CI CD and infrastructure management
- Lead incident response root cause analysis and operational reviews
- Mentor junior engineers and raise technical bar
- Own production services and pipelines with SLAs
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Alerting | Apache Flink | Apache Kafka | Apache Spark | Audience Segmentation | Batch and Streaming | Batch and streaming architectures | BigQuery | CI/CD | Data Lineage | Data Validation | Data Warehousing | Databricks | Developer tools | Dimensional Modeling | Distributed Systems | ELT | ETL | Feature Store | GCP | Identity resolution | Infrastructure as Code | Java | LLM | LLM-powered | LLM-powered developer tools | MLOps | Monitoring | Python | Reconciliation | SQL | Scala | Schema Design | Streaming Architectures | “as-code”
Education
N/A
Roles
Related jobs
-
Software Engineer III - Python INR 3000K-5000KAlerting | CI/CD | Docker | Infrastructure as Code | KubernetesSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde3h ago
-
Agentic AI | Agile | Artificial Intelligence | Docker | Generative AISenior-level ContractShaikpet, India4h ago
-
Senior AI Engineer / Data Scientist (Agentic AI) INR 2000K-5000KAI Search | AI Services | Agentic AI | Azure | Azure AISenior-level Full TimeChennai, India4h ago
-
Senior-level Full TimeIN-KA-Bangalore4h ago
-
GenAI Developer INR 1800K-4500KAPI Development | AWS | Azure | C++ | Cloud platformFull-time work | Work from OfficeSenior-level Full TimeIN-TN-Chennai4h ago
-
Expert Data Engineer INR 3500K-4200KAPI Integration | Access Control | Attribute-Based Access Control | Attribute-based access | Audit LoggingHybrid workSenior-level Full TimeBangalore, Karnataka, India4h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India5h ago
-
Amazon S3 | Apache Iceberg | Cloud Computing | Concurrency | Data ModelingCareer development | Health benefits | Paid time off | Remote work flexibilitySenior-level Full TimeHyderabad, India6h ago
-
Agile | Apache Airflow | Azure Data | Azure Data Factory | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India6h ago
-
Staff Software Engineer, Machine Learning INR 3000K-4680KC++ | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Fine TuningHealth and wellness programs | Time awaySenior-level Full TimeBengaluru, KA, India6h ago
-
Mid-level Full TimeBangalore, Karnataka, IN7h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN7h ago
-
Senior-level Full TimeHyderabad, Telangana, India7h ago
-
Principal Software Engineer INR 2000K-4800KAlgorithms | Auditability | Automation | Azure | Cause analysisSenior-level Full TimeIndia, Karnataka, Bangalore7h ago
-
Data Engineer - Associate Director INR 1500K-2600KAWS | AWS Glue | Agile | Apache Airflow | Apache HadoopMid-level Full TimeBangalore, Karnataka, India8h ago
-
Software Engineer III - ( Java , Python) INR 2000K-3500KAI Assisted Development | AWS | Agile | CI/CD | JavaSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Entry-level Full TimeHyderabad9h ago
-
Sr. Data Engineer INR 2800K-4000KApache Airflow | Apache Spark | Batch Processing | CI/CD | Cloud ComposerSenior-level Full TimeGurgaon, Haryana, India9h ago
-
Software Engineer II - Java, UI, Spark, Kafka INR 1600K-2800KAngular | Apache Airflow | Apache Hive | Apache Spark | Automated testingMid-level Full TimeMumbai, Maharashtra, India9h ago
-
Mid-level Full TimeHyderabad, TS, India9h ago
-
Senior Data Scientist INR 2000K-5000KAWS | Artificial neural networks | Azure | Chunking | Data StructuresSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Engineer, Agentic AI & MLOps Engineering (5-8 years) INR 3700K-5000KAPIs | Agent Orchestration | Agent systems | Deep learning | LLMOpsSenior-level Full TimeBengaluru, KA, India9h ago
-
Databricks Engineer INR 1500K-2700KAuto Loader | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeChennai, Tamil Nadu, India10h ago
-
Vice President, Snowflake Data Engineer INR 4000K-5199KAI chatbots | AWS | Access Control | Azure | CollibraExecutive-level Full TimePune, MH, India10h ago