SDE IV - Data Engineer
Tasks
- Architect data contracts and event schemas
- Build and maintain data lakehouse architecture
- Collaborate on low latency data reads for targeting
- Define data quality lineage observability SLA standards
- Design backend services for DSP functionality
- Design batch and real-time data pipelines
- Ensure API reliability SLOs circuit breakers retries observability
- Establish data governance metadata catalog access control PII retention
- Lead architecture reviews set engineering standards
- Mentor engineers through code reviews and design sessions
- Own StarRocks deployment for real time analytics
- Own data infrastructure technical roadmap capacity planning migrations build vs buy
- Partner with ML engineers on feature engineering and model serving
- Translate business requirements into technical designs
Perks/Benefits
- N/A
Skills/Tech-stack
Aerospike | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | Apache Spark Structured Streaming | Apache Zookeeper | ArgoCD | CCPA | CI/CD | Cassandra | ClickHouse | Dagster | Data Governance | Delta Lake | Dimensional Modeling | Event Driven | Event-driven architecture | GDPR | GRPC | GitHub Actions | Java | Kubernetes | Prefect | Python | REST API | SQL | Scala | Snowflake | Spark Structured Streaming | Starrocks | Structured Streaming
Education
Roles
Data Engineer | Engineer | Lead | Tech Lead
Related jobs
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN2h ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageMid-level Full TimePune, India2h ago
-
Mid-level Full TimePune, India2h ago
-
Associate Software Engineer INR 1300K-2000KAgile | Design Patterns | JavaScript | Python | REST APIMid-level Full TimePune, India2h ago
-
Tech Lead Data Engineer INR 1500K-2600KAWS Data | AWS Glue | AWS data warehousing | Amazon Athena | Amazon EKSGreat Place to Work recognitionSenior-level Full TimePune, India2h ago
-
Senior-level Full TimePune, India2h ago
-
Data Engineer INR 1500K-2500KAWS Glue | Agile methodology | Amazon Athena | Amazon EMR | Amazon KinesisMid-level Full TimePune, India2h ago
-
Senior AI-ML Platform Engineer / Tech Lead INR 2500K-5000KAI Foundry | API Gateway | API Keys | AWS Bedrock | AWS CloudFormationInclusion and Belonging CultureSenior-level Full TimeBangalore, Karnataka, IN, 5601003h ago
-
Senior-level Full TimeHyderabad R4h ago
-
Automation | Azure | Azure Data | Azure Data Explorer | Azure Log AnalyticsCross-functional collaboration | Professional growth | Remote workMid-level Full TimeIndia R4h ago
-
Staff Engineer (Cloudera CDP & Hadoop Administration) INR 1500K-3300KAnsible | ArgoCD | Automation | CI/CD | Cloudera CDPSenior-level Full TimeBengaluru, India5h ago
-
CI/CD | Claude | Code Analysis | Code modernization | Code remediationBusiness resource groups | Career progression | Disability insurance | Employee stock purchase plan | Family leaveSenior-level Full TimeIndia R5h ago
-
API Development | AWS EMR | Amazon EC2 | Amazon IAM | Amazon S3Flexible paid time off | Professional growth opportunities | Remote work from India | Stock grantsSenior-level Full TimeIndia R6h ago
-
AWS | Agile | Azure | Debugging | Deep learningConference access | Financial and legal consultation support | Internal mobility | Language learning resources | Learning and development initiativesSenior-level Full TimeIndia R8h ago
-
AWS | Agent Serving | Ansible | Argo CD | ArgoCDSenior-level Full TimeBangalore (SDC) - Bagmane Tech Park, …10h ago
-
Technical Lead-Data Engg INR 2000K-4500KAgent Bricks | Agentic AI | Apache Spark | Data Ingestion | Data ModelingSenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN10h ago
-
Senior-level Full TimePune, IN10h ago
-
Sr Technical Lead-App Development INR 2500K-5000KAWS | Amazon Bedrock | Azure | Data Lake | ElasticsearchImmediate joiner onlySenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN10h ago
-
Senior-level Full TimeIndia - Hyderabad10h ago
-
Planview Administration 169576 INR 1500K-2700KData Cleansing | Data Modeling | Data Validation | Data pipeline | Data pipeline orchestrationSenior-level Full TimeHyderabad, IND-TG, India16h ago
-
Mid-level Full TimeHyderabad, IND-TG, India16h ago
-
Engineering Team Lead (ETL) INR 2800K-5000KAI Agentic | AI Agentic frameworks | AI tools | Agentic Frameworks | AgileSenior-level Full TimeHyderabad19h ago
-
Senior Sales Engineer INR 2500K-4500KAI Model Training | AI model | AI workloads | File System | GPU clustersSenior-level Full TimeRemote - India R19h ago
-
Senior Software Engineer, Applied AI and Customer Solutions INR 3715K-5449KAPI Gateway | AWS | Access Management | Agentic AI | CI/CDSenior-level Full TimeIndia20h ago
-
Senior Agentic AI Engineer ID80140 INR 2000K-5000KAnthropic API | CI/CD | Infrastructure as Code | Langchain | LanggraphFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeBengaluru, India20h ago