SDE IV - Data Engineer
Tasks
- Architect data contracts and event schemas
- Build and maintain data lakehouse architecture
- Collaborate on low latency data reads for targeting
- Define data quality lineage observability SLA standards
- Design backend services for DSP functionality
- Design batch and real-time data pipelines
- Ensure API reliability SLOs circuit breakers retries observability
- Establish data governance metadata catalog access control PII retention
- Lead architecture reviews set engineering standards
- Mentor engineers through code reviews and design sessions
- Own StarRocks deployment for real time analytics
- Own data infrastructure technical roadmap capacity planning migrations build vs buy
- Partner with ML engineers on feature engineering and model serving
- Translate business requirements into technical designs
Perks/Benefits
- N/A
Skills/Tech-stack
Aerospike | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | Apache Spark Structured Streaming | Apache Zookeeper | ArgoCD | CCPA | CI/CD | Cassandra | ClickHouse | Dagster | Data Governance | Delta Lake | Dimensional Modeling | Event Driven | Event-driven architecture | GDPR | GRPC | GitHub Actions | Java | Kubernetes | Prefect | Python | REST API | SQL | Scala | Snowflake | Spark Structured Streaming | Starrocks | Structured Streaming
Education
Roles
Data Engineer | Engineer | Lead | Tech Lead
Related jobs
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN2h ago
-
Senior-level Full TimePune, India3h ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageMid-level Full TimePune, India3h ago
-
Mid-level Full TimePune, India3h ago
-
Associate Software Engineer INR 1300K-2000KAgile | Design Patterns | JavaScript | Python | REST APIMid-level Full TimePune, India3h ago
-
Tech Lead Data Engineer INR 1500K-2600KAWS Data | AWS Glue | AWS data warehousing | Amazon Athena | Amazon EKSGreat Place to Work recognitionSenior-level Full TimePune, India3h ago
-
Senior-level Full TimePune, India3h ago
-
Data Engineer INR 1500K-2500KAWS Glue | Agile methodology | Amazon Athena | Amazon EMR | Amazon KinesisMid-level Full TimePune, India3h ago
-
Senior Staff Engineer, Supply chain optimization INR 3000K-4500KAMPL | AWS | Agent-Based Simulation | Agent-based | AnyLogicSenior-level Full TimeRemote, India R3h ago
-
Senior AI-ML Platform Engineer / Tech Lead INR 2500K-5000KAI Foundry | API Gateway | API Keys | AWS Bedrock | AWS CloudFormationInclusion and Belonging CultureSenior-level Full TimeBangalore, Karnataka, IN, 5601004h ago
-
Senior-level Full TimeHyderabad R4h ago
-
Automation | Azure | Azure Data | Azure Data Explorer | Azure Log AnalyticsCross-functional collaboration | Professional growth | Remote workMid-level Full TimeIndia R5h ago
-
Senior Data Engineer, BizTech INR 3080K-4400KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch ProcessingSenior-level Full TimeBangalore, India6h ago
-
Staff Engineer (Cloudera CDP & Hadoop Administration) INR 1500K-3300KAnsible | ArgoCD | Automation | CI/CD | Cloudera CDPSenior-level Full TimeBengaluru, India6h ago
-
CI/CD | Claude | Code Analysis | Code modernization | Code remediationBusiness resource groups | Career progression | Disability insurance | Employee stock purchase plan | Family leaveSenior-level Full TimeIndia R6h ago
-
API Development | AWS EMR | Amazon EC2 | Amazon IAM | Amazon S3Flexible paid time off | Professional growth opportunities | Remote work from India | Stock grantsSenior-level Full TimeIndia R6h ago
-
AWS | Agile | Azure | Debugging | Deep learningConference access | Financial and legal consultation support | Internal mobility | Language learning resources | Learning and development initiativesSenior-level Full TimeIndia R9h ago
-
AWS | Agent Serving | Ansible | Argo CD | ArgoCDSenior-level Full TimeBangalore (SDC) - Bagmane Tech Park, …11h ago
-
Technical Lead-Data Engg INR 2000K-4500KAgent Bricks | Agentic AI | Apache Spark | Data Ingestion | Data ModelingSenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN11h ago
-
Senior-level Full TimePune, IN11h ago
-
Sr Technical Lead-App Development INR 2500K-5000KAWS | Amazon Bedrock | Azure | Data Lake | ElasticsearchImmediate joiner onlySenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN11h ago
-
Senior-level Full TimeIndia - Hyderabad11h ago
-
Data Quality Controls Oversight Lead INR 2771K-4000KAWS | Cloud Computing | Controls governance | Data Architecture | Data GovernanceSenior-level Full TimePune, Gera Commerzone SEZ, India11h ago
-
Subcontractor - AI OPS INR 1200K-2500KAWS Glue | AWS Lambda | Amazon Bedrock | Amazon Redshift | GitHub CopilotMid-level ContractINDIA - BENGALURU - HP, IN11h ago
-
Planview Administration 169576 INR 1500K-2700KData Cleansing | Data Modeling | Data Validation | Data pipeline | Data pipeline orchestrationSenior-level Full TimeHyderabad, IND-TG, India17h ago