SDE III - Data Engineering
Tasks
- Build ETL and ELT frameworks
- Build feature generation frameworks for machine learning
- Build user profiling and audience segmentation datasets
- Create catalog quality deduplication and normalization systems
- Create low latency feature pipelines for training and online inference
- Design batch and real-time data pipelines
- Develop data quality validation lineage monitoring and alerting systems
- Develop identity resolution and cross surface signal aggregation
- Ingest and enrich commerce catalog data
- Lead architecture design discussions and engineering best practices
- Own production data services with SLAs and perform incident response
Perks/Benefits
- N/A
Skills/Tech-stack
Agents | Alerting | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Audience Segmentation | Batch Architecture | BigQuery | CI/CD | Cloud platform | Cluster management | Copilots | Cost Optimization | Data Lineage | Data Modeling | Data Processing | Data Validation | Data Warehousing | Databricks | Dimensional Modeling | Distributed Systems | Distributed data | Distributed data processing | ELT | ETL | Feature Store | Google Cloud | Google Cloud Platform | Identity resolution | Infrastructure as Code | Java | LLM | MLOps | Monitoring | Performance optimization | Python | Real Time | Real-time Inference | Reconciliation | Reliability Engineering | SQL | Scala | Schema Design | Streaming Architecture | System design | User Profiling | “as-code”
Education
N/A
Roles
Related jobs
-
Senior Software Test Engineer (python, pyspark, SQL, databricks, playwright/ selenium) INR 2156K-2800KAPI Testing | Airflow | Azure Kubernetes | Azure Kubernetes Service | BitbucketEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India3h ago
-
React.Js Developer-HDFC-Gurugram INR 1500K-3000KAPI Design | AWS | AWS Lambda | Apache Kafka | DockerSenior-level Full TimeIndia - Bengaluru4h ago
-
Senior SDET – Performance Engineering INR 2500K-4000KAKS | APM | Azure | C# | CI/CD401k | Cafe Amenities | Fitness Center | Health insurance | Recreational facilitiesSenior-level Full TimePune, MH, India5h ago
-
AI / ML Engineer II / III INR 1800K-3000KAirflow | Anomaly Detection | Apache Spark | Classification | Data EngineeringMid-level Full TimeBengaluru, India6h ago
-
Senior-level Full TimeBangalore, India7h ago
-
Gen AI Lead INR 2000K-5000KApplication portfolio | Application portfolio management | Artificial Intelligence | Generative AI | LLMSenior-level Full TimeBangalore, IN8h ago
-
AWS Database | AWS Database Migration Service | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeGurugram 8 B, India10h ago
-
AWS | AWS CloudFormation | AWS Lambda | Amazon Bedrock | Amazon EC2Career growth resources | Mentorship | Travel opportunities | Work-life balanceSenior-level Full TimeBengaluru, Karnataka, IND10h ago
-
Senior-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …10h ago
-
Mid-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …10h ago
-
Subcontractor INR 1500K-2500KAWS | Acceptance Testing | Anomaly Detection | Azure | Cloud ComputingStakeholder visibilityMid-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …10h ago
-
ACID | AWS Database | AWS Database Migration Service | AWS Glue | AWS LambdaSenior-level Full TimeGurugram 8 B, India13h ago
-
Principal Software Engineer INR 3242K-4500KAWS | Azure | Azure DevOps | CI/CD | Cloud platformEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India15h ago
-
Mid-level Full TimePune, India17h ago
-
AWS Data Engineer with BI Connector To snowflake migration Exp(6+ Yrs of Exp & Immediate Joiner looking for) INR 1500K-2500KAWS | AWS Glue | AWS IAM | AWS Lambda | Amazon CloudWatchImmediate joiningMid-level Full TimeIndia18h ago
-
AI Governance | AI guardrails | API Integration | Amazon Connect | Amazon LexCollaborative inclusive work environment | Continuous learning opportunities | Remote work flexibilityMid-level Full TimeIndia18h ago
-
Software Engineer Data Analytics INR 1850K-2500KAPI Development | API Integration | Agile | AppSheet | Apps ScriptFlexible work modelMid-level Full TimeHyderabad, India19h ago
-
Data Engineer II INR 2040K-3380KAWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache AirflowComplimentary games | Family leave | Healthcare coverage | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India21h ago
-
Data Engineer II INR 2040K-3380KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamComplimentary games | Family leave | Healthcare coverage | Hybrid work model | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India21h ago
-
Mid-level Full TimeGurugram21h ago
-
Data Engineer II INR 2200K-3465KAmazon Kinesis | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache BeamFree games | Healthcare benefits | Hybrid work schedule | Mental health support | Paid time offMid-level Full Time地点：Hyderabad, Telangana, India21h ago
-
Data Engineer II INR 2200K-3465KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamFamily leave | Free games | Health insurance | Hybrid work | Mental health supportMid-level Full Time地点：Hyderabad, Telangana, India21h ago
-
Senior Data Engineer INR 1500K-2500KAWS Glue | AWS Lambda | Amazon EMR | Amazon S3 | Apache AirflowSenior-level Full TimeSaidapet21h ago
-
Senior-level Full TimeHyderabad, India21h ago
-
Senior-level Full TimeIN-AP-Hyderabad22h ago