Data Engineer
Tasks
- Analyze datasets to identify trends
- Build and optimize SQL queries
- Collaborate with product, engineering, and data science teams
- Define data contracts and schemas
- Design and build data enrichment pipelines
- Execute data governance with cataloging lineage tracking and schema design
- Implement observability and debugging
- Improve pipeline performance scalability and cost efficiency
- Maintain AWS data architectures
- Orchestrate data workflows with Airflow
- Run data quality validation and monitoring
- Troubleshoot data delivery issues
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Amazon Athena | Amazon S3 | Apache Airflow | Apache Spark | Data Governance | Data Modeling | Data Quality | ELT | ETL | GRPC | Java | Kafka | Monitoring | Observability | PySpark | Python | Query Optimization | REST API | SQL | Schema Design
Education
Roles
Related jobs
-
Mid-level Full TimeBangalore, KA, IN R11h ago
-
Engineers (Agentic / Automation) INR 2475K-4680K.Net Core | API Security | AWS Lambda | Agile | Amazon RDSSenior-level Full TimeGurgaon, HR, IN R11h ago
-
Data Engineer INR 1000K-1800KAWS | Apache Spark | Data Modeling | Data Pipelines | DatabricksHealth insurance | Hybrid work | Paid time off | Transport allowance | Wellness programsMid-level Full TimeBangalore (Hybrid) R1d ago
-
Manager - Senior AI/ML Engineer INR 3000K-5000KAPI Design | AWS | Agent Orchestration | Agent systems | Asynchronous Workflows401k match | Dental insurance | Health insurance | Paid time off | Vision insuranceSenior-level Full TimePune, IN R2d ago
-
Senior Associate – AI ML Engineer INR 1860K-4000KAWS | Agentic Workflows | Azure | CI/CD | Data Pipelines401k match | Dental insurance | Medical insurance | Paid time off | Vision insuranceMid-level Full TimePune, IN R2d ago
-
Senior Software Engineer - Data Platform INR 2500K-3584KAWS | Agentic AI | Apache Airflow | Apache Druid | Apache FlinkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India R2d ago
-
Senior BI & AI Engineer INR 3000K-4000KDAX | LLM | Langchain | Llamaindex | PandasAccess to Headspace app | Flexible vacation | Hybrid work model | Mental health days | Paid volunteer days offSenior-level Full TimeIndia, Hyderabad, Telangana R2d ago
-
AI / Generative AI Sr. Associate INR 2000K-4500KAI Governance | AI guardrails | AWS Bedrock | Agentic AI | Azure OpenAIFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - GTP, India R2d ago
-
Anthropic Claude | Application Insights | Asynchronous programming | Automated testing | Azure Application InsightsFlexible working environment | Long-term engagement | Mentorship opportunities | Remote workSenior-level Contract Full TimeIndia R2d ago
-
Software Engineer, Data Science INR 1000K-2000KD3 | Data Governance | Data Modeling | Data Pipelines | ETLHealth and wellness programs | Time awayMid-level Full TimeBengaluru, KA, India R3d ago
-
Senior Staff Engineer, Supply chain optimization INR 3000K-4500KAMPL | AWS | Agent-Based Simulation | Agent-based | AnyLogicSenior-level Full TimeRemote, India R3d ago
-
Senior Database Engineer / Senior Consultant Specialist INR 2000K-3200KAccess Control | Backup and Recovery | BigQuery | CI/CD | CassandraSenior-level Full TimePune, Maharashtra, India R3d ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 1860K-3900KAWS | Agent systems | Apache Spark | Apache Spark SQL | AzureSenior-level Full TimeRemote - India R3d ago
-
Senior Staff Engineer, Supply chain optimization INR 3000K-4500KAMPL | AWS | Agent-Based Simulation | Agent-based | AnyLogicSenior-level Full TimeRemote, India R3d ago
-
Senior-level Full TimeHyderabad R3d ago
-
Senior AI/ML Engineer II INR 2475K-4500KContainerization | Data Engineering | DeepSpeed | Distributed Systems | DockerCar lease | Career advancement programs | Certification programs | Continuous learning opportunities | Corporate NPSSenior-level Full TimeBangalore, Karnataka, India R3d ago
-
Automation | Azure | Azure Data | Azure Data Explorer | Azure Log AnalyticsCross-functional collaboration | Professional growth | Remote workMid-level Full TimeIndia R3d ago
-
API Development | AWS EMR | Amazon EC2 | Amazon IAM | Amazon S3Flexible paid time off | Professional growth opportunities | Remote work from India | Stock grantsSenior-level Full TimeIndia R3d ago
-
AWS | Agile | Azure | Debugging | Deep learningConference access | Financial and legal consultation support | Internal mobility | Language learning resources | Learning and development initiativesSenior-level Full TimeIndia R3d ago
-
Lead Platform Engineer (DevOps) INR 3000K-5000KAWS | Ansible | Azure | Bash | CI/CDCareer growth | Healthcare packages | Hybrid work setting | Mentorship | Online learning platformSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R3d ago
-
Engr III Spec-AI Science INR 2500K-4800KAlgorithm performance | Algorithm performance tuning | Amazon SageMaker | Azure Machine Learning | BentoMLSenior-level Full TimeVDSI, 201 TITUS,. BLDG#10, Hyderabad, IND … R3d ago
-
Dist Engr-AI Science INR 2000K-5000KAgentic AI | CNN | CPU architecture | Data Preprocessing | Deep learningHybrid work | Mentorship | Work from homeSenior-level Full TimeVDSI, 201 TITUS,. BLDG#10, Hyderabad, IND … R3d ago
-
Princ Engr-AI Science INR 2500K-5000KAgentic AI | Data Preprocessing | Deep learning | Distributed Computing | Entity ExtractionHybrid work schedule | Work from homeSenior-level Full TimeVDSI-5th floor Wing B, Etamin Block, … R3d ago
-
Mid-level Full TimeRemote, India R3d ago
-
AVP Senior Data Engineer L11 INR 2771K-4064KAb Initio | Agile | Amazon Redshift | Big Data | Cloud ComputingFlexible working hours | Occasional travel for meetings | Regional engagement hubs | Work from homeSenior-level Full TimeHyderabad IN, India R3d ago