Data Engineer - Senior
Tasks
- Apply version control best practices with Git
- Build and optimize ETL/ELT pipelines
- Collaborate with business stakeholders and technical teams
- Design data models and architectures
- Design scalable data solutions
- Develop Azure cloud data solutions
- Develop data transformations with Python and SQL
- Integrate data from diverse sources into analytics ready datasets
- Optimize data processing and storage with Azure Databricks and Delta Lake
- Troubleshoot data pipeline issues and improve performance
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure SQL | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage Gen2 | Data Modeling | Data Pipelines | Delta Lake | ELT | ETL | Git | Python | SQL | Synapse Analytics
Education
N/A
Roles
Related jobs
-
Databricks and Splunk Engineer - Senior Associate INR 3264K-4500KAmazon Web Services | Analytics | Azure | Cloud Computing | Cyber ThreatEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India R10h ago
-
Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Automation | Azure | Data ManagementBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R21h ago
-
AWS | Azure | Django | Embeddings | FastAPIContract or consulting engagement | Part-time engagement | Remote work within India | Technical ownership and autonomyMid-level Full TimeIndia R1d ago
-
AI Engineer INR 450K-700KData Preprocessing | Deep learning | Language Processing | MLOps | Machine LearningCareer development | Hybrid work flexibilityExecutive-level Full TimeNoida, India R1d ago
-
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3Autonomy | Collaboration | Continuous improvement | Fully remote | Operational excellenceSenior-level Full TimeIndia R1d ago
-
Staff Software Engineer, Machine Learning INR 3000K-4580KC++ | Classification | Data Pipelines | Deep learning | EmbeddingsHealth and wellness programs | Time away for employeesSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior Software Engineer, Data Platform INR 2000K-4200KApache Pinot | Artifactory | Git | Go | JavaSenior-level Full TimeIndia (Remote) R1d ago
-
AI/ML Engineering Lead/(Gen AI,Python,LLM,ETL)Associate Director INR 2000K-4000KApache Airflow | Apache Beam | Auditability | Automated testing | BigQueryContinuous professional development | Flexible working | Inclusive diverse environment | Opportunities for growthMid-level Full TimePune, Maharashtra, India R1d ago
-
API | AWS SageMaker | Azure Machine Learning | CI/CD | Context engineeringAdvanced AI exposure | Collaborative environment | Continuous learning | Contract engagement | End-to-end ownershipSenior-level Contract Full TimeIndia R1d ago
-
Azure | Azure AD | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Healthcare benefits | Insurance | Paid time off | Professional training and developmentSenior-level Full TimeIndia R1d ago
-
Senior Agentic Engineer, AI Platform INR 3000K-5000KAPI Development | AWS | Agent Orchestration | Authentication | AutoscalingSenior-level Full TimeBengaluru R1d ago
-
SW Engineer (1 - 2 years of exp in .Net / Python, Full-stack development, Angular / React, GenAI) INR 1500K-2500K.NET | API Management | Agile | Angular | Azure DevOpsHybrid work schedule | Limited direction working environmentMid-level Full TimeBengaluru, India R1d ago
-
Senior-level Full TimeHyderabad, India R1d ago
-
Senior-level Full TimeIndia - Remote R1d ago
-
Senior AI Engineer INR 2475K-3465KAirflow | Amazon Web Services | Angular | Apache Beam | BigQueryCareer development | Healthcare benefits | Hybrid work | Learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago
-
Lead AI Engineer INR 2156K-3500KAWS | Agile | Apache Airflow | Apache Beam | Atlassian ConfluenceGuided career tracks | Healthcare benefits | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago
-
Cloud/Big Data Engineer INR 2771K-3900KAgile | Apache Hive | Apache Spark | Automation | BigQueryHybrid work schedule | Work-life flexibilitySenior-level Full TimeChennai, India R1d ago
-
Lead Cloud Data Engineer - Manager INR 2771K-4064KAWS | Airflow | Autosys | CICD | Cloud SecurityEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India R1d ago
-
Architect - Data Engineer INR 2000K-4000KAWS Athena | AWS ECS | AWS EKS | AWS EMR | AWS GlueHybrid work schedule | In person collaboration at assigned office location minimum two days per week | Work-life flexibilitySenior-level Full TimeHyderabad, India R1d ago
-
Principal Engineer - Agentic Engineering INR 2156K-3500KAgile | Airflow | Apache Beam | BigQuery | BigtableCareer growth | Healthcare benefits | Hybrid work environment | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago
-
Senior-level Full TimePune, India R1d ago
-
Ops / SRE Support Engineer – VLabs - Manager INR 2000K-2525KAlerting | Automation | Azure Monitor | Bash | CI/CDMid-level Full TimeBengaluru, India R1d ago
-
Cloud Engineer, Data Platforms INR 3264K-5876KAzure | Azure Databricks | Azure DevOps | Azure Key Vault | Azure VirtualAccidental insurance | Adoption leave | Childcare support | Education assistance program | Emergency leave daysMid-level Full TimeBangalore, India R1d ago
-
Senior Data Engineer INR 3600K-5000KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFinancial wellness support | Flexible remote work on Fridays | Hybrid work schedule | Mental health support | Paid time offSenior-level Full TimeBengaluru, India R1d ago
-
Senior Software Engineer, MLOps/SRE INR 2475K-3500KAerospike | Amazon Web Services | Apache Airflow | Apache Spark | CI/CD401k pension | Disability insurance | Financial wellness support | Healthcare benefits | Life insuranceSenior-level Full TimeBengaluru, India R1d ago