Senior Data Engineer- Remote, India
Tasks
- Build ETL/ELT processes
- Design scalable data pipelines
- Develop data architectures and data models
- Document data processes and architectures
- Ensure data quality, validation, and reconciliation
- Implement CI/CD for data pipelines
- Integrate data from SAP and enterprise sources
- Monitor and troubleshoot pipelines
- Orchestrate Azure Databricks pipelines
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Kafka | Asset bundles | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Unity | Azure Unity Catalog | CI/CD | Data Lake Storage Gen2 | Data Modeling | Data Quality | Data Reconciliation | Data Security | Data Validation | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Docker | ELT | ETL | Event Hubs | Git | Lakehouse | Pipeline observability | Power BI | PySpark | Python | SAP ABAP | SAP CDS | SQL | Snowflake | Snowflake Schema | Spark SQL | Star Schema | Tableau | Terraform | Unity Catalog | YAML
Education
N/A
Roles
Related jobs
-
Staff Data Engineer INR 3242K-4200KCloud Data | Cloud data platform | Continuous integration | Data Engineering | Data QualityFlexible work hours | Mentorship | Remote work optionsSenior-level Full TimeHyderabad, Telangana , India R11h ago
-
Testing Engineering Specialist Advisor INR 2475K-3380K.NET | AI Search | AWS | Application Insights | AzureSenior-level Full TimeNoida, UP, IN R21h ago
-
Systems Integration Specialist Advisor_Storage Cloud INR 800K-1099KAWS | Access Control | Automation | Block Storage | CI/CDMid-level Full TimeBangalore, KA, IN R21h ago
-
AVP - Cloud Database Automation Engineer INR 2337K-3056KAWS RDS | Ansible | Auto Scaling | Cassandra | Cloud ConfigFlexible work hours | Work from homeExecutive-level Full TimeHyderabad IN, India R21h ago
-
AI Engineer INR 1500K-4000KAI Agents | API Design | Amazon Web Services | Async task queues | AzureRemote workMid-level Full TimeRemote - Pune, Maharashtra, India R21h ago
-
Senior ML Research Engineer/Scientist INR 3000K-4580KAgent collaboration | Agentic AI | Benchmark design | Context engineering | Data MixtureSenior-level Full TimeHyderabad, India R23h ago
-
Agile | BigQuery | CI/CD | Cloud Functions | Cloud RunContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Specialist Cloud Database Engineer (SQL, DevOps, AWS) INR 2156K-3000KAWS CloudFormation | AWS RDS | AWS Spacelift | AlwaysOn Availability | AlwaysOn availability groupsFlexible schedule | Hybrid work model | Office collaboration days | Remote work flexibilitySenior-level Full TimeIndia - Pune R1d ago
-
Azure Data Engineer INR 1500K-2500KAzure Cloud | Azure Cloud Platform | Azure Data | Azure Data Factory | Cloud platformSenior-level Full TimeNoida, Uttar Pradesh, India R1d ago
-
Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryAnnual retreat | Conference talk sponsorship | Coworking sprints | Employee leave policies | Home office fundMid-level Full TimeIndia R1d ago
-
Data Engineer INR 100KApache Airflow | BigQuery | Cloud Composer | Cloud Functions | Cloud platformDuvet days | Gym reimbursement | Health coverage | Meal credits | Mental health daysMid-level Full TimeBangalore R1d ago
-
Senior Software Engineer — Infra Agent Systems Remote India INR 2500K-4800KAPI Design | ArgoCD | Cloud Platforms | Data Modeling | Distributed SystemsRemote workSenior-level Full TimeIndia R1d ago
-
AI Assisted Development | Algorithms | Amazon S3 | Apache Iceberg | Cloud ComputingFlexible work schedule | Remote work optionsSenior-level Full TimeHyderabad, India R1d ago
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R1d ago
-
AWS | Agile | Azure | CI/CD | Cloud platformFully remote | Professional growthSenior-level Full TimeIndia R1d ago
-
Oliver Wyman - Data Engineer / Senior Data Engineer - Data and Analytics (DNA) - Gurugram, India USD 95KAWS | Apache Airflow | Azure | CI/CD | CassandraEmployee assistance program | Health and welfare benefits | Hybrid work model | International travel opportunities | Remote work flexibilitySenior-level Full TimeOne Horizon Center, Golf Course Road, … R1d ago
-
Data Engineer INR 1500K-2100KAWS | Agile | Apache Airflow | CI/CD | Data GovernanceHybrid work environment | Work-life flexibilityMid-level Full TimeBengaluru, India R1d ago
-
Software Development Advisor INR 1000K-1700KAPI Gateway | AWS | Agile | Amazon Connect | Amazon EKSMid-level Full TimeBangalore, KA, IN R1d ago
-
Offshore ETL Engineer (DBT SME) INR 1500K-2040KAnalytics modeling | CI | CI/CD | DBT | Data ModelingMid-level Full TimeBangalore, KA, IN R1d ago
-
AI/MLOps SRE Lead Engineer INR 3000K-4680KAKS | AWS CDK | Amazon SageMaker | Anomaly Detection | Automated remediationHybrid work environmentSenior-level Full TimeHyderabad, India R1d ago
-
Senior-level Full TimeBangalore, KA, IN R1d ago
-
Technical & Solution Architect INR 2771K-4300KAWS | Agile | Airflow | Angular | Angular MaterialCareer growth | Healthcare benefits | Hybrid work environment | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago
-
India - Senior Data Engineer ( Contractual Remote Opportunity) INR 3000K-4300KAWS | Azure | Azure Event | Azure Event Hubs | CDCSenior-level ContractRemote , India R1d ago
-
Mid-level Full TimeIND - Telangana - Hyderabad (Hitec … R1d ago
-
AWS | ArgoCD | Auto Scaling | Autogen | AzureHybrid work | In office days per hiring manager confirmation | Mentorship and career growthSenior-level Full TimeBengaluru, India R1d ago