Senior Data Engineering Consultant
Primary location: Gurgaon, India
INR 2000K-4000K (estimate) Senior-level Full Time
Tasks
- Collaborate with cross-functional teams to deliver solutions
- Design ETL pipelines
- Develop and operate cloud native data pipelines
- Document data engineering processes
- Implement data transformations
- Implement data validation and monitoring
- Migrate ETL workloads to Databricks
- Modernize on prem ETL workloads
- Optimize Spark based ETL frameworks
- Perform performance tuning
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | Azure | Cloud Architecture | Data Quality | Data Reconciliation | Data Warehousing | Databricks | Dimensional Modeling | ETL | Performance Tuning | PySpark | Python | SQL | Snowflake | Spark SQL | Workflow Orchestration
Education
Related jobs
-
Associate Consultant - Data Engineer(Python/Pyspark) INR 1500K-2200KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India17h ago
-
Engineering Lead - Data & Analytics INR 1600K-3000KAWS | Agentic Analytics | Agile | Artificial Intelligence | Automated DeploymentSenior-level Full TimePune, MAHĀRĀSHTRA, India18h ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R1d ago
-
Senior Data Engineer, Director INR 1500K-3000KAWS EMR | Amazon Athena | Amazon DynamoDB | Amazon Kinesis | Amazon QuickSightSenior-level Full TimeGurugram, India1d ago
-
AWS S3 | Amazon EMR | Amazon Redshift | Amazon Web Services | Apache SparkFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India1d ago
-
Analytics | Artificial Intelligence | Contract analytics | Cost analysis | Data GovernanceMid-level Full TimeHyderabad - Kondapur, India1d ago
-
Audit compliance | Balance sheet | Balance sheet substantiation | Data Analysis | Data GovernanceMid-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Senior Analytics Consultant INR 2771K-4064KBI Dashboard | Business Analysis | Cloud platform | Data Architecture | Data DictionarySenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
Consultant/Sr. Consultant, Consumer Analytics Data Engineering INR 2520K-4720KAWS | AWS Glue | CI/CD | DBT | Data GovernanceSenior-level Full TimeIN: Lilly Bengaluru, India1d ago
-
Risk Analytics Consultant INR 650K-1100KAgile | Alteryx | Data Reconciliation | Data Transformation | Data analyticsEntry-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Data Analyst – Consultant/Senior Consultant INR 2771K-4000KAI Agents | Data Governance | Data Quality | Data Visualization | DatabricksSenior-level Full TimeIN: Lilly Bengaluru, India1d ago
-
Director, Enterprise Data Engineering and Analytics INR 4000K-5199KAnalytics | Cloud Data | Cloud Data Platforms | Data Engineering | Data ModelingExecutive-level Full TimeBengaluru, Karnataka1d ago
-
AWS S3 | Amazon Web Services | Azure Data | Azure Data Engineering | BigQuerySenior-level Full TimeBengaluru Millenia, India1d ago
-
Software Engineering Manager - HIH - Evernorth INR 1500K-2600KAWS | AWS Lambda | Amazon EC2 | Amazon SNS | Amazon SQSMid-level Full TimeHIH - Hyderabad, India1d ago
-
Consumer Health Data & Analytics Consultant INR 1500K-2500KData Analysis | Data Modeling | Data Visualization | Excel | Market ResearchMid-level Full TimeBangalore, India1d ago
-
General Analytics Senior Consultant INR 2500K-4064KCommercial due diligence | Competitive Intelligence | Consulting methodology | Data analytics | Due DiligenceSenior-level Full TimeBangalore, India1d ago
-
Engineering Manager, Data Engineering INR 1300K-2200KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeIND-KA-Bengaluru, India2d ago
-
Data Architect & Delivery Lead INR 3600K-5400KAgile | Airflow | Batch Architecture | BigQuery | Canonical ModelingHybrid workSenior-level Full TimeHyderabad, India R2d ago
-
Manager - Data Governance/Data Platform INR 1000K-2000KCI/CD | DBT | Data Governance | Data Modeling | Data SecurityMid-level Full TimeGurugram, HR, India3d ago
-
Senior Technical Consultant - Storage INR 2400K-3500KAWS | Active Directory | Ansible | As built documentation | AutomationCompany holidays | Employee Wellness Initiatives | Flexible work arrangements | Health insurance | Learning and development opportunitiesSenior-level Full TimeIndia R3d ago
-
Senior Software Engineer, Data Engineering INR 2000K-3000K.Net Core | ASP.NET MVC | ASP.Net Core | Agile | Automated testingSenior-level Full TimePune, Maharashtra, India3d ago
-
Mid-level Full TimeGurgaon, Haryana, India3d ago
-
Associate Manager - Analytics INR 1500K-2000KAnalytics | Dashboarding | Data Governance | Data Quality | Data SecurityMid-level Full TimeAgra (AS02AM01), IN4d ago
-
AWS | Data Lake | Data Modeling | Data Visualization | Data WarehouseFlexible work arrangements | Hybrid work arrangement | Visa sponsorshipMid-level Full TimeIND - Telangana - Hyderabad (Hitec … R4d ago
-
Data Engineer Senior Consultant INR 2800K-4000KData Warehousing | Data pipeline | ETL | Python | SQLFlexible work arrangements | Remote workSenior-level Full TimeRemote or PAN India NTT Office, … R4d ago