Senior Data Engineering Consultant
Primary location: Hyderabad, India
INR 2000K-4000K (estimate) Senior-level Full Time
Tasks
- Apply data governance and security standards
- Architect scalable data solutions
- Build data pipelines (ETL/ELT)
- Define data models and standards
- Design Snowflake data warehousing architecture
- Develop reusable Python frameworks
- Enable streaming and batch data integration
- Implement CI/CD pipelines
- Integrate data using Azure Data Factory Databricks Airflow
- Optimize SQL queries and database performance
- Support AI and ML data pipelines
- Tune clusters and workload distribution
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure HDInsight | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Composer | Cloud platform | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Security | Data Warehousing | Databricks | ELT | ETL | Google Cloud | Google Cloud Platform | Hadoop | Hive | Infrastructure as Code | Lakehouse | Pandas | Performance Tuning | Pig | Power BI | PySpark | Python | Query Tuning | SQL | Snowflake | Streaming Data | Synapse Analytics | Workload management | “as-code”
Education
N/A
Related jobs
-
Senior-level Full TimeBengaluru, Karnataka, India R6h ago
-
Senior ML Operations Engineer INR 2500K-5000KAI Governance | AWS | Automated retraining | Azure | Azure MLSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Software Development Specialist INR 940K-940KAmazon CloudWatch | Amazon DynamoDB | Amazon S3 | Amazon Web Services | Azure DevOpsMid-level Full TimeBangalore, KA, IN R9h ago
-
Senior Manager INR 1500K-2800KAWS Glue | AWS Secrets | AWS Secrets Manager | Adaptive Query | Adaptive query executionHybrid work modeSenior-level Full TimePune, Maharashtra, India R10h ago
-
Senior Consultant - Data Engineering- INR 2000K-3500KApache Kafka | Apache Spark | Cloud Computing | Data Modeling | Data PipelinesSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Mid-level Full TimeBengaluru, Pune11h ago
-
Mid-level Full TimeIndia, Telangana, Hyderabad11h ago
-
Senior Data Engineer INR 3000K-4200KAPI Management | AWS | Application Architecture | Azure API | Azure API ManagementSenior-level Full TimeIndia11h ago
-
Data Science Chief Expert - Finance INR 3000K-4000KAWS | Azure | Cloud platform | Cypher | Data PreprocessingExecutive-level Full TimeBangalore, IN, 56006617h ago
-
Data Science Leader - Finance INR 2876K-5000KAgent Orchestration | Agent systems | Data Engineering | Data Modeling | Deep learningConstant learning | Flexible working models | Great benefits | Health and well-being programs | Skill growthSenior-level Full TimeBangalore, IN, 56006617h ago
-
IN_Manager_Agentic + Gen AI__ AI 50_ Advisory_Hyderabad INR 1000K-2500KAgentic AI | C plus plus | C# | CI/CD | DspyFlexibility programmes | MentorshipMid-level Full TimeHyderabad - Salarpuria, India17h ago
-
Sr Technical Lead-BI INR 1500K-3000KAgile | BI Data modeling | DAX | Data Modeling | Data WarehousingSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
Technical Lead-BI INR 1500K-2700KDAX | Data Modeling | Data Warehousing | Dimensional Modeling | ETLSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
IN_Sr Associate_Java Full Stack Engineer_D&A_Advisory_Bangalore INR 1200K-2500KAngular | Apache Kafka | App Service | Azure | Azure AppFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India17h ago
-
IN_Senior Associate_ Data Scientist_D&A_Advisory_Bangalore INR 3000K-4000KBig Data | Causal Inference | Data Manipulation | Data Modeling | Data VisualizationSenior-level Full TimeBengaluru Millenia, India17h ago
-
EY - GDS Consulting - AIA - AI Engineer- Senior INR 2500K-5000KAI Foundry | AI Observability | AWS Bedrock | Access Controls | Asynchronous programmingCoaching and confidence | Continuous learning | Diverse and inclusive culture | Flexible tools and supportSenior-level Full TimeChennai, TN, IN, 60003217h ago
-
API Integration | Access Control | Agent Orchestration | CI/CD | Change ManagementContinuous professional development | Flexible working | Inclusive workplaceMid-level Full TimeHyderabad, TG, IN, 50003217h ago
-
ESP Security Data Engineer INR 2000K-2700KAccess Controls | Automation | Cloud Platforms | Continuous Improvement | Data ArchitectureMid-level Full TimeBengaluru, KA, IN, 56004817h ago
-
APM | AWS | Ansible | Asynchronous programming | AzureSenior-level Full TimeIND - Chennai, Neville Towers, India17h ago
-
Java API & Microservices Engineer / Architect INR 2500K-3500KAPI Testing | Azure | CI/CD | Cassandra | DatadogSenior-level Full TimeBangalore, KA, IN R17h ago
-
EY - GDS Consulting - AIA - AI Platform Engineer- Senior INR 3000K-5449KAI Search | AI Services | Agent SDK | Autogen | Azure AISenior-level Full TimeBengaluru, KA, IN, 56004817h ago
-
Senior-level Full TimeBangalore, KA, IN R17h ago
-
Cloud AI / Agentic AI Developer - Manager INR 1860K-2500KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon BedrockEmployee networks | Flexible work/life support | Paid volunteer daysMid-level Full TimeHyderabad, India17h ago