Senior Principal Consultant, Data Engineering (AWS, Databricks, PySpark, Airflow)
Tasks
- Architect and build scalable data pipelines
- Build lakehouse solutions on AWS
- Collaborate with business and technical teams
- Define ETL ELT frameworks and data models
- Design and manage workflows with Apache Airflow
- Ensure data quality, governance, and security
- Lead development with Databricks and PySpark
- Optimize data platform performance reliability and cost
- Provide technical leadership, code reviews, and mentoring
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EMR | Amazon MWAA | Amazon Redshift | Amazon S3 | Apache Airflow | CI/CD | Data Governance | Data Lake | Data Modeling | Data Quality | Data Security | Data Vault | Data Warehousing | Databricks | Delta Lake | ELT | ETL | Git | Lakehouse | PySpark | Python | SQL | Spark SQL
Education
Related jobs
-
BI Developer - Snowflake & Salesforce Data INR 2000K-2500KAlerting | DBT | Data Quality | Data Validation | Data WarehousingChallenging projects | Great work-life balance | Professional developmentMid-level Full TimePune, MH, IN3h ago
-
Senior-level Full TimeMaharashtra, Mumbai, India4h ago
-
AI Solution Consultant INR 2500K-3000KAI strategy | Acceptance Testing | Business Analysis | Business Process | Business Process AnalysisSenior-level Full TimeNew Delhi, India4h ago
-
Manager, Tableau Developer INR 1400K-2000KAWS | Azure | CRM | Data Lakes | Data ModelingAI certifications | Mentorship | World-class trainingMid-level Full TimeIndia-Bangalore5h ago
-
Senior-level Full TimeMaharashtra, Mumbai, India5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
ETL Test Engineer INR 1200K-1500KAgile | Amazon Redshift | Data Integrity | Data Transformation | Data ValidationMid-level Full TimeIN-TN-Chennai5h ago
-
AWS Cloud & DevOps Engineer INR 2156K-2541KAWS | Ansible | Configuration Management | DevOps | Infrastructure as CodeSenior-level Full TimeIN-AP-Hyderabad5h ago
-
Mid-level Full TimeAhmedabad, 380015, India6h ago
-
Lead/Manager Software Engineer INR 2500K-3200KAgent Orchestration | Agentic AI | Amazon ECS | Amazon EMR | Amazon Elastic Kubernetes ServiceSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Sr.Lead Software Engineer INR 2500K-3500KAWS ECS | AWS EKS | AWS EMR | Agent Development | Amazon Web ServicesSenior-level Full TimeHyderabad, Telangana, India6h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2500K-4500KAPI Integration | Agent systems | Cloud platform | Cost Per Request | CrewAISenior-level Full TimeGurgaon, Haryana, India; Bengaluru, Karnataka, India7h ago
-
Mid-level Full TimePune, Maharashtra, India8h ago
-
Gen Ai Lead/Architect INR 2500K-4225KAgent Development | Agent systems | BigQuery | Cloud Functions | Cloud PubSubSenior-level Full TimeIndia8h ago
-
Senior-level Full TimeBangalore, Karnataka, India8h ago
-
Senior-level Full TimeBangalore, Karnataka, India8h ago
-
Data and AI Engineer (Manager) INR 2500K-3380KAWS | AWS Glue | Airflow | Amazon Redshift | Apache KafkaSenior-level Full TimeBengaluru, INDIA, India8h ago
-
Mid-level Full TimeGurugram, Haryana, India9h ago
-
AWS | AWS Lambda | Agile | Apache Spark | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
None Full TimePune, Maharashtra, India10h ago
-
Generative AI Engineer INR 2500K-4500KAgentic Frameworks | Autogen | Embeddings | Fine Tuning | LanggraphSenior-level Full TimePune, Maharashtra, India10h ago
-
Software Engineer (6months to 2 Years of experience - JAVA/Python Backend, CICD, APIs, GEN AI, Microservices, Cloud) INR 2000K-2156KAgile | Algorithms | Apache Kafka | Automated testing | C++Continued learning opportunities | Hybrid work arrangement | MentorshipEntry-level Full TimeBengaluru, INDIA, India10h ago
-
Data Management AI Lead INR 2500K-3380KAWS | Agent Orchestration | Agent systems | Azure | Cloud DataSenior-level Full TimeBangalore, Karnataka, IN10h ago