Principal Data Engineer
Tasks
- Architect data pipelines
- Build metadata driven data engineering frameworks
- Collaborate with governance and analytics teams
- Define monitoring standards and data quality KPIs
- Develop data integration frameworks
- Implement data ingestion transformations and lineage tracking
- Mentor data engineers
- Optimize spark performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Agile Framework SAFe | Apache Spark | CI/CD | Data Governance | Data Modeling | Data fabric | Data mesh | Databricks | Delta Lake | DevOps | Git | Jenkins | Lineage Tracking | Metadata Driven | Metadata-driven architecture | Performance Tuning | Platform Observability | PySpark | Python | SQL | Scaled Agile | Scaled Agile Framework | Scaled Agile Framework (SAFe) | SparkSQL | Unit Testing | Workflow Orchestration
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Assistant Manager- AI Engineer with Claude INR 1200K-2500KAWS | Autogen | Azure | Containerization | CrewAIMid-level Full TimeBangalore, Karnataka, India6h ago
-
Senior-level Full TimeBengaluru, KA, India8h ago
-
API Integration | AWS | Azure | Claude | Cloud platformFounding Team Access | Mentorship opportunities | Technical leadership growthSenior-level ContractHyderabad, India9h ago
-
CDP Specialist (Treasure Data) INR 1500K-2000KAI machine learning | API Integration | Amazon Web Services | Big Data | CassandraMid-level Full TimeIN-KA-Bangalore11h ago
-
Data Engineer - AIML Data modeling INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | ElasticsearchMid-level Full TimeIN-AP-Hyderabad11h ago
-
Data Engineering - AIML Data Modeling - SSE INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | Dependency InjectionMid-level Full TimeIN-AP-Hyderabad11h ago
-
AI Engineer - MDM INR 3000K-4720KAPI Integration | Access Control | Automation | Cybersecurity | Data AnalysisSenior-level Full TimePune, Maharashtra, IND, 41101311h ago
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India12h ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India12h ago
-
AI Software Engineer INR 1500K-2500KAPI Development | AWS | Access Control | Agentic patterns | AuditabilityCompany bonus/profit share | Flexible work arrangements | Long service awards | Medical benefits | Mobile Phone ReimbursementMid-level Full TimeChennai, India12h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1500K-2800KAI Model Deployment | AI model | APIs | Agent Frameworks | AzureMid-level Full TimeBangalore, Karnataka, India13h ago
-
Accelerator hardware | C++ | Compiler Internals | Compiler optimization | Custom KernelsSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Data Engineer - Delivery INR 3000K-3900KAnalytics services | App Service | Azure Analytics | Azure Analytics Services | Azure AppSenior-level Full TimePune, MH, India13h ago
-
Team Member - IP, CE Data & Conv Core INR 2000K-2500KGenerative AI | HTML | Jira | Power BI | PythonSenior-level Full TimeNavi Mumbai, Maharashtra, India13h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India13h ago
-
Software Engineer II INR 2500K-3500KAWS | Alerting | Asynchronous processing | Azure | Backend DevelopmentHybrid work up to 50 percent work from homeMid-level Full TimeIndia, Karnataka, Bangalore13h ago
-
AVP - QA Automation Engineer - IB Tech & CRM/ Analytics INR 3000K-4000KAWS | AWS Lambda | AWS RDS | Amazon Redshift | Amazon S3Executive-level Full TimePune, India14h ago
-
Product Engineering Specialist INR 2500K-5000KAI Foundry | AI Governance | AI Solution | AI Solution Architecture | AI platformsSenior-level Full TimePune, Maharashtra, India14h ago
-
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720KAWS | Agile | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Senior-level Full TimeMumbai, India15h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R16h ago
-
Applied AI ML Associate Senior INR 1200K-2500KAI Agents | AWS Lambda | AWS Step Functions | Agentic AI | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India16h ago
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN17h ago
-
DE&A - Core - Cloud Data Engineering - AWS Data Engineering INR 3000K-4000KAWS | AWS Data | AWS Data Governance | AWS EC2 | Data GovernanceSenior-level Full TimePune, Maharashtra, India17h ago
-
Senior-level Full TimeBengaluru, Karnataka, India17h ago