Principal Data Engineer
Tasks
- Architect data pipelines
- Build metadata driven data engineering frameworks
- Collaborate with governance and analytics teams
- Define monitoring standards and data quality KPIs
- Develop data integration frameworks
- Implement data ingestion transformations and lineage tracking
- Mentor data engineers
- Optimize spark performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Agile Framework SAFe | Apache Spark | CI/CD | Data Governance | Data Modeling | Data fabric | Data mesh | Databricks | Delta Lake | DevOps | Git | Jenkins | Lineage Tracking | Metadata Driven | Metadata-driven architecture | Performance Tuning | Platform Observability | PySpark | Python | SQL | Scaled Agile | Scaled Agile Framework | Scaled Agile Framework (SAFe) | SparkSQL | Unit Testing | Workflow Orchestration
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Specialist - Gen AI Development INR 3000K-4800KAPI Development | AWS | AWS Lambda | Amazon Bedrock | Amazon SageMakerMid-level Full TimeSun Life Global Solutions Private Limited, …5h ago
-
Entry-level Full TimeBengaluru, Karnataka, India6h ago
-
Technical Lead - AI Specialist / Automation Engineer INR 2000K-4800KAdobe | Anthropic | Figma | Fine Tuning | GitHubFull time employment authorized to work without visa sponsorship | Global career opportunities | Robust benefits packageSenior-level Full TimeNoida Office, India6h ago
-
Assistant Manager- AI Engineer with Claude INR 1200K-2500KAWS | Autogen | Azure | Containerization | CrewAIMid-level Full TimeBangalore, Karnataka, India8h ago
-
Senior-level Full TimeBengaluru, KA, India10h ago
-
API Integration | AWS | Azure | Claude | Cloud platformFounding Team Access | Mentorship opportunities | Technical leadership growthSenior-level ContractHyderabad, India11h ago
-
CDP Specialist (Treasure Data) INR 1500K-2000KAI machine learning | API Integration | Amazon Web Services | Big Data | CassandraMid-level Full TimeIN-KA-Bangalore13h ago
-
Data Engineer - AIML Data modeling INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | ElasticsearchMid-level Full TimeIN-AP-Hyderabad13h ago
-
Data Engineering - AIML Data Modeling - SSE INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | Dependency InjectionMid-level Full TimeIN-AP-Hyderabad13h ago
-
AI Engineer - MDM INR 3000K-4720KAPI Integration | Access Control | Automation | Cybersecurity | Data AnalysisSenior-level Full TimePune, Maharashtra, IND, 41101313h ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1400K-2000KApache Airflow | Apache Beam | Auditability | Batch Processing | CI/CDMid-level Full TimeHyderabad, Telangana, India R13h ago
-
Ansible, Jira, Confluence, Hadoop / Consultant Specialist INR 800K-1700KAmazon S3 | Ansible | CI/CD | Confluence | DevSecOpsContinuous professional development | Flexible working | Inclusive work environment | Opportunities to growMid-level Full TimeHyderabad, Telangana, India R13h ago
-
Senior-level Full TimeKolkata,West Bengal,India13h ago
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India13h ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India14h ago
-
AI Software Engineer INR 1500K-2500KAPI Development | AWS | Access Control | Agentic patterns | AuditabilityCompany bonus/profit share | Flexible work arrangements | Long service awards | Medical benefits | Mobile Phone ReimbursementMid-level Full TimeChennai, India14h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1500K-2800KAI Model Deployment | AI model | APIs | Agent Frameworks | AzureMid-level Full TimeBangalore, Karnataka, India14h ago
-
Accelerator hardware | C++ | Compiler Internals | Compiler optimization | Custom KernelsSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior Data Engineer - Delivery INR 3000K-3900KAnalytics services | App Service | Azure Analytics | Azure Analytics Services | Azure AppSenior-level Full TimePune, MH, India14h ago
-
Senior-level Full TimePune, Maharashtra, India14h ago
-
Airflow | Apache Beam | Apache Flink | Asynchronous Messaging | BigQueryMid-level Full TimePune, Maharashtra, India14h ago
-
Team Member - IP, CE Data & Conv Core INR 2000K-2500KGenerative AI | HTML | Jira | Power BI | PythonSenior-level Full TimeNavi Mumbai, Maharashtra, India14h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India14h ago
-
API Design | Airflow | Alerting | Apache Beam | Apache FlinkMid-level Full TimePune, Maharashtra, India14h ago
-
Airflow | Apache Beam | Apache Flink | BigQuery | CI/CDMid-level Full TimePune, Maharashtra, India14h ago