Principal Data Engineer
Tasks
- Architect batch and real time distributed data processing
- Conduct architecture and design reviews
- Define data engineering standards and best practices
- Define data security governance and access controls
- Design ETL/ELT pipelines
- Drive performance scalability reliability and operational excellence
- Enable data integration across systems and services
- Establish data quality lineage monitoring and validation
- Implement workflow orchestration and workflow management
- Lead data platform architecture modernization
- Mentor engineers and develop reusable engineering frameworks
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Kafka | Apache Spark | Azure | CI/CD | Cloud Data | Cloud Data Platforms | Data Governance | Data Lake | Data Lakehouse | Data Modeling | Data Security | Data integration | Data platforms | Databricks | ELT | ETL | GCP | Hadoop | Kafka | Kubernetes | NoSQL | Observability | OpenShift | Relational databases | Workflow Management | Workflow Orchestration
Education
N/A
Roles
Architect | Data Architect | Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Advanced Engineer - Data Engineer INR 2475K-3465KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AzureAccess to cutting-edge technologies | Collaborative work environment | Professional growth and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …3h ago
-
Data Engineer INR 302K-480KAgile | Apache Airflow | Cloud Composer | Cloud Storage | Cloud platformEntry-level Full TimeIN-MH-Pune3h ago
-
Senior-level Full TimeIN-TN-Chennai3h ago
-
AI & ML Development Lead INR 2500K-5000KAPI Development | AWS | Agent systems | Azure | Cloud PlatformsSenior-level Full TimeGurugram, Haryana, India4h ago
-
Senior Data Management Professional – Process Automation & Data Operations, Company Financials Data , Pune INR 2800K-4000KCI/CD | Cause analysis | Data Governance | Data Monitoring | Data ObservabilityPlatinum customer supportSenior-level Full TimePune4h ago
-
CDP,Snowflake,SQL,Java, API, AWS - (6-9 Yrs) - CHN INR 2000K-3000KAPI Integration | AWS | Audience Management | Customer Data | Customer Data PlatformSenior-level Full TimeIndia4h ago
-
Data Engineer ((SSIS, SQL and Azure Data Factory) INR 1000K-1700KAzure Data | Azure Data Factory | Data Factory | Databricks | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India5h ago
-
API Integration | AWS | Anomaly Detection | Azure | Data LineageSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Data Governance | Data Modeling | Data Quality | Data ResiliencyDiversity inclusion and respectMid-level Full TimeHyderabad, Telangana, India6h ago
-
Lead - Agentic AI Engineer INR 2500K-5000KAgent Development Kit | Anomaly Detection | CI/CD | Cloud Computing | Data PreprocessingSenior-level Full TimeChennai, Tamil Nadu, India6h ago
-
Mid-level Full TimePune, Maharashtra, India R6h ago
-
Senior Software Engineer, Data Engineering INR 2000K-3000K.Net Core | ASP.NET MVC | ASP.Net Core | Agile | Automated testingSenior-level Full TimePune, Maharashtra, India6h ago
-
Data Engineer (.NET Specialist) INR 2400K-3465K.Net Core | ASP.NET | Angular | App Service | Azure AppSenior-level Full TimePune, MH, India7h ago
-
Lead Software Engineer - AI-Augmented Full Stack Development INR 3000K-5000KAI Assisted Development | API Design | AWS | Agile methodologies | AngularSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Data Engineer - Databricks & Microsoft FabricData Engineer - Databricks & Microsoft Fabric INR 1500K-2800KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeChennai, IN, 60003211h ago
-
Mid-level Full TimeBengaluru, Karnataka, India11h ago
-
Lead Data Engineer INR 1500K-2700KApache Kafka | Apache Spark | Automated testing | CI/CD | Data ModelingSenior-level Full TimeBengaluru, KA, India12h ago
-
ASR | AWS | Audio Processing | Cloud platform | ContainerizationFlexible working hours | Fully remote | Mentorship | Professional growthSenior-level Full TimeIndia R12h ago
-
GenAI LLM Python/Senior Associate Director, Software Engineering INR 2000K-4000KAWS | Agent systems | Azure | Docker | Function CallingFlexible working | Professional developmentMid-level Full TimePune, MH, IN, 41100614h ago
-
Software Engineer - Data Engineering INR 1500K-2541KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite 5 days per week | Relocation assistance | Visa sponsorshipMid-level Full TimeChennai, Tamil Nadu, India16h ago
-
Software Engineer - Data Engineering INR 1500K-2500KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite work | Relocation assistanceMid-level Full TimeChennai, Tamil Nadu, India16h ago
-
Lead Software Engineer- Data Engineer INR 2000K-3000KAWS | AWS CloudFormation | Agile | Azure DevOps | CI/CDOnsite work five days per week | Relocation availableSenior-level Full TimeChennai, Tamil Nadu, India16h ago
-
Senior-level Full TimeBangalore, KA, IN16h ago
-
Lead Software Engineer (AWS, Snowflake & ML Backend) INR 3000K-4500KAWS | AWS Lambda | AWS Step Functions | Access Control | Amazon ECSOnsite work 5 days per week | Relocation supportSenior-level Full TimeChennai, Tamil Nadu, India16h ago
-
Principal Digital Architect INR 2500K-5000KAgentic architecture | Artificial Intelligence | CI/CD | Cloud Computing | Data ArchitectureOnsite work 5 days a week | Relocation availableSenior-level Full TimeChennai, Tamil Nadu, India16h ago