Senior Principal Data Engineer
APAC - India - Bengaluru - Sunriver
INR 2520K-3380K (estimate) Senior-level Full Time
Tasks
- Architect model training inference and personalization at scale
- Define and enforce enterprise data modeling standards
- Define data architecture strategy for enterprise distributed platforms
- Design and implement enterprise ETL ELT pipelines using DBT Python and SQL
- Design scalable low latency batch and streaming data pipelines
- Drive data governance lineage and monitoring improvements
- Enable customer data platforms behavioral analytics and segmentation
- Establish DataOps best practices including CI CD observability data quality testing reliability engineering
- Lead architectural decisions across Snowflake Spark Flink Iceberg Kafka AWS
- Mentor senior engineers and technical leads across multiple scrum teams
- Partner with product analytics and business teams to deliver data products
- Provide guidance during production incidents root cause analysis and system recovery
- Support generative AI driven data discovery and self service analytics
- Translate business requirements into scalable technical solutions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Lambda | Amazon ECS | Amazon EKS | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | CI/CD | DBT | Data Architecture | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Warehousing | DataOps | Distributed Systems | ELT | ETL | Event Driven | Event-driven architecture | Generative AI | Machine Learning | Model Inference | Observability | Parquet | Performance Tuning | Personalization | Python | Query Optimization | Reliability Engineering | S3 | SQL | Snowflake | Streaming Pipelines | Testing
Education
Related jobs
-
Senior Data Platform Engineer INR 1500K-2400KAWS Glue | AWS IAM | AWS Lake Formation | AWS Lambda | AWS S3Senior-level Full TimeBangalore, India2h ago
-
Data Platform Engineer INR 1400K-2000KAPI Integration | AWS CloudWatch | AWS CodePipeline | AWS Glue | AWS IAMMid-level Full TimeBangalore, India2h ago
-
AI Search | AKS | API Management | App Service | Azure AISenior-level Full TimeIndia-Noida3h ago
-
Senior-level Full TimeMaharashtra, Pune, India3h ago
-
Senior-level Full TimeIndia, West Bengal, Kolkata3h ago
-
Mid-level Full TimeIndia, West Bengal, Kolkata4h ago
-
Data Engineer INR 1500K-2000KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Azure DataMid-level Full TimeIndia, West Bengal, Kolkata4h ago
-
Senior Software Engineer - Data License Analytics, Pune INR 3000K-4512KAWS | Apache Airflow | Apache Iceberg | Databricks | Distributed SystemsSenior-level Full TimePune4h ago
-
Data Engineer III - PySpark, Databricks, AWS INR 2000K-2400KAmazon Web Services | Apache Spark | Data Modeling | Data Warehousing | DatabricksSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Senior BI Engineer - Power BI with Databricks INR 2400K-3900KDashboard Design | Data Modeling | Data Pipelines | Data Quality | Data VisualizationCareer growth | Certification support | Flexible knowledge transfer | Mentorship | Recognition rewardsSenior-level Full TimeHyderabad, TS, India5h ago
-
Business Data Scientist INR 1400K-2400KAI Agents | Data Pipelines | Data Transformation | Database querying | Hypothesis TestingMid-level Full TimeHyderabad, Telangana, India5h ago
-
Senior Databricks Engineer INR 1500K-2040KCI/CD | Databricks | Databricks API | Databricks SDK | ELTSenior-level Full TimeMaharashtra, Pune, India6h ago
-
Senior - Gen AI INR 2500K-3500KDeep learning | Docker | Generative AI | Language Processing | MLOpsSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Mid-level Full TimeBangalore, Karnataka, India6h ago
-
Assistant Manager - Gen AI INR 1000K-1350KArtificial Intelligence | Generative AI | Machine LearningMid-level Full TimeBangalore, Karnataka, India6h ago
-
Embedded Engineer INR 1060K-2300KAMP | ARMv8 | Buildroot | CI/CD | Cross-compilationIncentives | Mentorship | Team collaboration | Training opportunitiesSenior-level Full TimeHyderabad, TS, IN7h ago
-
Analytics Solution Associate INR 900K-1475KAWS Glue | AWS Lambda | Agile | Data Governance | Data IngestionMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Software Engineer III - Python & Databricks INR 2050K-3500KAWS S3 | Agile | CI/CD | Cloud Computing | DatabricksSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Senior-level Full TimePune, MH, India8h ago
-
Senior-level Full TimeMumbai, Maharashtra, India9h ago
-
Staff Software Engineer (Python) INR 2500K-3800KAPIs | AWS | Authentication | Batch Processing | Data PipelinesCollaborative team environment | Leadership development | Training programsSenior-level Full TimeMumbai, MH, India9h ago
-
Azure Data & Fabric Developer ( 5 + yrs Assistant Manager - RNA INR 1400K-1700KApache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimeMumbai, MH, India9h ago
-
Mid-level Full TimeNoida, UP, IN9h ago
-
Data Engineer INR 2400K-3356KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeHyderabad, TG, IN9h ago
-
Staff Engineer (Python/AWS) INR 2500K-4000KAWS | Aurora MySQL | CI/CD | Code review | DebuggingDevelopment opportunities | Reward and recognition | Volunteering opportunities | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India9h ago