Senior Principal Data Engineer
Bengaluru, Karnātaka, India
INR 2400K-3500K (estimate) Senior-level Full Time
Tasks
- Build ingestion for APIs event streams files and third party sources
- Communicate architectural decisions and trade-offs
- Define data engineering standards and best practices
- Design, build, and manage data pipelines
- Develop data models and schemas
- Implement data quality lineage observability and automated testing
- Lead architecture reviews and design discussions
- Mentor and guide data engineering team
- Optimize compute storage and transformation performance and cost
- Own data platform architecture
Perks/Benefits
- Career Development Programs
- Health and wellbeing programs
- Hybrid work 2 days per week
- Inclusion and diversity culture
- Work-life flexibility
Skills/Tech-stack
API ingestion | AWS | Amazon Kinesis | Apache Airflow | Apache Spark | Automated testing | CI/CD | Cloud infrastructure | Cloud platform | CloudFormation | DBT | Dagster | Data Architecture | Data Engineering | Data Governance | Data Lineage | Data Modeling | Data Pipelines | Data Quality | DataOps | Distributed Processing | ELT | ETL | Event Driven | Event-driven architecture | Feature Store | Google Cloud | Google Cloud Platform | Google Pubsub | Infrastructure as Code | Kafka | MLOps | Machine Learning | Metadata Management | Microsoft Azure | Observability | Prefect | Python | SQL | Security | Snowflake | Terraform | Version control | “as-code”
Education
N/A
Related jobs
-
Engineer - Digital & AI Solutions INR 302K-346KAWS | Agile | Azure | Big Data | Cloud platformCharity Programmes | Discounted gym memberships | Environmental initiatives | Flexible working | Hybrid workingEntry-level Full TimeHyderabad, Telangana, India9h ago
-
Data Analyst Technical Lead (Alteryx) INR 3000K-4000KAPI Integration | Alteryx Designer | Alteryx Server | Data Cleansing | Data ReconciliationUK shiftSenior-level Full TimeNoida, UP, India11h ago
-
GCP Data Engineer INR 1500K-2000KAgile | Apache Airflow | Ascend.io | CI/CD | Cloud ComposerFlexible work model | Wellbeing cultureMid-level Full TimeHyderabad, India11h ago
-
Senior AI & Automation Engineer (6+ years Generative AI, Agentic AI, LLMs, Python, APIs, MCP) INR 3700K-5500KAgent systems | Agentic AI | Agile | CI/CD | DockerSenior-level Full TimeBengaluru, KA, India12h ago
-
AWS | Adversarial Machine Learning | Amazon SageMaker | Anonymization | AzureCutting-edge AI security work | Flexible working hours | Fully remote | Global cross-functional collaboration | Opportunity to shape AI security best practicesSenior-level Full TimeIndia R12h ago
-
A/B | A/B Testing | AWS | Azure | B testingFlexible working hours | Flextime policy | Hybrid work model | International collaboration | Technical growth opportunitiesSenior-level Full TimeIndia12h ago
-
Senior Software Engineer, Machine Learning INR 2500K-3500KA/B | A/B Testing | Amazon S3 | Apache Airflow | Apache SparkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India12h ago
-
Manager Software Engineer- ML + NLP+ ppl management INR 3200K-4800KAPIs | BERT | Data Mining | Data Science | Deep learningFlexible work arrangements | Hybrid work environmentSenior-level Full TimeGurgaon - Cyber Park, India16h ago
-
Principal Engineer, Storage Data Science and Analytics INR 3200K-4590KAIOps | Anomaly Detection | Apache Spark | C# | C++Career Development Programs | Flexible work arrangements | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India16h ago
-
Principal Engineer, Storage Data Science and Analytics INR 3000K-3900KAIOps | Agentic Workflows | Anomaly Detection | C# | C++Senior-level Full TimeBengaluru, Karnātaka, India16h ago
-
Senior-level Full TimeBengaluru Office, India16h ago
-
Senior-level Full TimeBangalore, India R16h ago
-
Databricks -Project Lead-Data Engg INR 1500K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data FactoryClient communication support | Flexible to work US shiftsSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …16h ago
-
Technical Specialist-App Development INR 2000K-5000KAWS | Azure | Experiment tracking | Financial Reporting | Fraud DetectionSenior-level Full TimeINDIA - HYDERABAD - BIRLASOFT OFFICE, …16h ago
-
AI / ML Engineer INR 1200K-2700KChatbots | Cloud Computing | Data Engineering | Data Pipelines | Deep learningMid-level Full TimeHyderabad, HDC3B, India16h ago
-
Senior Data Engineer (Data Analytics),Hyderabad INR 3000K-4000KAPI | AWS | Agile | Amazon DynamoDB | Amazon RedshiftEqual opportunity employer | Fast track growth opportunitiesSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …16h ago
-
Data Engineer - Fabric Pipelines / Orchestration INR 2040K-3000KApache Spark | Azure Synapse | Data Quality | Data Warehousing | Data integrationContract employment | Quarterly renewal | Remote workSenior-level Full TimeDelhi, DL, IN16h ago
-
Databricks - Principal Data Engineer INR 1500K-2500KApache Spark | CI/CD | Data Modeling | Data Pipeline Performance Tuning | Data WarehousingFull-time employment | Hybrid workSenior-level Full TimeBangalore, KA, IN16h ago
-
AI/ML Engineer INR 2500K-4500KAWS | Azure | Cloud Computing | Computer Vision | Continuous DeploymentSenior-level Full TimePune [SNTPS Kharadi], India16h ago
-
Custom Software Engineer INR 2475K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseSenior-level Full TimeBengaluru, BDC11A, India16h ago
-
Mid-level Full TimeBengaluru, BDC6F, India16h ago
-
Custom Software Engineer INR 1500K-2500KAI Evaluation | Agentic AI | Artificial Intelligence | Data Engineering | Generative AIMid-level Full TimeGurugram, DDC2A, India16h ago
-
Senior-level Full TimeBengaluru, KA, IN, 56001616h ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Dataverse | Azure FunctionsSenior-level Full TimePune, India16h ago
-
AWS | Airflow | DBT | Fine Tuning | Language ModelsBonuses | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, India R22h ago