Principal Data Engineer - Commercial Effectiveness
Bengaluru Campus 31, India
INR 3600K-4600K (estimate) Senior-level Full Time
Tasks
- Collaborate with data architects analysts and data scientists
- Design build and operate scalable data solutions
- Develop mentor and manage data engineering team
- Drive CI/CD automation
- Embed data quality security and governance controls
- Ensure reliable reusable fit for purpose data assets
- Establish engineering standards architecture patterns and best practices
- Evaluate and introduce new data engineering technologies
- Implement infrastructure-as-code
- Implement logging tracing and monitoring systems
- Lead data foundation delivery
- Optimize compute and storage performance
- Own full data engineering lifecycle
- Provide hands on technical leadership for complex problems
- Translate business requirements into production ready data assets
Perks/Benefits
- N/A
Skills/Tech-stack
AKS | Agile | Ansible | Apache Airflow | Apache Kafka | Apache Spark | Application Monitoring | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Event | Azure Event Hubs | Azure Functions | Azure Kubernetes | Azure Kubernetes Service | Azure Synapse | Azure Synapse Analytics | Blob Storage | CI/CD | Containerization | Data Engineering | Data Governance | Data Lake Storage | Data Modeling | Data Quality | Data Security | Databricks | DevOps | Distributed Systems | Event Driven | Event Hubs | Event-driven architecture | IaC | Infrastructure as Code | Kubernetes Service | Logging | SAFe | Scrum | Streaming Architectures | Synapse Analytics | Terraform | Tracing | “as-code”
Related jobs
-
Databricks Data Engineer (Databricks, PySpark, Cloud, MLOps) | 100% Remote | Contract 12 + Months | AS A INR 1500K-2600KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | DatabricksRemote workSenior-level Full TimeIndia, India R3h ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkComplimentary games | Family leave | Health insurance | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India5h ago
-
Senior-level Full TimeHyderabad, India6h ago
-
Senior BI Engineer - Tableau & Python INR 3000K-4000KBusiness Intelligence | Data Modeling | Data Visualization | Data Warehousing | DatabricksCareer growth | Certification support | Flexible collaboration | Innovation time | MentorshipSenior-level Full TimeHyderabad, TS, India7h ago
-
Applied AI ML Senior Associate INR 3264K-5000KAWS | Azure | CI/CD | Cloud platform | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Associate Program Manager INR 2000K-4000KAI Agents | AI Foundry | AI Governance | AI orchestration | APIsMid-level Full TimeChandigarh, India7h ago
-
AI/ML Engineer INR 1860K-4000KAI Agent Builder | AI Pipelines | AI vector search | Agent Builder | AirflowMid-level Full TimeChennai, Tamil Nadu, India7h ago
-
Senior-level Full TimeHyderabad, Telangana, India9h ago
-
Manager of Software Engineering - Java Full stack developer INR 2000K-3200KAPI first | AWS | CI/CD | Databricks | DockerSenior-level Full TimeHyderabad, Telangana, India R9h ago
-
Engineering-L2-Bengaluru-Analyst-Software Engineering INR 1500K-2500KApache Spark | Avro | CI/CD | Data Clustering | Data ModelingEntry-level Full TimeBengaluru, Karnataka, India9h ago
-
Mgr-AI Innovation & Research INR 3799K-5500KApache Hive | Apache Spark | Attention Mechanism | BigQuery | C plus plusSenior-level Full TimeBengaluru, KA, India10h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India10h ago
-
ML-Ops INR 3700K-5000KAsyncio | CI/CD | CProfile | Caching | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Engineering Manager – AI Platforms INR 3000K-5000KAWS | AWS Bedrock | Agile Scrum | Amazon SageMaker | AzureCollaborative team environment | Diverse projects | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India11h ago
-
Generative AI Engineer INR 1200K-2500KAI Services | AWS | Amazon SageMaker | Anthropic API | AzureCollaborative team environment | Leadership development | Training programsMid-level Full TimeMumbai, Maharashtra, India11h ago
-
Staff GenAI Engineer INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ClassificationCollaborative team environment | Global consulting environment | Leadership development program | Mentorship programs | Training sessionsSenior-level Full TimeMumbai, MH, India11h ago
-
Mid-level Full TimeMumbai, Maharashtra, India11h ago
-
Senior-level Full TimeMumbai, Maharashtra, India11h ago
-
D&T Technical Solutions Manager - Marketing and Commercial INR 2000K-3814KAPI Design | API LED | API-led Architecture | Access Control | AgileMid-level Full TimePune, IN12h ago
-
Lead Software Engineer - Python and AI INR 3500K-6000KAI assisted code | AI-assisted code review | AWS ECS | AWS Lambda | Agent FrameworksSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior-level Full TimeMumbai, Maharashtra, India12h ago
-
Lead Data Engineer - Azure + Fabric INR 1200K-2700KAzure | Azure DevOps | CDC | CI/CD | Data GovernanceSenior-level Full TimeGurugram, Haryana, India12h ago
-
Databricks Engineer - Senior/ Lead INR 1500K-2800KACID | ADLS Gen2 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, TS, India12h ago
-
Data Engineer - Azure + Fabric INR 1400K-2700KAccess Control | Apache Spark | Azure Data | Azure DevOps | Azure SynapseSenior-level Full TimeGurugram, Haryana, India12h ago
-
Mid-level Full TimeNoida R13h ago