Lead - Data Engineer
INMANBP Bangalore (INMANBP) Manyatha, India
INR 3000K-4200K (estimate) Senior-level Full Time
Tasks
- Define and govern data quality checks and controls
- Design data pipelines and ingestion patterns
- Ensure pipeline security auditability and governance
- Govern Snowflake environments security and data domain onboarding
- Govern transformation frameworks with dbt and NiFi OpenFlow
- Implement retries backfills reruns and late arriving data handling
- Lead MicroStrategy and Power BI semantic models dashboards and refresh operations
- Lead enterprise data engineering services
- Maintain CI CD pipelines testing deployment and rollback
- Maintain architecture diagrams lineage runbooks and SOPs
- Monitor throughput connector health latency failures SLAs and alerts
- Operate monitor and optimize data pipelines
- Perform RCA operational reporting audit evidence and DR support
- Provide oversight on data models and transformation documentation
- Provide technical leadership for pipeline design reviews
- Support Dataiku analytics workflows validation and integration
- Tune and optimize SQL and Python workloads
- Validate schema metadata and data quality before publishing
Perks/Benefits
Skills/Tech-stack
Audit Logging | CI/CD | DBT | Data Governance | Data Lineage | Data Quality | Data Recovery | Data encryption | Data masking | Dataiku | Microstrategy | Nifi | OpenFlow | Oracle | Power BI | PySpark | Python | RBAC | SQL | Snowflake | Spark
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior-level Full TimeHyderabad, IND-TG, India12h ago
-
Mid-level Full TimeHyderabad, India15h ago
-
AI+DevSec Ops INR 2000K-4500KAKS | Active Directory | Amazon Web Services | Azure Active Directory | Azure DevOpsSenior-level Full TimeHyderabad, India15h ago
-
Entry-level Full TimeMaharashtra, Pune, India15h ago
-
Python - Bigdata INR 1500K-2800KBig Data | Data pipeline | Development Life Cycle | PySpark | PythonMid-level Full TimeIN-MH-Pune16h ago
-
Senior-level Full TimeIN-KA-Bangalore16h ago
-
Mid-level Full TimeIN-AP-Hyderabad16h ago
-
Data Engineer (PySpark, Database, Python) INR 1500K-2200KAb Initio | CI/CD | Data Governance | DynamoDB | HadoopMid-level Full TimeIN-TN-Chennai16h ago
-
Gen AI INR 1800K-2800KAI Services | AI Studio | Azure AI | Azure AI Services | Azure AI StudioHybrid workMid-level Full TimeIN-AP-Hyderabad16h ago
-
Pyspark Developer INR 2000K-2700KAWS | Apache Flink | Apache Hadoop | Data Modeling | Data analyticsSenior-level Full TimeIN-TN-Chennai16h ago
-
Pyspark Developer INR 2000K-2700KAWS | Apache Flink | Apache Hadoop | Data Modeling | Data analyticsSenior-level Full TimeIN-TN-Chennai16h ago
-
Assistant Director,Collections Analytics Lead INR 2040K-2755KAWS | Alteryx | Audit compliance | Azure | BigQuerySenior-level Full TimeKolkata, West Bengal, India R16h ago
-
Data Warehouse Engineer INR 3000K-4000KAPI Integration | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsAccreditations | Annual excellence awards | Bike to work | Career development program | Educational assistanceSenior-level Full TimeNoida, UP, India17h ago
-
Predictive Analytics Data Scientist-AI Labs INR 2000K-3000KAWS | Anomaly Detection | Azure | Bias Mitigation | Data PrivacyMid-level Full TimeAhmedabad, Gujarat, India17h ago
-
Data Engineer (AWS+Pyspark) INR 1500K-2500KAWS CloudTrail | AWS Glue | AWS Lake Formation | AWS Lambda | Amazon CloudWatchSenior-level Full TimeHyderabad, Telangana, India17h ago
-
Senior-level Full TimeIndia17h ago
-
Senior Tech Lead - Data Engineering / Consultant Specialist INR 2040K-4000KAPI | Apache Airflow | Apache Beam | Autoscaling | BigQueryContinuous professional development | Flexible workingSenior-level Full TimeHyderabad, Telangana, India R17h ago
-
Practice Customer Engineer, Data Analytics INR 2000K-3000KApache Spark | Big Data | Cloud platform | DNS | Data ArchitectureSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India17h ago
-
Senior Software Engineer INR 1500K-2500KAccess Control | Agile | Anomaly Detection | Apache Spark | AzureSenior-level Full TimeBengaluru, KA, IN; Hyderabad, TS, IN18h ago
-
Senior Engineer (Full Stack Infrastructure & Embedded Systems) INR 2000K-3199KAlerting | Android | CI/CD | DTB | Distributed SystemsEmployee resource groups | Flexible work environment | Remote work optionSenior-level Full TimeBengaluru, KA, India18h ago
-
Senior-level Full TimeHyderabad, Telangana, India19h ago
-
Junior GenAI Developer INR 300K-350KAWS | Amazon Bedrock | Anthropic API | Chroma | EmbeddingsCertification programs | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities, India R19h ago
-
Consultant - AI Engineer with Claude INR 2000K-4800KAWS | Autogen | Azure | Cloud Computing | ContainerizationSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Non-Mainly Manager # Proc. & SCM – Digital Transformation INR 1000K-2000KAWS | Agentic AI | Anomaly Detection | Apache Airflow | Apache SparkMid-level Full TimeChennai, Tamil Nadu, India20h ago
-
Junior GenAI Developer INR 300K-350KAWS | Agentic Workflows | Amazon Bedrock | Anthropic | ChromaHealth insurance | Language courses | Mentorship | Professional development | Relocation programEntry-level Full TimeAll Cities, India R20h ago