Associate Director, RDU IT Data Engineering
Location: Bengaluru, India
INR 1500K-2700K (estimate) Mid-level Full Time
Tasks
- Balance cost performance and concurrency using AI recommendations
- Correlate incidents across orchestration warehouse and source systems
- Create automated audit artifacts
- Define batch micro batch and event driven integration patterns
- Deliver scalable cost efficient resilient data products
- Design and build cloud native ELT ETL pipelines
- Detect and tag PII and enforce policy checks
- Detect anomaly and drift and recommend root cause
- Generate SQL and Python code with AI copilots
- Generate unit integration tests with AI copilots
- Implement data quality frameworks and SLAs SLOs
- Implement self healing runbooks where feasible
- Instrument pipelines with metrics logs and traces
- Manage data lineage and metadata enrichment
- Mentor engineers on data engineering and responsible AI usage
- Operationalize data governance and privacy controls
- Optimize pipeline performance reliability and security
- Support data contracts and feature ready datasets
- Tune Snowflake warehouses queries and dbt models
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Anomaly Detection | Apache Airflow | CI/CD | CloudFormation | DBT | Data Catalog | Data Observability | Data Quality | Docker | Drift Detection | Encryption | FAIR | Fivetran | GDPR | GitHub Actions | HIPAA | Infrastructure as Code | Kubernetes | PBAC | PII Detection | Python | RBAC | SQL | Secrets management | Serverless | SnowSQL | Snowflake | Snowflake Streams | Snowflake Tasks | Snowpipe | TRUSTed | Telemetry | Terraform | Zero copy | Zero copy clone | “as-code”
Education
Related jobs
-
Access Control | Agile | Alerting | Apache Airflow | AuditabilityFlexible working | Inclusive diverse workplace | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India16h ago
-
Architect – Agentic AI Engineering INR 2500K-5000KAPI Design | AWS | Async/Await | Azure | Claude CodeSenior-level Full TimeHyderabad, India18h ago
-
Senior-level Part TimeGurugram, Haryana, India23h ago
-
Lead Assistant Manager INR 1500K-2500KApache Airflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud StorageSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Lead Digital Architect INR 2500K-4300KAI | API Gateway | AWS | Access Control | Amazon RDSOnsite schedule five days a week | Relocation assistanceSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Technical & Solution Architect INR 2771K-4300KAWS | Agile | Airflow | Angular | Angular MaterialCareer growth | Healthcare benefits | Hybrid work environment | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago
-
Data Architect INR 2000K-3200KApache Spark | Audit Logging | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePune, PDC3B, India1d ago
-
Mid-level Full TimeIND - Telangana - Hyderabad (Hitec … R1d ago
-
Senior Developer, Snowflake & Databricks INR 1500K-2700KADLS | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsContinuous learning | Professional growthSenior-level Full TimeGurugram, India1d ago
-
Generative AI Architect-Manager INR 2000K-5000KAI Foundry | Amazon Bedrock | Artificial Intelligence | Autogen | Azure AISenior-level Full TimeBangalore (SDC) - Bagmane Tech Park, …1d ago
-
Large Language Model Architect INR 2500K-5000KFine Tuning | Language Models | Language Processing | Large Language Models | Machine LearningSenior-level Full TimeBengaluru, BDC7A, India1d ago
-
Senior-level Full TimeIndia - Chennai1d ago
-
Director- Software Engineering Lead INR 3242K-5000KAWS | AWS Bedrock | Angular | Azure | Azure OpenAISenior-level Full TimeIndia - Chennai1d ago
-
Lead Data & Analytics Eng - Vice President INR 3000K-5000KApache Iceberg | Cloud Native | Data Modeling | Data Processing | Data QualitySenior-level Full TimeRMZ Ecoworld Business Park, India1d ago
-
Principal Data Engineer - Senior Manager INR 3000K-4500KAWS | Apache Spark | CI/CD | Data Architecture | Data ModelingEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India1d ago
-
Azure Databricks-Senior Technical Architect INR 2400K-4500KAgile methodologies | Apache Spark | Azure | CI/CD | Data platformHolidays | Paid time off | Rewards and recognition programs | Travel opportunities | Work-life balanceSenior-level Full TimeHyderabad, TELANGANA, India1d ago
-
Senior-level Full TimeShaikpet, India R1d ago
-
Lead / Manager - Data Engineering INR 1500K-3000KAgile | Apache Airflow | Apache Hadoop | Apache Spark | Data ModelingSenior-level Full TimeHyderabad, TS, India1d ago
-
Senior Technical Specialist, AI Solutions : Delhi INR 2500K-4800KAWS | Agent Orchestration | Authentication | Azure | CI/CDHybrid work | Onsite client workSenior-level Full TimeIndia Remote R1d ago
-
Access Management | Alation | Change Data Capture | Collibra | Data Capture401k matching | Dental insurance | Flexible work arrangements | Fully remote work | Life insuranceMid-level Full TimeIndia R2d ago
-
Senior-level Full TimeNoida,Uttar Pradesh,India2d ago
-
Manager II, Tech(AI) INR 2000K-3300KAWS | Access Control | Amazon Kinesis | Amazon Redshift | Amazon SageMakerMid-level Full TimeHitech City, TG, India2d ago
-
Senior Manager, Data & AI Platform INR 3000K-5000KAPIs | Airflow | Argo Workflows | Compute Orchestration | Data pipelineChallenging projects | Collegial culture | Flex workSenior-level Full TimeBangalore, IN2d ago
-
DE-Cloud Native Data Architect-AWS-GDSN02 INR 2771K-4300KAI-powered analytics | AWS | AWS Glue | AWS Lake | AWS Lake FormationSenior-level Full TimeBengaluru, KA, IN, 5600162d ago