Associate Director, RDU IT Data Engineering
Tasks
- Apply AI assisted PII detection policy checks and audit artifacts
- Apply AI driven recommendations to balance cost and performance
- Build scalable reliable secure data products
- Correlate incidents across orchestration warehouse and source systems
- Create self healing runbooks where feasible
- Design and build cloud native ELT ETL data pipelines
- Detect anomalies and drift and suggest root causes
- Ensure FAIR and TRUSTed data product alignment
- Generate technical documentation lineage and code comments with AI
- Implement batch micro batch and event driven integrations
- Implement data quality frameworks and SLAs SLOs
- Instrument pipelines with metrics logs and traces
- Mentor engineers in data engineering and responsible AI use
- Operationalize data governance and privacy controls
- Optimize pipeline performance reliability and security
- Support data contracts and reproducible pipelines
- Tune Snowflake warehouses queries and dbt models for cost performance and concurrency
- Use AI copilots for code test and schema generation
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Anomaly Detection | Apache Airflow | CI/CD | CloudFormation | Containerization | DBT | Data Governance | Data Quality | Docker | Drift Detection | Encryption | Fivetran | GDPR | GitHub Actions | HIPAA | Infrastructure as Code | Kubernetes | Logging | Metrics | Microservices | Observability | PII Detection | Python | RBAC | SQL | Serverless | SnowSQL | Snowflake | Snowpipe | Streams and Tasks | Terraform | Time Travel | Tracing | Zero copy | Zero-Copy Cloning | “as-code”
Related jobs
-
Analytics Solutions Associate INR 1000K-1500KAccess Controls | Alteryx | Anomaly Detection | Data Governance | Data LineageMid-level Full TimeMumbai, Maharashtra, India13h ago
-
API Design | Apache Airflow | Apache Spark | CI/CD | Cloud ComposerMid-level Full TimePune, Maharashtra, India R13h ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India14h ago
-
Mid-level Full TimeBangalore, Karnataka, India R15h ago
-
Mid-level Full TimeIND - Bengaluru, India23h ago
-
Lead Software Engineer - Data Engineering INR 3417K-4580KAWS | AWS CloudFormation | Agile | Azure DevOps | CI/CDSenior-level Full TimeChennai, Tamil Nadu, India23h ago
-
Associate Director, RDU IT Data Engineering INR 1800K-2700KAWS | AWS Glue | Anomaly Detection | Apache Airflow | CI/CDMid-level Full TimeLocation: Bengaluru, India23h ago
-
Sr Data Engineering Analyst-Python, Scala, Azure INR 1500K-3000KApache Airflow | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimePrimary location: Noida, India23h ago
-
VP AI ML Engineering INR 3000K-6000KAI Deployment | API Integration | Agentic AI | CI/CD | ContainerizationCareer development opportunities | Comprehensive benefits | Continuous learning | Inclusion-oriented cultureExecutive-level Full TimePrimary location: Hyderabad, India23h ago
-
Associate Director I/II, Real World Data Statistics INR 980K-1820KAnalysis Plan | Audit Readiness | Causal Inference | Confounding | Data linkageMid-level Full TimeLocation: Bengaluru, India23h ago
-
Associate Director I/II, Real World Data Statistics INR 980K-1820KCausal Inference | Confounding control | Data Quality | Data linkage | Data quality assessmentMid-level Full TimeIndia - Bangalore23h ago
-
Assistant Vice President.Retail Risk Analytics-Risk Management INR 4000K-5199KBacktesting | Basel framework | Big Data | Big data analytics | Credit RiskExecutive-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Manager Data Engineering INR 3200K-5000KArtificial Intelligence | Automation | Azure | Classification | Cloud DataSenior-level Full TimePrimary location: Pune, India1d ago
-
Director - Data & Analytics Integration & Eventing INR 4000K-5199KAPI Management | AWS | AWS Glue | Automation | AxwayExecutive-level Full TimeHyderabad (Office), India2d ago
-
Technical Lead Data Engineer INR 2771K-4200KAPI Integration | AWS Glue | Amazon Redshift | Amazon S3 | Data ArchitectureFinancial wellness | Hybrid work model | Personal wellness | Physical wellness | Wellness supportSenior-level Full TimeHyderabad, India2d ago
-
Director of Data Engineering INR 3000K-4000KAWS | Apache Kafka | Apache Spark | Azure | Azure DevOpsExecutive-level Full TimeBengaluru Luxor North Tower, India2d ago
-
Solutions Engineer - Data Engineering INR 2000K-3000KApache Airflow | CI/CD | DAG | Data Transformation | DockerHybrid work model | Office in HyderabadMid-level Full TimeHyderabad3d ago
-
Associate Data Quality Specialist INR 700K-900KCustomer Service | Data Cleansing | Data Quality | Data Reconciliation | Data ValidationMid-level Full TimeIndia3d ago
-
Quant Analytics Senior Associate - Cards INR 1400K-2347KAlteryx | Big Data | Data Analysis | Data Mining | Data VisualizationMid-level Full TimeBengaluru, Karnataka, India3d ago
-
Quant Analytics Associate - Cards INR 1219K-2134KAlteryx | Data Analysis | Data Mining | Data Visualization | Data dashboardsMid-level Full TimeBengaluru, Karnataka, India3d ago
-
Associate Software Engineer INR 1200K-2800KAgile | C# | Cloud Development | Containerization | DHTMLMid-level Full TimeKolkata, India3d ago
-
Associate Data Scientist INR 980K-1500KClassification | Clustering | Data Analysis | Data Transformation | Data cleaningMid-level Full TimeHyderabad, Telangana, India3d ago
-
Mid-level Full TimeHyderabad, Telangana, India3d ago
-
IN-Associate_GEN AI_D&A _Advisory_Mumbai INR 2000K-5000KAgentic Workflow | Amazon Web Services | Azure | Bitbucket | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeMumbai Shivaji Park, India3d ago
-
Auditing | Compliance Auditing | Corporate Governance | Data Analysis | Data IngestionMid-level Full TimeGurugram 8 B, India3d ago