Associate Director, RDU IT Data Engineering
Tasks
- Automate PII detection tagging and policy checks
- Balance cost performance and concurrency
- Build reusable golden path templates
- Correlate incidents across orchestration warehouse and source systems
- Create unit and integration tests
- Design and build cloud native ELT ETL data pipelines
- Develop scalable resilient secure data products
- Ensure FAIR and TRUSTed data product alignment
- Generate SQL and Python code with AI copilots
- Implement RBAC PBAC encryption and retention
- Implement batch micro batch and event driven integrations
- Implement data quality frameworks and SLAs SLOs
- Instrument pipelines with metrics logs and traces
- Manage data catalog metadata and semantic tagging
- Mentor engineers on responsible AI and modern data engineering
- Operationalize data governance and privacy controls
- Optimize database queries and schemas
- Optimize pipeline performance reliability and security
- Perform anomaly and drift detection
- Support data contracts and feature ready datasets
- Tune Snowflake warehouses and queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Anomaly Detection | Apache Airflow | CI/CD | CloudFormation | Containerization | Cortex | DBT | Data Quality | Distributed tracing | Docker | Drift Detection | Encryption | FAIR | Fivetran | GDPR | GitHub | HIPAA | Infrastructure as Code | Kubernetes | Logging | Metrics | Observability | Prompt engineering | Python | RBAC | SQL | Secrets management | Serverless | SnowSQL | Snowflake | Snowpipe | Streams and Tasks | Terraform | Zero copy | Zero copy clone | “as-code”
Education
Related jobs
-
Sr Developer Software INR 2000K-4000KAWS | AWS Glue | AWS Lambda | Amazon ECS | Amazon EMRFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India3h ago
-
Data Architect INR 1500K-2600KApache Kafka | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore North, India11h ago
-
Lead Database Engineer INR 1500K-3000KAudit Logging | Azure Data | Azure Data Factory | Azure Database | Azure Database MigrationSenior-level Full TimePune City, India12h ago
-
ETL,K8, NiFi, Kafka, Prod Support/Senior Consultant Specialist INR 2800K-4200KAIOps | AWS | Agile | Ansible | AzureFlexible working | Professional development opportunitiesSenior-level Full TimeHyderabad, Telangana, India R12h ago
-
Data Scientist INR 2500K-4500KAdvanced Statistics | Apache Spark | Azure Data | Azure Data Factory | Azure KubernetesEquity and inclusion focus | Mentorship opportunities | Travel to other locations in India and globally | Work on global projectsSenior-level Full TimeBangalore - Karnataka - India12h ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1200K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | Data ModelingContinuous professional development | Flexible working | Inclusive workplace cultureSenior-level Full TimeHyderabad, Telangana, India R12h ago
-
Senior-level Full TimePune, Maharashtra, India13h ago
-
Data Ingestion Engineer (ADF+Dbt+Snowflake) INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | DBT | Data FactoryMid-level Full TimePune, MH, India13h ago
-
Mid-level Full TimeBengaluru, Karnataka, India R14h ago
-
C# | C++ | Data Science | Data Structures | Distributed SystemsExecutive-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior-level Full TimePune, Maharashtra, India14h ago
-
Assistant Manager INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud StorageMid-level Full TimePune, Maharashtra, India14h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India R14h ago
-
Applied AI/ML Engineer INR 2000K-3000KAgentic Systems | Bias Mitigation | Decision Trees | Evaluation Frameworks | Fallback mechanismsMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Software Engineering Manager II, Google Cloud INR 1500K-3500KAI infrastructure | C# | C++ | Code review | Distributed ComputingMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India R15h ago
-
AWS Data Engineer INR 1500K-2500KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeBengaluru, Karnataka, India R15h ago
-
EAI Software Engineer INR 1800K-2500KAPI Gateway | APIs | Agile | ArgoCD | CI/CDOn site work 4 days per week | Relocation N/AMid-level Full TimeHyderabad, India15h ago
-
Software Engineer III-Java, Kafka/Streams INR 2000K-3000KAgile | Application Resiliency | CI/CD | Data Visualization | JavaSenior-level Full TimeMumbai, Maharashtra, India16h ago
-
Software Engineer II - AI & Agentic Automation INR 1200K-2500KAI Search | AWS | AWS CDK | AWS CloudFormation | AWS environmentsMid-level Full TimeBangalore, Karnataka, India16h ago
-
AI safety & Security controls, LLM Guardrails/Associate Director, Software Engineering Specialist INR 1400K-2500KAPI Development | Asynchronous processing | Audit trails | Classification | Cloud ComputingFlexible working | Opportunities for professional developmentMid-level Full TimePune, Maharashtra, India R16h ago
-
Mid-level Full TimeHyderabad, India16h ago
-
Software Engineer INR 1200K-2500KAlgorithms | Artifactory | Azure DevOps | Bitbucket | CI/CDEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India16h ago
-
Sr. Data Engineer INR 1500K-2700KAWS Glue | AWS Lambda | Amazon Athena | Amazon S3 | Azure DataHybrid workSenior-level Full TimeChennai, IND-TN, India17h ago
-
Data Engineer INR 1500K-2600KAWS DataZone | AWS Lake | AWS Lake Formation | AWS Lambda | Amazon AthenaContinuous improvement | Hybrid work environment | Stakeholder collaborationSenior-level Full TimeChennai, IND-TN, India17h ago