Associate Director, RDU IT Data Engineering
Tasks
- Apply FAIR and trustworthy data product principles
- Apply Infrastructure as Code with Terraform or CloudFormation
- Build scalable data products
- Collaborate on data contracts feature datasets
- Correlate incidents across orchestration warehouse and source systems
- Design cloud native ELT ETL pipelines
- Detect and tag PII with AI
- Detect anomaly and drift with AI
- Develop reusable components templates golden paths
- Generate technical documentation lineage summaries with AI
- Generate unit integration tests with AI copilots
- Implement batch micro batch event driven integrations
- Implement data quality frameworks and SLAs SLOs
- Instrument pipelines with metrics logs traces
- Maintain GDPR HIPAA alignment
- Manage Snowflake warehouses queries and dbt models
- Mentor engineers on data engineering and responsible AI
- Operationalize data governance and privacy controls
- Optimize pipeline performance reliability security
- Tune cost performance and concurrency for Snowflake
- Use AI copilots for SQL Python dbt code scaffolding
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Anomaly Detection | Apache Airflow | CI/CD | CloudFormation | Containerization | DBT | Data Catalog | Data Governance | Docker | Drift Detection | ELT | ETL | Encryption | FAIR | Fivetran | GDPR | GitHub Actions | HIPAA | Infrastructure as Code | Kubernetes | Logging | Metadata | Metrics | Observability | PBAC | PII Detection | Python | RBAC | SQL | Secrets management | Serverless | SnowSQL | Snowflake | Snowflake Streams | Snowflake Tasks | Snowflake Zero Copy Clone | Snowpipe | Streams & Tasks | Terraform | Time Travel | Tracing | Zero copy clone | “as-code”
Education
Related jobs
-
Senior-level Full TimeHyderabad, India9h ago
-
API Design | Apache Airflow | Apache Beam | Apache Flink | Async messagingContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R9h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India13h ago
-
Lead Software Engineer - Python and AI INR 3500K-6000KAI assisted code | AI-assisted code review | AWS ECS | AWS Lambda | Agent FrameworksSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Lead Software Engineer (Full Stack) INR 506K.NET | AWS | Angular | Asynchronous programming | AzureRemote work flexibility | Supportive team culture | Work-life balanceSenior-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India17h ago
-
Senior-level Full TimeChennai, TN, IN R22h ago
-
EDM Eagle PACE-STAR Data Analyst- Manager INR 1000K-1500KAdvanced Excel | Cause analysis | Data Governance | Data Lineage | Data ManagementMid-level Full TimeBengaluru, KA, IN, 56001622h ago
-
Lead AI Engineer – Lead Engineer , VP INR 2000K-5000KADK | AIOps | API Design | BigQuery | Cloud ComposerAccident insurance | Best in class leave policy | Childcare assistance reimbursement | Employee assistance program | Gender neutral parental leavesSenior-level Full TimePune - Margarpatta, India22h ago
-
Data Engineer- Azure Databricks Senior Associate INR 1500K-2800KApache Hadoop | Apache Spark | Apache Spark SQL | Azure Data | Azure Data FactorySenior-level Full TimeBangalore (SDC) - Bagmane Tech Park, …22h ago
-
Azure Databricks design - Senior Manager INR 1500K-3000KAgile | Amazon Web Services | Apache Airflow | Azure Data | Azure Data FactoryCoaching and mentoring | Continuous improvement | Inclusive cultureSenior-level Full TimeBangalore (SDC) - Fortius Tower, Olympia …22h ago
-
AVP, Applied Model Ops Developer (L11) INR 3000K-5000KAWS | Amazon Redshift | Apache Airflow | Apache Spark | AzureFlexible work hours | Regional engagement hubs | Work from homeExecutive-level Full TimeHyderabad IN, India R22h ago
-
Senior Manager - Data Analyst - Methodology & Assumption (M&A) Actuarial Policyholder Data Team INR 3000K-4000KCause analysis | Data Analysis | Data Enrichment | Data Governance | Data MonitoringSenior-level Full TimeMumbai Central Avenue, India22h ago
-
Principal Data Engineer - Commercial Effectiveness INR 3600K-4600KAKS | Agile | Ansible | Apache Airflow | Apache KafkaSenior-level Full TimeBengaluru Campus 31, India22h ago
-
Associate Director I/II, Real World Data Statistics INR 980K-1400KCausal Inference | Cohort construction | Confounding control | Data Analysis | Data linkageMid-level Full TimeIndia - Bangalore22h ago
-
Director, Data Engineering INR 4000K-4000KAccess Control | Airflow | DBT | Data Modeling | Data WarehousingExecutive-level Full TimeIndia - Hyderabad22h ago
-
Product Management Director - Data Platform INR 3000K-4000KABAC | API Integration | Access Control | Analytics | Big DataExecutive-level Full TimeIndia - Hyderabad22h ago
-
Software Engineering Lead INR 4000K-6000KAI Observability | Agent systems | Agentic AI | Amazon Web Services | Anthropic MCP)Senior-level Full TimePrimary location: Hyderabad, India22h ago
-
AI Technical Lead INR 2500K-5000KAPI Development | Access Control | Access Management | Alerting | AuthenticationSenior-level Full TimePune, India22h ago
-
Lead Software Engineer, Data Engineering INR 2000K-3000K.Net Core | ASP.NET MVC | ASP.Net Core | Agile | Automated testingSenior-level Full TimePune, Maharashtra, India1d ago
-
Bigdata team member in New Data team for L4 - Lead Data Engineer INR 1500K-2700KAWS | Agile | Apache Kafka | Apache Spark | CI/CDAccess to trainings and certifications | Bonuses | Socializing activitiesSenior-level Full TimeHyderabad, India, India1d ago
-
Lead Database Engineer INR 1500K-3000KAudit Logging | Azure Data | Azure Data Factory | Azure Database | Azure Database MigrationSenior-level Full TimePune City, India3d ago
-
Lead AI Engineer - Agentic Engineering INR 2500K-5000KAPI Design | Agent Orchestration | Agent systems | Autogen | Automated RegressionSenior-level Full TimeHyderabad, TS, India3d ago
-
Lead Developer (Python, React, AWS, GenAI) INR 3242K-4800KAgile | Amazon Web Services | Apache Kafka | Continuous integration | DevSecOpsAutonomy | Inclusive & Supportive Culture | Mentoring | Professional development opportunitiesSenior-level Full TimePune, India3d ago
-
Lead Generative AI Engineer-Player Coach INR 2000K-5000KAWS Bedrock | Amazon Elastic Kubernetes Service | Argo Workflows | Autogen | AzureSenior-level Full TimePune, Maharashtra, India3d ago
-
Accountability Models | Analytics | Consent Management | Data Accessibility | Data GovernanceContract opportunity | Exposure to data privacy and analytics initiatives | Fully remote working | High visibility stakeholder engagement | Long term program impactSenior-level Contract Full TimeIndia R3d ago