Associate Director, RDU IT Data Engineering
Tasks
- Build reproducible pipelines with data contracts
- Build reusable components and templates golden paths
- Correlate incidents across orchestration and warehouse systems
- Create data catalogs metadata semantic tags and lineage
- Create self healing runbooks for pipeline issues
- Design and build cloud native ELT ETL pipelines
- Develop scalable cost efficient resilient data products
- Generate unit and integration tests with AI copilots
- Implement batch micro batch and event driven integrations
- Implement data governance privacy controls RBAC PBAC encryption retention
- Implement data quality frameworks with anomaly and drift detection
- Instrument pipelines with metrics logs and traces
- Mentor engineers in data engineering and responsible AI
- Optimize cost performance and concurrency
- Optimize pipeline performance reliability and security
- Perform automated PII detection and policy checks
- Support FAIR and TRUSTed data product principles
- Tune Snowflake warehouses queries and dbt models
- Use AI copilots to scaffold SQL Python and dbt code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Anomaly Detection | Apache Airflow | CI/CD | Containerization | DBT | Data Catalog | Data Governance | Data Quality | Docker | Drift Detection | Encryption | Fivetran | GDPR | GitHub | GitHub Actions | HIPAA | Infrastructure as Code | Kubernetes | Lineage | Logging | Metadata Management | Metrics | Observability | PBAC | PII Detection | Python | RBAC | SQL | Secrets management | Serverless | SnowSQL | Snowflake | Snowpipe | Streams and Tasks | Terraform | Time Travel | Tracing | Zero copy | Zero copy clone | “as-code”
Education
Related jobs
-
Mid-level Full TimeHyderabad, India6h ago
-
Senior-level Full TimeIN-AP-Hyderabad8h ago
-
Senior Engineering Manager, Geo INR 2800K-4500KBusiness Intelligence | C++ | Data Compression | Data Science | Data analyticsSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior-level Full TimeBangalore, Karnataka, India9h ago
-
Senior-level Full TimeBangalore, Karnataka, India9h ago
-
Lead Software Engineer Python Gen AI INR 3500K-5500KAWS | Agents | Amazon Web Services | Anomaly Detection | AuthenticationSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior-level Full TimePune, Maharashtra, India12h ago
-
Mid-level Full TimeBangalore, Karnataka, India15h ago
-
Analytics Solutions Manager- Associate INR 700K-1200KAirflow | Alerting | Anomaly Detection | Azure Data | Azure Data FactoryMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Sr Lead Architect - (Java, Python, AI Solutions) INR 3500K-5000KAI/LLM | AI/LLM tools | AWS | Amazon Web Services | Artificial IntelligenceSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Data & Analytics Engineer - Consultant INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India15h ago
-
Senior-level Full TimeBangalore, KA, India16h ago
-
Agentic AI Lead INR 2500K-5000KAgent safety | Agent safety evaluation | Agents SDK | Airflow | CI/CDTeam leadershipSenior-level Full TimeChennai, TN, India16h ago
-
Data Solution Architect INR 2200K-3500KAPI Integration | Apache Spark | Application Programming | Application Programming Interfaces | Azure DataHealth and well-being benefits | Inclusive collaborative workplace | Mentorship | Professional development | Structured learningSenior-level Full TimeRMZ Ecoworld 32, India20h ago
-
Data Architect AVP INR 3000K-4000KAnalytics | Asset Management | Cloud Computing | Conceptual data modeling | Cross Border DataSenior-level Full TimeBangalore, KA, IN, 56010320h ago
-
Lead Data Scientist MSAT INR 2400K-4064KArtificial Intelligence | Data Validation | Deep learning | GitHub | Lean managementHybrid work | Occasional travel | Remote work flexibilitySenior-level Full TimeBengaluru Luxor North Tower, India20h ago
-
Lead Analyst Business Intelligence Analytics INR 2771K-4132KAWS | Ad Hoc Reporting | Ad-Hoc | Analytics | Business IntelligenceFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India20h ago
-
AI Transformation and Automation Lead INR 3000K-4680KAI Agents | API | Analytics | Automation | CloudCareer growth | Global team collaboration | Innovation-focused environmentSenior-level Full TimeIndia - Remote R20h ago
-
Lead Enterprise Engineer (AI / Artificial Intelligence) INR 2500K-5000KAPI Development | AWS | Agentic AI | Automation | AzureIn person interview option | Onsite work requiredSenior-level Full TimeIND-Pune-Smartworks, India20h ago
-
Senior-level Full TimeBengaluru, India20h ago
-
Adobe Analytics | CES | CSAT | Cause analysis | Customer ExperienceCollaborative workspaces | On-site clinic | On-site gymMid-level Full TimeBengaluru, India20h ago
-
Lead Data Analyst - Enterprise Data and Analytics (MDM) INR 2817K-4200KConfluence | Data Management | Data Quality | Data Reconciliation | ExcelSenior-level Full TimeIND - KA - Bangalore - …20h ago
-
Data Mining | Machine Learning | Python | SQL | Series forecastingExecutive-level Full Time(HIL) DELHI - RHQ, India20h ago
-
Senior-level Full TimeIND - KA - Bangalore - …20h ago
-
Mgr, Forward Deployed Engineer, Data & Intelligence INR 3000K-5000KADaM | AI Governance | AWS | Agentic AI | Apache SparkExecutive-level Full TimeIN022 Hyderabad, India20h ago