Associate Director, RDU IT Data Engineering
Location: Bengaluru, India
INR 1800K-2700K (estimate) Mid-level Full Time
Tasks
- Apply Infrastructure as Code with Terraform or CloudFormation
- Auto generate technical documentation and code comments
- Balance cost performance and concurrency for Snowflake
- Build scalable resilient data products
- Contribute reusable golden path templates
- Correlate incidents using metrics logs and traces
- Create audit artifacts for compliance
- Design cloud native ELT ETL data pipelines
- Detect anomaly and drift with AI enabled monitoring
- Generate unit and integration tests with AI
- Implement batch micro batch and event driven integrations
- Implement data governance and privacy controls
- Implement data quality frameworks and SLAs SLOs
- Infer schemas and mappings with AI
- Manage catalog metadata semantic tags and discoverability
- Mentor engineers on data engineering and responsible AI
- Operate RBAC and PBAC with encryption and retention
- Optimize performance reliability and security for pipelines
- Perform AI assisted PII detection and policy checks
- Suggest query optimizations
- Support FAIR and TRUSTed data product principles
- Tune Snowflake warehouses queries and dbt models
- Use AI copilots to scaffold SQL and Python code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Anomaly Detection | Apache Airflow | CI/CD | Cause analysis | CloudFormation | DBT | Data Catalog | Data Governance | Data Observability | Data Quality | Docker | Drift Detection | Encryption | FAIR | Fivetran | GDPR | Git | GitHub Actions | HIPAA | Infrastructure as Code | Kubernetes | Logging | Metrics | PBAC | PII Detection | Python | RBAC | Root Cause Analysis | Root cause | SQL | Secrets management | Serverless | SnowSQL | Snowflake | Terraform | Tracing | “as-code”
Education
Related jobs
-
ACID | AWS Database | AWS Database Migration Service | AWS Glue | AWS LambdaSenior-level Full TimeGurugram 8 B, India1h ago
-
Mid-level Full TimePune, India4h ago
-
Data Engineer II INR 2040K-3380KAWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache AirflowComplimentary games | Family leave | Healthcare coverage | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India8h ago
-
Data Engineer II INR 2040K-3380KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamComplimentary games | Family leave | Healthcare coverage | Hybrid work model | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India8h ago
-
Data Engineer II INR 2200K-3465KAmazon Kinesis | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache BeamFree games | Healthcare benefits | Hybrid work schedule | Mental health support | Paid time offMid-level Full Time地点：Hyderabad, Telangana, India8h ago
-
Data Engineer II INR 2200K-3465KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamFamily leave | Free games | Health insurance | Hybrid work | Mental health supportMid-level Full Time地点：Hyderabad, Telangana, India8h ago
-
Senior Data Engineer INR 1500K-2500KAWS Glue | AWS Lambda | Amazon EMR | Amazon S3 | Apache AirflowSenior-level Full TimeSaidapet8h ago
-
Senior-level Full TimeHyderabad, India9h ago
-
Senior-level Full TimeIN-AP-Hyderabad9h ago
-
ETL Data with QA Tester INR 1500K-2500KDBT | Data Aggregation | Data Quality | Data Transformation | Data ValidationRemote workSenior-level Full TimeIN-AP-Hyderabad9h ago
-
Agentic AI | Alembic | Autogen | Azure AI | Azure OpenAIEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India9h ago
-
Agile | Airflow | Azure | Azure Data | Azure Data FactoryEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off | Wellness plansMid-level Full TimeChennai, TN, India10h ago
-
Software Engineer III - Python Developer + LLM / Gen AI INR 2500K-5000KAWS | Agile | Application Resiliency | CI/CD | Cloud ComputingSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Backend Developer (Node.js) - GGS - BLR INR 1500K-2800KAPM | Bash | Database Query | Database Query Plan | GitHybrid workMid-level Full TimeKarnataka, Bengaluru, India11h ago
-
Sr. Expert INR 2516K-3356KAlgorithms | Cloud Computing | Data Aggregation | Data Engineering | Data IngestionEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India11h ago
-
API Development | Amazon Redshift | Amazon Web Services | Apache Spark | AzureSenior-level Full TimeBangalore, Karnataka, India12h ago
-
Analytics Solutions Associate INR 1000K-1500KAccess Controls | Alteryx | Anomaly Detection | Data Governance | Data LineageMid-level Full TimeMumbai, Maharashtra, India12h ago
-
API Design | Apache Airflow | Apache Spark | CI/CD | Cloud ComposerMid-level Full TimePune, Maharashtra, India R12h ago
-
Manager - AI Application Development INR 2500K-5000KAI Foundry | Agent systems | Arize Phoenix | Autogen | Azure AISenior-level Full TimeGurgaon, Haryana, India12h ago
-
Asstt Manager People Analytics GSSC INR 700K-900KMicrosoft Access | Microsoft Excel | Power Apps | Power Automate | PythonMid-level Full TimeGurgaon,Haryana,India12h ago
-
Lead ML Engineer INR 2500K-5000KAgile | Autogen | Automl | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India13h ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Support Engineer – Developer Portal INR 600K-700KAI Automation | API Integration | Agentic AI | Automation Anywhere | ExcelAccommodation support | Equal opportunity employment | Inclusive cultureEntry-level Full TimeHyderabad, India14h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Apache Airflow | Apache Kafka | Apache SparkAccreditations | Bike to work | Career development | Educational assistance | Employee assistance programSenior-level Full TimeMumbai, MH, India14h ago
-
Data Engineer INR 3000K-4000KAWS | Cloud Computing | Data Architecture | Data Governance | Data ManagementAccreditation support | Bike to work | Career development program | Educational assistance | Employee assistance programMid-level Full TimeBengaluru, KA, India15h ago