Senior AI Data Engineer
INR 2800K-4200K (estimate) Senior-level Full Time
Tasks
- Architect end-to-end data solutions
- Build event driven streaming ingestion
- Conduct architecture and code reviews
- Define data engineering standards and patterns
- Define data quality framework and remediation SLAs
- Design production ELT ETL pipelines
- Design reusable lakehouse components
- Design semantic models and DAX patterns
- Drive data governance and lineage workflows
- Handle late arriving data
- Implement Delta Lake and SCD transformations
- Implement automated data quality validation
- Integrate data quality gates into CI CD deployments
- Lead Power BI governance and deployment pipelines
- Lead master data management initiatives
- Lead technical discovery for new data initiatives
- Maintain technology radar and run tool evaluations
- Mentor data engineering team
- Optimize Spark pipeline performance
- Partner on feature store and embedding pipelines
- Present architecture proposals and governance roadmaps
- Structure and version gold layer datasets for AI
Perks/Benefits
Skills/Tech-stack
Access Control | Audit Logging | Avro | Azure | Azure APIM | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | Broadcast joins | Business glossary | CI/CD | Column-Level Security | Copilot in Fabric | Copilot in Power BI | Cost Based Query Planning | DAX | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Management | Data Quality | Data Retention | Data Stewardship | Data Vault | Data Vault 2.0 | Data retention policies | Databricks | Dataflows Gen2 | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | Event Driven | Event-driven architecture | Feature Store | GDPR | GitHub Actions | Infrastructure as Code | JSON | Key Vault | LLM | Lakehouse | Liquid clustering | MDM | Master Data | Master Data Management | Medallion Architecture | Microsoft Data | Microsoft Data Factory | Microsoft Fabric | Parquet | Partitioning | Power BI | PySpark | Python | Query Optimization | Query Planning | RAG | REST APIs | RLS | Retention policies | Row Level Security | SCD Type 6 | SCD Type-2 | SQL | Semantic layer | Spark Query Optimization | Streaming Ingestion | Synapse Analytics | Terraform | Type 2) | Unity Catalog | Unity Catalog Access Control | Vector Databases | YAML | Z-ordering | “as-code”
Education
N/A
Roles
AI Data Engineer | Data Engineer | Engineer | Senior AI Data Engineer
Related jobs
-
SSE_Analytics Enablement INR 2250K-5000KAI/ML | Alteryx | Analytics engineering | Architecture Review | AutomationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India9h ago
-
SSE_Analytics Enablement INR 2250K-5000KAlteryx | Architecture Review | Artificial Intelligence | CI/CD | Code AutomationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India9h ago
-
Data Engineer INR 1000K-1000KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud BuildEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India10h ago
-
Data Engineer INR 1500K-3000KAPI Development | AWS | Amazon Kinesis | Amazon Redshift | AzureCommunity volunteering opportunities | Discounted gym memberships | Flexible working | Life assurance | Medical insuranceMid-level Full TimeHyderabad, India13h ago
-
ML Engineer (Must have- Python & R), Pune candidates preferred INR 2500K-3356KAWS | Azure | Code Documentation | Confluence | Distributed SystemsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India14h ago
-
Entry-level Full TimeBengaluru, India15h ago
-
GCP Data Engineer / Consultant Specialist INR 1500K-2000KAirflow | Alerting | Apache Beam | Automation | BigQueryFlexible working | Inclusive workplace | Opportunities for growth | Professional developmentMid-level Full TimePune, Maharashtra, India R15h ago
-
Senior AI Testing Engineer (Generative AI) INR 2000K-3300KAI Agents | API Testing | AWS | Azure | CI/CDSenior-level Full TimeBangalore North, India16h ago
-
Senior-level Full TimeIN-KA-Bangalore16h ago
-
Senior-level Full TimeIN-KA-Bangalore16h ago
-
Senior-level Full TimeIN-KA-Bangalore16h ago
-
Senior-level Full TimeIN-KA-Bangalore16h ago
-
Senior-level Full TimeIN-KA-Bangalore16h ago
-
Senior-level Full TimeIN-TN-Chennai16h ago
-
Data Science and Tech Lead AMEA INR 2000K-3500KAWS | Agile | Amazon Bedrock | Amazon SageMaker | CI PipelinesSenior-level Full TimePune, ASIA, India17h ago
-
Mid-level Full TimeBangalore, Karnataka, India18h ago
-
Mid-level Full TimeBangalore, Karnataka, India18h ago
-
Mid-level Full TimeBangalore, Karnataka, India18h ago
-
Mid-level Full TimeBangalore, Karnataka, India18h ago
-
Assistant Manager- AI Engineer INR 1500K-2800KAmazon Web Services | Anthropic Claude | Autogen | Azure | Cloud platformMid-level Full TimeBangalore, Karnataka, India18h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2200KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India18h ago
-
Practice Customer Engineer, Gen AI, Telecom or FSI INR 1800K-3300KAI Agent Development Kit | API Gateway | Agent Development Kit | Agentic AI | Audit LoggingSenior-level Full TimeMumbai, Maharashtra, India18h ago
-
Senior Software Engineer, AI/ML, AI Garage INR 2500K-4800KApache Beam | BigQuery | Cause analysis | Data Processing | DataflowSenior-level Full TimeHyderabad, Telangana, India18h ago
-
Data Engineer, Play Data Science and Analytics INR 1500K-2500KAI | Automation | C plus plus | Data Infrastructure | Data ModelingMid-level Full TimeBengaluru, Karnataka, India18h ago
-
Data Engineer, YouTube INR 800K-1400KApache Flume | Apache Spark | Cloud Dataflow | Data Analysis | Data ArchitectureMid-level Full TimeBengaluru, Karnataka, India18h ago