Senior AI Data Engineer
INR 2800K-4200K (estimate) Senior-level Full Time
Tasks
- Architect end-to-end data solutions
- Build event driven streaming ingestion
- Conduct architecture and code reviews
- Define data engineering standards and patterns
- Define data quality framework and remediation SLAs
- Design production ELT ETL pipelines
- Design reusable lakehouse components
- Design semantic models and DAX patterns
- Drive data governance and lineage workflows
- Handle late arriving data
- Implement Delta Lake and SCD transformations
- Implement automated data quality validation
- Integrate data quality gates into CI CD deployments
- Lead Power BI governance and deployment pipelines
- Lead master data management initiatives
- Lead technical discovery for new data initiatives
- Maintain technology radar and run tool evaluations
- Mentor data engineering team
- Optimize Spark pipeline performance
- Partner on feature store and embedding pipelines
- Present architecture proposals and governance roadmaps
- Structure and version gold layer datasets for AI
Perks/Benefits
Skills/Tech-stack
Access Control | Audit Logging | Avro | Azure | Azure APIM | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | Broadcast joins | Business glossary | CI/CD | Column-Level Security | Copilot in Fabric | Copilot in Power BI | Cost Based Query Planning | DAX | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Management | Data Quality | Data Retention | Data Stewardship | Data Vault | Data Vault 2.0 | Data retention policies | Databricks | Dataflows Gen2 | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | Event Driven | Event-driven architecture | Feature Store | GDPR | GitHub Actions | Infrastructure as Code | JSON | Key Vault | LLM | Lakehouse | Liquid clustering | MDM | Master Data | Master Data Management | Medallion Architecture | Microsoft Data | Microsoft Data Factory | Microsoft Fabric | Parquet | Partitioning | Power BI | PySpark | Python | Query Optimization | Query Planning | RAG | REST APIs | RLS | Retention policies | Row Level Security | SCD Type 6 | SCD Type-2 | SQL | Semantic layer | Spark Query Optimization | Streaming Ingestion | Synapse Analytics | Terraform | Type 2) | Unity Catalog | Unity Catalog Access Control | Vector Databases | YAML | Z-ordering | “as-code”
Education
N/A
Roles
AI Data Engineer | Data Engineer | Engineer | Senior AI Data Engineer
Related jobs
-
SSE_Analytics Enablement INR 2250K-5000KAI/ML | Alteryx | Analytics engineering | Architecture Review | AutomationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India4h ago
-
SSE_Analytics Enablement INR 2250K-5000KAlteryx | Architecture Review | Artificial Intelligence | CI/CD | Code AutomationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India5h ago
-
Entry-level Full TimeBengaluru, India11h ago
-
GCP Data Engineer / Consultant Specialist INR 1500K-2000KAirflow | Alerting | Apache Beam | Automation | BigQueryFlexible working | Inclusive workplace | Opportunities for growth | Professional developmentMid-level Full TimePune, Maharashtra, India R11h ago
-
Senior AI Testing Engineer (Generative AI) INR 2000K-3300KAI Agents | API Testing | AWS | Azure | CI/CDSenior-level Full TimeBangalore North, India11h ago
-
Senior-level Full TimeIN-KA-Bangalore12h ago
-
Senior-level Full TimeIN-KA-Bangalore12h ago
-
Senior-level Full TimeIN-KA-Bangalore12h ago
-
Senior-level Full TimeIN-KA-Bangalore12h ago
-
Senior-level Full TimeIN-KA-Bangalore12h ago
-
Senior-level Full TimeIN-TN-Chennai12h ago
-
Data Science and Tech Lead AMEA INR 2000K-3500KAWS | Agile | Amazon Bedrock | Amazon SageMaker | CI PipelinesSenior-level Full TimePune, ASIA, India12h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
Assistant Manager- AI Engineer INR 1500K-2800KAmazon Web Services | Anthropic Claude | Autogen | Azure | Cloud platformMid-level Full TimeBangalore, Karnataka, India13h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2200KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India13h ago
-
Practice Customer Engineer, Gen AI, Telecom or FSI INR 1800K-3300KAI Agent Development Kit | API Gateway | Agent Development Kit | Agentic AI | Audit LoggingSenior-level Full TimeMumbai, Maharashtra, India13h ago
-
Senior Software Engineer, AI/ML, AI Garage INR 2500K-4800KApache Beam | BigQuery | Cause analysis | Data Processing | DataflowSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Data Engineer, Play Data Science and Analytics INR 1500K-2500KAI | Automation | C plus plus | Data Infrastructure | Data ModelingMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Data Engineer, YouTube INR 800K-1400KApache Flume | Apache Spark | Cloud Dataflow | Data Analysis | Data ArchitectureMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Practice Customer Engineer, GenAI, Public Sector, Google Cloud INR 2000K-3300KAPIs | Agentic AI | Audit Logging | Cloud Networking | Cloud infrastructureSenior-level Full TimeGurgaon, Haryana, India; Bengaluru, Karnataka, India13h ago
-
Practice Customer Engineer, GenAI, Manufacturing, Google Cloud INR 2000K-3300KAI Agents | Audit Logging | Cloud Architecture | Cloud Computing | Distributed tracingConference participation | Professional development | Technical stakeholder exposure | Travel opportunitiesSenior-level Full TimeMumbai, Maharashtra, India13h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1800K-3000KAPI Integration | Agent systems | Cloud platform | CrewAI | Data PipelinesMid-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India13h ago