Senior AI Data Engineer
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Architect end-to-end data solutions
- Build ELT/ETL pipelines
- Conduct architecture and code reviews
- Define data quality framework
- Design data vault patterns
- Design embedding pipelines
- Design lakehouse structures
- Design semantic models and DAX patterns
- Enable RAG ready vector data products
- Implement advanced transformation patterns
- Integrate DQ gates into CI CD
- Lead data governance and policy management
- Lead master data management initiatives
- Maintain technology radar
- Manage Power BI deployment pipelines
- Mentor data engineering team
- Optimize Spark pipeline performance
- Partner with AI ML engineers for feature stores
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics | Bicep | Broadcast joins | CI/CD | Collibra | Collibra Data Governance | Collibra Data Quality | Column-Level Security | Cost Based Query Planning | DAX | Data Factory | Data Governance | Data Management | Data Quality | Data Vault | Data Vault 2.0 | Databricks | Dataflows Gen2 | Delta Lake | Delta Live Tables | Delta Live) | Feature Store | GDPR | GitHub Actions | Infrastructure as Code | LLM | Lakehouse | Liquid clustering | Master Data | Master Data Management | Medallion Architecture | Microsoft Fabric | PII data | Partitioning Strategy | Power BI | PySpark | Python | Query Planning | RAG | Row Level Security | SCD Type 1 | SCD Type-2 | SQL | Spark | Streaming Ingestion | Synapse Analytics | Terraform | Type 1 | Type 2) | Unity Catalog | Unity Catalog Access Control | Vector embeddings | Z-Order | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Fullstack Data Engineer (Remote) INR 800K-2000KAPI Keys | AWS IAM | AWS S3 | AWS VPC | Apache SparkRemote work | UK shift scheduleSenior-level Full TimeMaharashtra, Pune, India R2h ago
-
Principal Consultant - GenAI Engineer INR 3000K-4144KAWS | Agentic AI | Azure | Azure OpenAI | Cloud ComputingSenior-level Full TimeIndia-Pune3h ago
-
Principal Consultant - GenAI Engineer INR 3000K-4725KAWS | Agentic AI | Azure OpenAI | Cloud platform | Deep learningSenior-level Full TimeIndia-Kolkata3h ago
-
Senior DevOps Engineer (AWS | MLOps | Kubernetes) INR 2500K-4000KAWS IAM | Amazon EKS | Amazon S3 | Amazon Web Services | Argo CDHybrid workSenior-level Full TimeMaharashtra, Pune, India3h ago
-
GenAI Azure INR 1800K-2500K.NET | API Management | ASP.Net Core | Access Control | Active DirectoryMid-level Full TimeIN-AP-Hyderabad4h ago
-
Senior-level Full TimeHyderabad, India5h ago
-
Staff Software Engineer, Cloud SQL Postgres INR 1500K-2400KC++ | Database Administration | PostgreSQL | Query Optimization | Relational databasesSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Actuarial - Data Science INR 1500K-3000KClassification | Data Preprocessing | Data Quality | Explainable AI | Feature EngineeringMid-level Full TimeBangalore, KA, India5h ago
-
Data Engineer II - Python, AWS & Pyspark INR 1500K-2200KAWS | Data Migration | Data Modeling | Data Warehouse | Data pipelineMid-level Full TimeHyderabad, Telangana, India7h ago
-
AWS | Alerting | Audit Logging | Azure | CI/CDSenior-level Full TimePune, MH, India7h ago
-
Consultant - Gen AI Engineer INR 550K-610KAPI Integration | Generative AI | Language Processing | Machine Learning | Natural LanguageEntry-level Full TimeBangalore, Karnataka, India8h ago
-
Apache Iceberg | Apache Spark | Avro | CI/CD | Cause analysisEntry-level Full TimeHyderabad, Telangana, India9h ago
-
Engineering-L2-Bengaluru-Vice President-Software Engineering INR 1500K-6000KApache Iceberg | Apache Spark | Avro | CI/CD | DatabricksExecutive-level Full TimeBengaluru, Karnataka, India9h ago
-
Software Engineer III - Data Engineer, AWS, ETL, Python INR 2000K-3500KAWS | CI/CD | Data Governance | Data Lake | Data ProcessingSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Gen AI Lead engineer INR 3000K-4800KAgentic Frameworks | CI/CD | Data Visualization | Git | LangchainSenior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Engineering-L2-Bengaluru-Associate-Software Engineering INR 1800K-3200KANSI SQL | Apache Iceberg | Apache Spark | Avro | CI/CDSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Full Stack Developer :: Acon INR 2500K-3500KAI Search | AI Studio | Application Security | Arize Phoenix | Azure AISenior-level Full TimeIndia10h ago
-
Lead Assistant Manager INR 2500K-4500KASR | AWS EC2 | Amazon ECS | Amazon SageMaker | Amazon Web ServicesSenior-level Full TimeNoida, Uttar Pradesh, India10h ago
-
Data Engineer INR 2755K-3500KAPI Development | AWS | Amazon Redshift | Azure | BashHybrid working | Inclusive culture | Learning and development programmesSenior-level Full TimeHyderabad, India10h ago
-
Director of Software Engineering - Big Data, Cloud INR 2000K-6000KAI machine learning | AWS | Agile | Azure | Big DataExecutive-level Full TimeMumbai, Maharashtra, India10h ago
-
Assistant Manager-GDC INR 1500K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India11h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 2000K-3500K.NET | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSSenior-level Full TimePune, Maharashtra, India12h ago
-
Software Engineer III - Databricks, SQL , Python INR 2000K-2800KApache Spark | Cloud technologies | Data Lake | Data Warehouse | DatabricksSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior-level Full TimeBangalore, Karnataka, India13h ago
-
Senior-level Full TimeBangalore, India15h ago