Senior AI Data Engineer
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Architect end-to-end data solutions
- Build parameterized pipeline frameworks
- Conduct architecture and code reviews
- Define AI product data quality framework
- Define DAX patterns and measure libraries
- Define data engineering standards
- Design and deliver production ELT ETL pipelines
- Design data vault patterns
- Design lakehouse structures
- Design reusable data components
- Design semantic models in Power BI
- Design vector ready data products for RAG
- Handle late arriving data
- Implement SCD Type 2
- Implement advanced transformation patterns
- Implement automated data quality validation
- Implement event driven streaming ingestion
- Integrate data quality gates into CI CD
- Lead Power BI governance model
- Lead data quality incident triage and root cause analysis
- Lead master data management initiatives
- Lead technical discovery for data initiatives
- Mentor data engineering team
- Optimize Spark pipeline performance
- Partner on feature store and embedding pipelines
Perks/Benefits
Skills/Tech-stack
Avro | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Synapse | Azure Synapse Analytics | Business glossary | CI/CD | Collibra | Column-Level Security | DAX | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Management | Data Quality | Data Vault | Data Vault 2.0 | Databricks | Delta | Delta Lake | Delta Live Tables | Delta Live) | Entity Relationship Modeling | Entity relationship | Event Driven | Event-driven architecture | GitHub Actions | JSON | Master Data | Master Data Management | Medallion Architecture | Microsoft Fabric | Parquet | Power BI | PySpark | Python | REST APIs | Relationship Modeling | Row Level Security | SCD Type 1 | SCD Type-2 | SQL | Semantic layer | Snowflake Schema | Star Schema | Streaming Ingestion | Synapse Analytics | Terraform | Type 1 | Type 2) | Unity Catalog | Vector Databases | YAML
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Mid-level Full TimeHyderabad, India4h ago
-
Data Scientist (GenAI/Core DS) INR 2000K-3000KAWS | Data Analysis | Data Modeling | Data Visualization | LangchainSenior-level Full TimeGurugram, Haryana, India5h ago
-
Senior-level Full TimeIN-AP-Hyderabad5h ago
-
Senior-level Full TimeIN-AP-Hyderabad5h ago
-
Tech Lead INR 1500K-2400KAmazon Web Services | Data Governance | Data Modeling | Data Quality | DataOpsSenior-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-AP-Hyderabad5h ago
-
APIs | AWS Kinesis | ClickHouse | DBT | Data GovernanceCareer growth | Flexible collaboration | Inclusive culture | Innovation focus | Remote-friendly work setupSenior-level Full TimeIndia5h ago
-
Senior-level Full Timebangalore, India5h ago
-
Full Stack Engineer – MERN Stack INR 1300K-2500KAPIs | AWS | Azure | Bootstrap | CI/CDCollaborative culture | Growth opportunities | MentorshipMid-level Full TimeMaharashtra, Pune, India5h ago
-
Python AI Engineer INR 1800K-3500KAPI Development | AWS | AWS Lambda | Amazon Bedrock | Amazon SageMakerHybrid workSenior-level Full TimeIndia6h ago
-
Gen AI Engineer INR 2500K-4500KAWS Extract | Document processing | Langchain | Language Models | Large Language ModelsSenior-level Full TimeHyderabad, Telangana, India6h ago
-
Apache Kafka | Codebeamer | Data Validation | Event Driven | Event-driven architectureSenior-level Full Timebangalore, India6h ago
-
Mid-level Full Timebangalore, India6h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2040KApache Kafka | Data Warehousing | Dimensional Modeling | Flink | GitSenior-level Full Timebangalore, India6h ago
-
Software Engineer (SDE 2) - Full Stack (Frontend), Lakeflow INR 1800K-3000KAPI Integration | AWS | Accessibility | Azure | CSSMid-level Full TimeBengaluru, India7h ago
-
.NET | API Integration | Agents | Automation Anywhere | Azure FunctionsEntry-level Full TimeNashik, MH, India7h ago
-
Software Engineer III - Python, AI ML INR 2000K-3500KAgentic Frameworks | Amazon Web Services | Apache Airflow | Azure | Cloud NativeSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
TRQ27-0135-01-OR Consultant - Data & AI Practice INR 400K-600KCBC | CPLEX | Cloud Computing | Constraint Programming | Error HandlingEntry-level Full TimeIndia8h ago
-
Sr. AI Engineer, Backend (Altium) INR 2000K-4500KAPI Development | Agentic Systems | Algorithms | CI/CD | Data StructuresEmployee resource groups | Remote work optionSenior-level Full TimeBangalore, India8h ago
-
Software Engineering INR 1400K-1820KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure EventMid-level Full TimeHyderabad, TS, IN9h ago
-
Senior Data Scientist INR 2000K-3300KA/B | A/B Testing | Algorithm Design | Apache Airflow | Apache SparkSenior-level Full TimeBengaluru East, Karnataka, India9h ago
-
Senior Applied Scientist INR 2000K-3000KAudio Processing | C++ | Data Analysis | Data Processing | Deep learningInclusive culture | Mentoring | On-site collaborationSenior-level Full TimeHyderabad, TS, IN10h ago
-
AWS | AWS CloudWatch | Alerting | Backups | BashSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 2000K-3630KAWS | Apache Spark | Azure | C++ | Convolutional Neural NetworksSenior-level Full Timebengaluru, India10h ago
-
Senior-level Full TimePune, Maharashtra, India10h ago