Senior AI Data Engineer
INR 2800K-4200K (estimate) Senior-level Full Time
Tasks
- Architect end-to-end data solutions
- Build event driven streaming ingestion
- Conduct architecture and code reviews
- Define data engineering standards and patterns
- Define data quality framework and remediation SLAs
- Design production ELT ETL pipelines
- Design reusable lakehouse components
- Design semantic models and DAX patterns
- Drive data governance and lineage workflows
- Handle late arriving data
- Implement Delta Lake and SCD transformations
- Implement automated data quality validation
- Integrate data quality gates into CI CD deployments
- Lead Power BI governance and deployment pipelines
- Lead master data management initiatives
- Lead technical discovery for new data initiatives
- Maintain technology radar and run tool evaluations
- Mentor data engineering team
- Optimize Spark pipeline performance
- Partner on feature store and embedding pipelines
- Present architecture proposals and governance roadmaps
- Structure and version gold layer datasets for AI
Perks/Benefits
Skills/Tech-stack
Access Control | Audit Logging | Avro | Azure | Azure APIM | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | Broadcast joins | Business glossary | CI/CD | Column-Level Security | Copilot in Fabric | Copilot in Power BI | Cost Based Query Planning | DAX | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Management | Data Quality | Data Retention | Data Stewardship | Data Vault | Data Vault 2.0 | Data retention policies | Databricks | Dataflows Gen2 | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | Event Driven | Event-driven architecture | Feature Store | GDPR | GitHub Actions | Infrastructure as Code | JSON | Key Vault | LLM | Lakehouse | Liquid clustering | MDM | Master Data | Master Data Management | Medallion Architecture | Microsoft Data | Microsoft Data Factory | Microsoft Fabric | Parquet | Partitioning | Power BI | PySpark | Python | Query Optimization | Query Planning | RAG | REST APIs | RLS | Retention policies | Row Level Security | SCD Type 6 | SCD Type-2 | SQL | Semantic layer | Spark Query Optimization | Streaming Ingestion | Synapse Analytics | Terraform | Type 2) | Unity Catalog | Unity Catalog Access Control | Vector Databases | YAML | Z-ordering | “as-code”
Education
N/A
Roles
AI Data Engineer | Data Engineer | Engineer | Senior AI Data Engineer
Related jobs
-
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720KAWS | Agile | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeHyderabad, Telangana, India6h ago
-
Senior-level Full TimeMumbai, India7h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R8h ago
-
Applied AI ML Associate Senior INR 1200K-2500KAI Agents | AWS Lambda | AWS Step Functions | Agentic AI | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India8h ago
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN8h ago
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R9h ago
-
Senior-level Full TimeBengaluru, Karnataka, India9h ago
-
Dir, Machine Learning Engrg Mgmt INR 3242K-4200KAlgorithms | Code optimization | Design Patterns | Java | Machine LearningFlexible work options | In-office work options | Remote work optionsSenior-level Full TimeHyderabad, India9h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India10h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R10h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN15h ago
-
Senior-level Full TimeBangalore, KA, IN15h ago
-
Senior Data Engineer INR 3200K-4200KAWS | Airflow | Apache Spark | CI/CD | Cloud ComputingCompany-matched student loan contribution | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India15h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R15h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R15h ago
-
Software Development Senior Analyst INR 2000K-4500KAPI Gateway | AWS CloudFormation | AWS Lambda | Agile | Amazon BedrockSenior-level Full TimeChennai, TN, IN15h ago
-
Senior Data Scientist / AI Engineer INR 3700K-5000KAdapters | Agentic AI | BERT | CI/CD | Command LineSenior-level Full TimeBangalore,IND, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India15h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS Database | AWS Database Migration Service | AWS Glue | AWS Lambda | AWS Step FunctionsFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3500KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Apache Airflow | Azure DevOpsSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-2500KAWS | AWS Database | AWS Database Migration Service | AWS Glue | AWS LambdaSenior-level Full TimeBengaluru Millenia, India15h ago