Senior AI Data Engineer
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Architect end-to-end data solutions
- Build ELT/ETL pipelines
- Conduct architecture and code reviews
- Define data quality framework
- Design data vault patterns
- Design embedding pipelines
- Design lakehouse structures
- Design semantic models and DAX patterns
- Enable RAG ready vector data products
- Implement advanced transformation patterns
- Integrate DQ gates into CI CD
- Lead data governance and policy management
- Lead master data management initiatives
- Maintain technology radar
- Manage Power BI deployment pipelines
- Mentor data engineering team
- Optimize Spark pipeline performance
- Partner with AI ML engineers for feature stores
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics | Bicep | Broadcast joins | CI/CD | Collibra | Collibra Data Governance | Collibra Data Quality | Column-Level Security | Cost Based Query Planning | DAX | Data Factory | Data Governance | Data Management | Data Quality | Data Vault | Data Vault 2.0 | Databricks | Dataflows Gen2 | Delta Lake | Delta Live Tables | Delta Live) | Feature Store | GDPR | GitHub Actions | Infrastructure as Code | LLM | Lakehouse | Liquid clustering | Master Data | Master Data Management | Medallion Architecture | Microsoft Fabric | PII data | Partitioning Strategy | Power BI | PySpark | Python | Query Planning | RAG | Row Level Security | SCD Type 1 | SCD Type-2 | SQL | Spark | Streaming Ingestion | Synapse Analytics | Terraform | Type 1 | Type 2) | Unity Catalog | Unity Catalog Access Control | Vector embeddings | Z-Order | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Mid-level Full TimePune, India3h ago
-
Mid-level Full TimeKarnataka, Bengaluru, India5h ago
-
Expert Data Engineer (Databricks) INR 1500K-2400KAPI Design | API Key | AWS Glue | AWS IAM | AWS LambdaSenior-level Full TimeMaharashtra, Pune, India5h ago
-
Senior Data Engineer (Databricks) INR 2000K-2800KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Senior-level Full TimeMaharashtra, Pune, India5h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Local connection | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeMumbai, India6h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureGrowth education budget | Local compliance in India | Remote work | Team meet-ups | Wellness budgetSenior-level Full TimeBangalore North, India6h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Spark | CI/CD | Change Data CaptureBudgets for personal growth education and wellness | Legal presence in India | Local connection | Periodic meet ups | Remote workSenior-level Full TimePune City, India6h ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileHybrid work modelSenior-level ContractShaikpet, India6h ago
-
MLOps Engineer INR 1200K-1680KAWS | AWS Lambda | Amazon Bedrock | Amazon S3 | Amazon SQSEmployee Share Savings Plan | Hybrid work | Learning programs | Mentoring | Paid volunteer dayMid-level Full TimeBengaluru7h ago
-
Data Engineer INR 1500K-2500KAWS Glue | AWS Step Functions | Amazon Athena | Amazon Kinesis | Amazon Web ServicesSenior-level Full TimeIN-MH-Pune7h ago
-
Software Engineer - ML Ops DevOps INR 2500K-3465KAWS | Argo CD | Azure | CI/CD | Data PipelinesCollaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …7h ago
-
Associate Engineer - Embedded AI & Data Analytics INR 1000K-1141KC plus plus | Classification | Data Modeling | Data Observability | Data PipelinesCollaborative work environment | On-site work schedule | Professional development opportunities | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …7h ago
-
Advanced Engineer - Embedded C++ Linux INR 1236K-1854KASPICE | CI/CD | Cloud Computing | Communications | Configuration ManagementEmployee discounts | Employee recognition rewards | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …7h ago
-
Testing Senior Associate - Power BI/Power Automate Tester INR 1000K-2000KAgile | Case design | Dashboard Verification | Data Reconciliation | Data ValidationFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Personal/family careMid-level Full TimeHyderabad, India R8h ago
-
AI/ML Expert INR 2500K-4500KASR | Agent systems | Conversational AI | Data Analysis | Edge ComputingSenior-level Full Timepune, India10h ago
-
GCP Data Engineer/Consultant Specialist INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud SDK | Cloud SQLFlexible working | Inclusive and diverse environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R10h ago
-
Senior Data Engineer - Big Data & Automation INR 1500K-2500KAgile | Ansible | Apache Hive | Apache Spark | ArgoCDFlexible work policy | Work from homeSenior-level Full TimeIndia10h ago
-
AI Senior Software Engineer INR 1800K-3300KAgent collaboration | Agents SDK | Autogen | CI/CD | EmbeddingsInclusive work environmentSenior-level Full TimeNoida, Uttar Pradesh, India10h ago
-
Lead Database Engineer INR 1800K-3000KASH | AWR | AWS CloudWatch | AWS RDS | Access GovernanceHealth and life insurance | Hybrid schedule | Paid time off | Pension and retirement benefits | Professional development supportSenior-level Full TimeHyderabad, India R10h ago
-
Senior Data Engineer - ETL Framework INR 1500K-2500KApache Doris | Apache Hive | Apache Iceberg | Apache Spark | Apache TezFlexible work policy | Work from homeSenior-level Full TimeIndia10h ago
-
Specialist - Data Engineering-Google BigQuery INR 302K-562KData Modeling | Data Pipelines | Data Warehousing | ETL | Google BigQueryEntry-level Full TimeMumbai, Maharashtra, India10h ago
-
Data Engineer INR 1000K-1200KAzure | Azure Data | Azure Data Factory | Data Bricks | Data FactoryEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India10h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India11h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India11h ago
-
AI Engineer - SAP S/4HANA INR 2000K-4500KA2A protocol | AI Core | AI-Hub | Agent systems | Agent to AgentSenior-level Full TimeBangalore, Karnataka, IN11h ago