AI Data Foundation Engineer
Tasks
- Build ingestion transformation storage pipelines
- Create data contracts and schemas
- Design pipeline and schema
- Execute AI assisted development workflows
- Gather data requirements
- Implement agentic workflows
- Implement data quality frameworks
- Integrate source systems with knowledge graphs and inference engines
- Maintain knowledge graphs and ontologies
- Orchestrate data pipelines
- Set up data validation versioning observability
- Standardize data engineering SDLC
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Beam | Apache Kafka | Apache Spark | CI/CD | Chunking | Cloud Composer | Cloud Dataflow | Cloud PubSub | Cloud Storage | Cypher | Dagster | Data Catalog | Data Contracts | Data Modeling | Data Observability | Data Validation | Data Versioning | Data Warehousing | Dimensional Modeling | Embeddings | GCP | Google BigQuery | Google Cloud | Google Cloud Composer | Google Cloud Dataflow | Google Cloud PubSub | Google Cloud Storage | Graph Databases | Graph Query | Graph Query Language | Gremlin | Knowledge graph | LLM | LLM-based tools | Metadata Management | Ontology | Python | Query Language | RAG | Relational databases | Retrieval-Augmented Generation | SQL | Vector Databases
Education
Related jobs
-
Vice President - AI/ML Technical Developer INR 4000K-5199KAgentic Frameworks | Alerting | Automated testing | Cause analysis | Code reviewExecutive-level Full TimeBengaluru, Karnataka, India7h ago
-
Data Engineer (Python ETL) INR 800K-2000KETL | Oracle Database | PL/SQL | Performance Tuning | PythonMid-level Full TimeIN-MH-Pune7h ago
-
Mid-level Full TimeIN-MH-Pune7h ago
-
API Design | AWS | Apache Spark | Azure | Big DataSenior-level Full TimeBangalore - Karnataka - India Pune …7h ago
-
Senior Analytics Engineer INR 3000K-4000KAWS | Cloud platform | Confluent Cloud | DBT | Data IngestionAgile team collaboration | Knowledge sharing culture | Mentorship opportunitiesSenior-level Full TimeBangalore - Karnataka - India Pune …7h ago
-
Lead - AI/ML Engineer (Generative AI Agent Systems) INR 3700K-5000KAI Agent Development Kit | AI tuning | Agent Development Kit | Agent Engine | Agentic WorkflowsSenior-level Contract Full TimePune, MH, India7h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2000KAWS Glue | AWS Lambda | AWS S3 | Access policies | AirflowCorporate social responsibility programs | Discounts on products and services | Maternity leave | Networking opportunities | Paternity leaveMid-level Full TimeBangalore, Karnataka, India8h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API first | API-first design | Access Control | Agent OrchestrationSenior-level Full TimeRemote, India R8h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API Design | Access Control | Artificial Intelligence | Batch inferenceSenior-level Full TimeRemote, India R8h ago
-
Data Scientist - Senior INR 3600K-5000KAgile | Anomaly Detection | CI/CD | Classification | Computer VisionSenior-level Full TimePune, Maharashtra, India8h ago
-
Applied AI/ML Engineer INR 1800K-3000KAgent workflows | Agentic Systems | Auditability | Drift Detection | Error HandlingMid-level Full TimeBengaluru, Karnataka, India8h ago
-
AI Observability | Agent systems | Artificial Intelligence | Context engineering | Data SovereigntySenior-level Full TimeMumbai, Maharashtra, India8h ago
-
ML Compiler Engineer, TPU Performance Optimizations INR 2500K-5000KC++ | CUDA | Compiler optimization | Computer Architecture | DebuggingSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior-level Full TimeIndia9h ago
-
Data Engineer –GCP BigQuery INR 3000K-4000KAdobe Experience | Adobe Experience Platform | BigQuery | Cloud Data | Cloud Data ArchitectureSenior-level Full TimeIndia9h ago
-
AI Enginner Intern INR 200K-300KAI orchestration | Azure | Backend Development | Data Preprocessing | Data QualityHands-on learning | Mentorship | On site work experienceEntry-level Full Time InternshipBangalore, Karnataka, India10h ago
-
Associate Director (AI Hub - GDC) INR 1500K-3300KAWS | Apache Kafka | CI/CD | Cassandra | Cloud platformMid-level Full TimeHyderabad, Telangana, India10h ago
-
Sr IT Analyst INR 1500K-2500KETL | Informatica IDMC | Informatica PowerCenter | Linux | Python24 7 shift model | On-call supportSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India11h ago
-
Senior-level Full Timebengaluru, India11h ago
-
Senior-level Full Timebengaluru, India11h ago
-
Senior-level Full Timebengaluru, India11h ago
-
Sr.Data Engineering INR 2000K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full Timebengaluru, India11h ago
-
Sr.Data Engineering INR 2000K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full Timebengaluru, India11h ago
-
Mid-level Full Timebengaluru, India11h ago