Full-stack Data Engineer II
Tasks
- Build Delta Lake tables in DataBricks
- Build data pipelines with DataBricks Workflows and Delta Live Tables
- Deploy LLM based agents
- Develop Python backend services with FastAPI
- Develop agentic AI workflows
- Implement Retrieval-Augmented Generation (RAG)
- Monitor agent accuracy safety and performance
- Use Lakehouse architecture
- Use Unity Catalog for data governance
Perks/Benefits
Skills/Tech-stack
Autogen | Databricks | Databricks Mosaic | Databricks Mosaic AI | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Docker | FastAPI | LLM | Lakehouse | Langchain | MLflow | Mosaic AI | Pinecone | Prompt engineering | PySpark | Python | Retrieval-Augmented Generation | SQL | Unity Catalog | Vector Search | Weaviate
Education
N/A
Roles
Data Engineer | Engineer | Full Stack | Full Stack Data Engineer
Related jobs
-
Senior Applied ML Engineer (Speech & Audio) USD 140K-200KActivity Detection | Audio Processing | Audio codecs | Audio preprocessing | Automatic Speech RecognitionAccommodation allowance | Career growth | Coffee and other hot drinks | Company events and parties | Daily breakfastSenior-level Full TimeEgypt - Remote R20h ago
-
AI Engineer (Hybrid) USD 125K-175KAgent Orchestration | Agent systems | Autogen | CI/CD | ChromaDBHybrid workMid-level Full TimeGiza, El Omraniya, Egypt R2d ago
-
API Integration | Automation | CRM | Claude | DashboardsFlexible work schedule | Fully remoteMid-level Full TimeEgypt R6d ago
-
AI Agent Engineer & Team Lead INR 2000K-5000KAutogen | CI/CD | Computer Vision | CrewAI | DockerFlexible working hours | Fully remote | Work from anywhereSenior-level Full TimeCairo Governorate, Cairo, Egypt R7d ago
-
AI Engineer USD 102K-135KAPI Integration | Automation | Cloud Computing | Data Ingestion | Data PipelinesPay transparencyMid-level Full TimeCairo, Cairo Governorate, Egypt - Remote R13d ago
-
AWS | Apache Spark | Azure | Compliance | Data GovernanceRemote workSenior-level Full TimeEgypt - Remote R14d ago
-
Senior AI Backend Engineer - Remotely USD 140K-180KAWS | Amazon SQS | Asyncio | Authentication | CI/CDRemote workSenior-level Full TimeCairo, Egypt (Remote) R14d ago
-
Senior MLOps Engineer - Remote - Robusta USD 150K-200KAWS | Alerting | CI/CD | Cloud platform | Data PipelinesRemote workSenior-level Full TimeEgypt - Remote R16d ago
-
Data Engineer USD 115K-165KAWS Athena | AWS QuickSight | Amazon Web Services | Apache Airflow | Apache IcebergMid-level Full TimeCairo, Egypt, Egypt (Hybrid) R27d ago
-
AI Team Lead PHP 150K-250KAutonomous Agents | Azure | Azure Machine Learning | BERT | CI/CDPaid time off | Performance bonus | Training and developmentSenior-level Full TimeEgypt - Remote R1mo ago
-
Adversarial Testing | Bias and fairness | Edge case testing | Generative AI | JailbreakingCollaborative and inclusive team culture | Fully remote work | Professional growth and development opportunities | Work on cutting-edge AI technologiesSenior-level Full TimeCairo, Cairo Governorate, Egypt - Remote R1mo ago
-
Senior-level Full TimeRemote , Egypt R1mo ago
-
AI Team Lead USD 140K-242KAWS | Azure | Cloud deployment | Data Processing | Deep learningPaid time off | Training and developmentSenior-level Full TimeEgypt - Remote R1mo ago
-
.NET | Apex | C# | C++ | DartContinuous learning | Remote work | Technical writing experienceSenior-level Part TimeCairo, Egypt R1mo ago