Senior Data Engineer (Python)

Tasks

• Build ETL pipelines
• Compute embeddings and retrieval pipelines
• Design analytics and AI agent schemas
• Design data ingestion pipelines
• Develop Python data services
• Implement data transformation layers
• Ingest structured data from APIs
• Ingest unstructured data from documents
• Orchestrate pipelines with Kubernetes
• Prepare data for RAG systems

Perks/Benefits

• Employment Visa
• Flexible working environment
• Hybrid work
• Medical insurance

Skills/Tech-stack

APIs | Apache Airflow | Azure | Azure Data | Azure Data Factory | Chunking | Data Factory | Data Warehousing | Databricks | ELT | ETL | Embeddings | Kafka | Kubernetes | LLM Evaluation | Oracle | Prompt engineering | Python | RAG | Retrieval-Augmented Generation | Snowflake | Vector Databases | Workflow Orchestration