AI Evaluation Engineer (Data Analysis & Multi-Agent Systems)
Colombia - Remote
R
A COP 48000K-64000K (estimate) Mid-level Contract Full Time
Tasks
- Build reproducible evaluation environments with Docker
- Conduct statistical analysis and interpretation
- Create realistic datasets
- Define task decomposition strategies across sub agents
- Design multi agent benchmark tasks
- Detect anomalies and contradictions
- Implement evaluation pipelines
- Perform cross referencing across data sources
- Refine benchmark scoring accuracy
- Validate analytical outputs with verification logic
Perks/Benefits
Skills/Tech-stack
Anomaly Detection | Data Analysis | Data Pipelines | Data Quality | Data Quality Validation | Docker | ETL | Machine Learning | NumPy | Pandas | Python | Quality validation | SQL | Statistics
Education
N/A
Roles
AI | AI Evaluation Engineer | Analyst | Data Analyst | Engineer | Evaluation Engineer
Regions
Countries
States
Related jobs
-
AWS CDK | AWS Glue | AWS Step Functions | Amazon ECS | Amazon Kinesis100 percent remote work | Paid time off | Work with autonomy | Work with top American companiesSenior-level Full TimeBogota R20h ago
-
AWS | Airflow | DBT | DevOps | GCPCasual dress code | Financial literacy training | Health insurance | RRSP matching | Team socialsMid-level Full TimeColombia - Remote R1d ago
-
AutoGPT | Chain-of-Thought | Data Privacy | Embedding Models | Few-Shot LearningPaid time off | Remote work | Work autonomy | Work-life balanceSenior-level Full TimeBogota R3d ago
-
Data Engineer ODI COP 54000K-72000KData Integrator | Data Warehouse | Dimensional Modeling | ELT | ETLEmployee fund | Paid time off | Prepaid health insurance | Remote work | Training platformsMid-level Full TimeBogota, Colombia R3d ago
-
Amazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | Data IngestionExposure to modern AI driven data systems | Fully remote | Global flexibility | International diverse team | Ownership of end to end challengesSenior-level Full TimeColombia R4d ago
-
Artificial Intelligence | Generative AI | Looker Studio | Power BI | PythonContinuous learning opportunities | Flexible work options | Health, wellness, and retirement plansSenior-level Full TimeCOL-Iron Mountain Colombia S.A.S Bogota R4d ago
-
Senior Data Engineer (Credit) COP 27600K-240000KAnalytics engineering | Automation | DBT | Data Architecture | Data IntegrityAnnual performance bonus | Dental insurance | Health insurance | Remote work | Stock optionsSenior-level Full TimeColombia R4d ago
-
APIs | Claude API | HubSpot | JavaScript | LLMCareer growth | Continuous learning | Fully remoteEntry-level Full TimeColombia R5d ago
-
API | AWS S3 | Apache Spark | Data Lake | Data WarehousingFlexible working | Paid volunteer time off | Parental leave | Wellness daysSenior-level Full TimeColombia - Remote R5d ago
-
AWS | AWS Polly | Azure | Data Visualization | EmbeddingsFlexible days off | Health plan | Home office bonus | Language courses | Professional growth coursesMid-level Full TimeColombia R6d ago
-
Google Analytics | Google Analytics 4 | Google Tag | Google Tag Manager | JavaScriptPaid public holidays | Paid time off | Remote work from anywhereMid-level Full TimeBogotá, Bogota, Colombia R6d ago
-
AI Engineer II - Marketing USD 39K-72KAWS | BERT | CI/CD | Docker | EmbeddingsFull-time employment | Remote workMid-level Full TimeBogota, Colombia R6d ago
-
AI Engineering I - Marketing USD 30K-39KAWS | Agentic Systems | Attention Mechanisms | CI/CD | Distributed SystemsEntry-level Full TimeBogota, Colombia R6d ago
-
Sr. AI Engineer - Marketing USD 50K-120KAWS | AWS CloudWatch | Amazon SageMaker | Apache Spark | CI/CDFull-time employment | Remote workSenior-level Full TimeBogota, Colombia R7d ago
-
Bilingual DataOps Engineer COP 54000K-72000KAKS | Apache Cassandra | Apache Kafka | Azure Data | Azure Data FactoryMid-level Full TimeBogota, CO R7d ago
-
Senior-level Full TimeBogota, Colombia (Remote Friendly) R10d ago
-
Adobe Analytics | BigQuery | Dashboarding | Data Modeling | Data QualityCareer advancement | Hybrid work options | Professional development programs | Remote work options | Training and learning accessSenior-level Full TimeColombia - Remote R10d ago
-
Amazon Web Services | CI/CD | Data Pipelines | Distributed Systems | GitAWS certification sponsorship | Continuous learning support | Fully remote | Medical insurance budget | Paid public holidaysSenior-level Full TimeMedellín, Antioquia R11d ago
-
AWS Lambda | AWS SageMaker | Amazon ECR | Amazon EMR | Amazon S3AWS certification sponsorship | Continuous learning support | Fully remote | Medical insurance coverage | Paid public holidaysSenior-level Full TimeMedellín, Antioquia R11d ago
-
AI Agents | API Integration | Anthropic Claude | Automation workflows | ChatGPTFully remote | MentorshipEntry-level Full TimeBogota, D.C., Colombia R11d ago
-
AI Data Engineer COP 42000K-42000KAWS | CI/CD | Data Modeling | Data Quality | Data quality monitoringEAP benefits | Employee assistance program | Employee growth and leadership opportunities | Full remote work | Hybrid workMid-level Full TimeRemote - Colombia R12d ago
-
ML/AI Engineer / Data Scientist COP 48000K-72000KAPI Development | BERTopic | CatBoost | Distributed Systems | Feature EngineeringCertifications | Corporate English classes | Courses | Flexible working hours | Hybrid workMid-level Full TimeBogotá, Bogota, Colombia R12d ago
-
Senior-level Full TimeColombia R12d ago
-
Business Analyst (Data) COP 54000K-64000KAWS | Apache Ranger | Apache Spark | Cloud platform | Data GovernanceFlexible schedule | Multicultural community | Remote workMid-level Full TimeLatin America#LATAM, Remote, Colombia (Hybrid) R14d ago
-
Cloud Data | Cloud data lakehouse | Data Engineering | Data Lakehouse | Data ModelingSenior-level Contract Full TimeColombia - Remote R14d ago