AI Evaluation Engineer (Data Analysis & Multi-Agent Systems)
Colombia - Remote
R
A COP 48000K-64000K (estimate) Mid-level Contract Full Time
Tasks
- Analyze task performance and refine scoring
- Build reproducible environments with Docker
- Create realistic datasets
- Decompose tasks across specialized sub agents
- Design multi agent benchmark tasks
- Develop verification logic for analytical outputs
- Implement evaluation pipelines
Perks/Benefits
Skills/Tech-stack
Anomaly Detection | CSV | Data Pipelines | Data Quality | Docker | ETL | JSON | Logs | NumPy | Pandas | Python | SQL | Statistical Analysis
Education
N/A
Roles
AI | AI Evaluation Engineer | Data Scientist | Engineer | Evaluation Engineer | Scientist
Regions
Countries
States
Related jobs
-
AWS | AWS Guardrails | Agentic Orchestration | Amazon Bedrock | Contextual MemorySenior-level Full TimeBogota, Colombia (Remote Friendly) R19h ago
-
API ingestion | Airbyte | BigQuery | CRM | Cloud StoragePaid time off | Remote work | Work autonomy | Work with top American companiesSenior-level Full TimeBogota R1d ago
-
API Development | AWS | Artificial Intelligence | Caching | Data PipelinesAWS Partnership training | Advanced engineering resources | Early access to cloud capabilitiesSenior-level Full TimeBogota, Colombia (Remote Friendly) R2d ago
-
API | AWS | Backend Development | Cloud platform | DockerFlexible work environment | Indefinite contract | Mental health days | Paid time off | Remote-firstMid-level Full TimeBogota, Colombia - Remote R3d ago
-
Senior-level Full TimeRemote, Colombia R3d ago
-
Senior-level Full TimeBogota, CO R4d ago
-
AWS | CI/CD | Databricks | Git | JSONOn-call support rotation | Remote workSenior-level Contract Full TimeColombia - Remote R4d ago
-
Data Lakehouse | Data Modeling | Data Transformation | Databricks | LookerLATAM eligibility for Colombia or Argentina residents | Remote workSenior-level Contract Full TimeColombia - Remote R4d ago
-
A/B | A/B Testing | AI Safety | AI guardrails | AWSBilingual collaboration | Hybrid workSenior-level Full TimeMedellin, Colombia R6d ago
-
AWS | AWS Glue | Apache Spark | Azure | Azure DataMid-level Full TimeMedellín, Antioquia, Colombia R7d ago
-
API | AWS | Apache Spark | Applied Mathematics | AzureOngoing learning | Remote workSenior-level Full TimeMedellín, Antioquia, Colombia R7d ago
-
API Integration | AWS | Cloud platform | Cost Optimization | DockerAnnual retreats | Indefinite contract | Mental health days | PTO | Remote-firstMid-level Full TimeBogota, Colombia - Remote R7d ago
-
Data Engineer, Azure - Remote, Latin America COP 54000K-74400KAgile | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse AnalyticsCompany-sponsored certifications | Conferences | Continuing education | Flexible working hours | Paid time offMid-level Full TimePalmira, Valle del Cauca, Colombia R7d ago
-
Data Engineer, Azure - Remote, Latin America COP 54000K-74400KAgile | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse AnalyticsCompany-sponsored certifications | Conference attendance | Continuing education | Flexible working hours | Paid time offMid-level Full TimeMedellin, Antioquia, Colombia R7d ago
-
Data Engineer, Azure - Remote, Latin America COP 54000K-74400KAgile | Azure Data | Azure Data Lake | Azure DevOps | Azure Key VaultCompany sponsored exams | Company-sponsored certifications | Company-sponsored coursework | Conferences | Continuing educationMid-level Full TimeColombia R7d ago
-
Data Engineer, Azure - Remote, Latin America COP 54000K-74400KAgile | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse AnalyticsCompany-sponsored coursework | Conferences | Continuing education | Flexible working hours | Paid time offMid-level Full TimeCartagena, Bolivar, Colombia R7d ago
-
Data Engineer, Azure - Remote, Latin America COP 54000K-74400KAgile | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse AnalyticsCompany-sponsored coursework | Conferences | Continuing education | Flexible working hours | Paid time offMid-level Full TimeCali, Valle del Cauca, Colombia R7d ago
-
Data Engineer, Azure - Remote, Latin America COP 54000K-74400KAzure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | Azure Synapse NotebooksCompany sponsored training | Conferences | Continuing education | Flexible working hours | Paid time offMid-level Full TimeBogota, D.C., Capital District, Colombia R7d ago
-
Data Engineer, Azure - Remote, Latin America COP 54000K-74400KAzure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | Data CatalogCompany-sponsored coursework | Conferences | Continuing education | Flexible working hours | Paid time offMid-level Full TimeBarranquilla, Atlantico, Colombia R7d ago
-
AWS | AWS Bedrock | AWS SageMaker | Computer Vision | Data IngestionFlexible scheduling | Fully remote work | Paid training opportunities | Professional development support | Work from anywhere with stable internetMid-level Full TimeColombia R8d ago
-
Senior-level Full TimeColombia (Remote) R8d ago
-
AI APIs | Access Control | Authentication | Docker | FirebaseFully remote | High ownership and autonomy | Remote flexibilitySenior-level Full TimeColombia - Remote R9d ago
-
AWS | Angular | Anthropic | Azure | CI/CDCareer advancement | Certification programs | Mentorship | Remote work | TrainingSenior-level Full TimeMexico; Colombia; Costa Rica; Chile; Uruguay R9d ago
-
AWS Glue | Amazon Athena | Amazon Kinesis | Amazon S3 | Amazon Web ServicesDiversity, equity, and inclusion focus | Global team collaboration | Mentoring opportunities | Remote-first teamSenior-level Full TimeBarranquilla, Colombia (remote) R11d ago
-
AWS Glue | Amazon Athena | Amazon Kinesis | Amazon S3 | Amazon Web ServicesGlobal team collaboration | Mentorship opportunities | Remote-first cultureSenior-level Full TimeBarranquilla, Colombia (remote) R11d ago