Agentic AI Optimization Developer
CAN - Ontario - Toronto, Canada
CAD 120K-165K (estimate) Mid-level Full Time
Tasks
- Audit agent trajectories and reasoning
- Build automated evaluation pipelines
- Curate golden dataset for agent testing
- Debug asynchronous nondeterministic system errors using tracing observability
- Design JSON schemas for tool calling
- Implement guardrail frameworks for autonomous agents
- Measure agent accuracy latency token spend fallback reliability
- Monitor deployed agents for drift and hallucinations
- Optimize RAG pipelines and knowledge bases
- Optimize tool use and function calling
- Refine system prompts context windows few shot examples
- Test agentic workflows in production
- Tune interactions with external APIs and databases
- Write automated test scripts
Perks/Benefits
Skills/Tech-stack
API Design | Async Programming | Data Generation | Function Calling | Gemini | JSON Schema | LLM orchestration | Langgraph | Microservices | Observability | Python | RAG | Synthetic Data Generation | Synthetic data | Test automation | Tool-Calling | Tracing | TypeScript | UiPath | UiPath RPA | Vertex AI
Education
N/A
Related jobs
-
AWS | Agile | Azure | Azure Data | Azure Data FactorySenior-level ContractToronto, Canada12h ago
-
APIs | AWS | AWS Glue | Amazon Athena | Amazon EC2Hybrid work modelSenior-level ContractToronto, Canada12h ago
-
AWS | Access Management | Agile | Automated testing | AzureFull time schedule 36 25 hours per week | Occasional travel within Alberta | Remote work | Work performed within CanadaSenior-level ContractEdmonton, Canada R12h ago
-
Airflow | BigQuery | CI/CD | DBT | Data GovernanceInclusive culture | Remote-friendly environment | Significant ownershipSenior-level Full TimeCanada R23h ago
-
Senior Machine Learning Engineer CAD 168K-210KAWS | Azure | CI/CD | Drift Detection | Feature EngineeringContinuing education | Health benefits | Mental health benefits | VacationSenior-level Full TimeBurnaby, British Columbia, Canada1d ago
-
Agentic AI Developer CAD 120K-165KAPI Design | Agent systems | Agentic Workflows | Asynchronous programming | Cloud deploymentMid-level Full TimeCAN - Ontario - Toronto, Canada1d ago
-
Automation Solution Lead CAD 140K-170KAgentic AI | Artificial Intelligence | Cloud Architecture | Cloud platform | Code reviewSenior-level Full TimeCAN - Ontario - Toronto, Canada1d ago
-
Software Engineer - AI Developer Productivity USD 165K-330KAudit Logging | Authentication | Authorization | CI/CD | Context ManagementCompany facilitated 401k | Fertility and family building stipend | Flexible PTO | Medical dental vision insurance 100 percent | Paid parental leaveSenior-level Full TimeSan Francisco R1d ago
-
Senior AI Engineer - Grafana AI/ML | USA | Remote CAD 129K-217KAWS | Agent Frameworks | Agent workflows | Artificial Intelligence | Cloud ComputingAnnual leave | Company RSUs | Relocation N/A | Remote workSenior-level Full TimeCanada (Remote) R1d ago
-
Continuous Improvement & AI Intelligence Automation Lead CAD 110K-125KAgentic AI | Automation Anywhere | Automation Roadmapping | Blue Prism | Cause analysisEducation/training stipend | Employee resource groups | Headspace subscription | Health, dental, vision coverage | Hybrid work environmentSenior-level Full TimeVancouver R1d ago
-
Senior Software Engineer, Data Systems CAD 123K-187KAirflow | Amazon Redshift | Apache Kafka | Backpressure | Capacity PlanningDental coverage | Flexible work hours | Fully remote | Health insurance | Parental leave top-upsSenior-level Full TimeCanada (Remote) R1d ago
-
Ingénieur(e) IA Générative - Hébergement De Modèles LLM CAD 101K-133KC plus plus | CI/CD | Chaos Engineering | Device plugins | DockerSenior-level Full TimeMontreal,Quebec,Canada R1d ago
-
Ingénieur(e) IA Générative - Hébergement De Modèles LLM CAD 101K-133KC++ | CI/CD | CUDA | CUDA toolkit | DockerSenior-level Full TimeMontreal,Quebec,Canada1d ago
-
AWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftCollaborative environment | Mentorship and growth | Mission-driven impactEntry-level Full TimeVaughan, Ontario; Remote, Canada; Remote, US … R1d ago
-
AI & Data Analyst CAD 82K-113KAI Foundry | APIs | Azure AI | Azure AI Foundry | Business CentralCompany-matched RRSP | Comprehensive health and dental | Disability insurance | Flexible spending account | Life insuranceMid-level Full TimeEdmonton, Alberta1d ago
-
Data Engineer CAD 100K-110KAWS | Airflow | Apache Airflow | Apache Flink | Apache SparkAgile team | Hybrid work | Remote collaborationMid-level Full TimeToronto, Ontario, Canada1d ago
-
Data Engineer CAD 100K-110KAWS | Apache Airflow | Apache Spark | ArgoCD | AzureAgile team collaboration | Hybrid work environment | Mentorship opportunitiesMid-level Full TimeToronto, Ontario, Canada1d ago
-
Aerial Imagery | Airflow | Computer Vision | DBT | DagsterDistributed team collaboration | Fully remote | Technical ownership | Visa sponsorship not availableSenior-level Full TimeCanada R1d ago
-
ML Engineer – Generative AI & LLMs (Remote) CAD 129K-174KAWS | Agent systems | Agentic Systems | Apache Spark | AzureAccountability culture | Competitive compensation | Remote workMid-level Contract Full TimeToronto, ON, Canada R1d ago
-
Analytics Engineer CAD 75K-122KAirflow | Alation | Amazon Redshift | BigQuery | CI/CDCompany-paid certifications | Healthcare insurance | Internal events | Internal mobility opportunities | Life insuranceMid-level Full TimeCanada1d ago
-
Airflow | Computer Vision | Computer vision models | DBT | DagsterCanada based candidates preferred | Climate focused initiatives | Cross-functional collaboration | Fully remote work | Impact on infrastructure resilienceSenior-level Full TimeCanada R1d ago
-
AI Agents | API Integration | Access Control | Amazon Bedrock | Argo CDCollaborative culture | Equity or bonus opportunities | Professional growth opportunities | Remote work within Canada | Work on cutting edge AI and cloud projectsSenior-level Full TimeCanada R2d ago
-
Senior Machine Learning Engineer CAD 170K-250KC# | C++ | Deep learning | GPU Computing | Generative AICareer development | Health and well-being benefits | Mentoring programs | Paid time off | Savings and retirement programsSenior-level Full Time661 University Avenue, Toronto, Ontario, Canada2d ago
-
AI Search | Agile | Azure AI | Azure AI Search | Azure DataAccident insurance | Health insurance | Hybrid work | Life insurance | Retirement savings plansSenior-level Full TimeFCP, Canada R2d ago
-
Principal Machine Learning Engineer CAD 154K-232KA/B | A/B Testing | AWS | Attention Mechanisms | Automated retrainingEmployee assistance program | Health insurance | Retirement savings plan | Vacation and paid holidaysSenior-level Full TimeToronto Office TRO, Canada2d ago