We are seeking a highly skilled Microsoft 365 / Dynamics 365 Copilot Agent Developer with expertise in AI agent testing, evaluation, quality engineering, and automation . The ideal candidate will be responsible for designing, developing, testing, and optimizing enterprise-grade Copilot agents using Microsoft Copilot Studio, Microsoft 365 Copilot, Dynamics 365 Copilot, Power Platform, Azure AI, and Copilot Studio Kit . This role will focus on building scalable test frameworks, automated evaluation pipelines, benchmark datasets, and quality validation processes for Generative AI solutions. The successful candidate will leverage Copilot Studio Kit, Azure Application Insights, AI Builder, Dataverse, Direct Line APIs, and Azure AI services to validate agent accuracy, grounded Ness, response quality, relevance, safety, and overall business effectiveness. The candidate should possess hands-on experience developing and evaluating multi-turn conversational agents , implementing response match, topic match, generative answer, and attachment testing , and creating automated regression testing frameworks for Microsoft 365 and Dynamics 365 Copilot solutions. Experience analyzing conversation transcripts, telemetry, knowledge retrieval effectiveness, and agent KPIs is required. The ideal candidate will also have strong expertise in prompt engineering, Retrieval-Augmented Generation (RAG), LLM evaluation, AI governance, Responsible AI, hallucination detection, grounded Ness testing, benchmark management, and continuous quality monitoring . They will work closely with solution architects, business stakeholders, developers, and QA teams to ensure Copilot agents meet enterprise standards for reliability, security, compliance, and user satisfaction. Required Skills Microsoft Copilot Studio Microsoft 365 Copilot Extensibility Dynamics 365 Copilot Power Platform (Power Apps, Power Automate, Dataverse) Azure AI Services & Azure OpenAI Copilot Studio Kit (Agent Kit) AI Builder Prompt Engineering Retrieval-Augmented Generation (RAG) Multi-Turn Conversation Testing Generative AI Evaluation Agent Benchmark Development Grounded Ness, Relevance, Completeness & Accuracy Testing Hallucination Detection Response Match, Topic Match & Attachment Match Testing Azure Application Insights Power BI Analytics & Reporting Direct Line API Integration Microsoft Entra ID Security Azure DevOps / GitHub CI/CD Test Automation Framework Development AI Governance & Responsible AI Conversation Transcript Analysis Agent Performance Monitoring & KPI Reporting Dynamics 365 Sales, Customer Service, and Customer Insights Preferred Certifications AI-102 Azure AI Engineer Associate PL-400 Power Platform Developer PL-600 Power Platform Solution Architect MB-210 Dynamics 365 Sales MB-230 Dynamics 365 Customer Service Microsoft Copilot Studio Applied Skills
Microsoft 365 / Dynamics 365 Copilot Agent Developer (TestDevelopment) • Karachi, Pakistan
We're hiring an Outbound Specialist (outbound marketing) to build and run the top of our pipeline, .This is a quota-carrying, outbound-first role built around modern AI and automation .Build and ma... Show more
Headquartered in San Francisco, our investors include.AI Safety Experts — English & Urdu.Conduct jailbreaks, prompt injections, misuse cases, and bias exploitation.Generate high-quality human data.... Show more
At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio.If you're looking for an exciting opportunity to grow in a innovative environment, this could be the pe... Show more
We are seeking a highly skilled.Microsoft 365 / Dynamics 365 Copilot Agent Developer.AI agent testing, evaluation, quality engineering, and automation.The ideal candidate will be responsible for de... Show more
CRM Techno-Functional Consultant.Customer Engagement, AI Copilot, Power Platform, and integration initiatives across Microsoft Dynamics 365, Microsoft 365 Copilot, Copilot Studio, HubSpot, Azure AI... Show more
At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio.If you're looking for an exciting opportunity to grow in a innovative environment, this could be the pe... Show more
Headquartered in San Francisco, our investors include.AI Safety Experts — English & Punjabi.Focus on jailbreaks, prompt injections, misuse cases, and bias exploitation.Generate high-quality hum... Show more
TOP clients from our portfolio.We are currently looking for a.DFT & Post-Silicon Validation.Are you passionate about Design for Testability (DFT) for complex SoCs and SoC chiplets in package? W... Show more
You should be comfortable working end to end—from Azure networking and routing through to server operations, application hosting, and platform performance.In this role, you’ll collaborate closely w... Show more
Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Show more
Reboot Monkey is a global datacenter services provider headquartered in Haarlem, Netherlands, operating.We deliver colocation, IP transit, smart hands, remote hands, and managed datacenter services... Show more
Clients need a single point of contact who actually understands hardware, not just a relationship manager who has to relay every technical question.Projects span hardware deployment, structured cab... Show more
Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Show more
Headquartered in San Francisco, our investors include.AI Safety Experts — English & Punjabi.Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging sy... Show more
At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio.We are currently seeking a Continuous Integration & Verification Infrastructure Engineer to join on... Show more
Reboot Monkey is a global datacenter services provider headquartered in Haarlem, Netherlands, operating.We deliver colocation, IP transit, smart hands, remote hands, and managed datacenter services... Show more
Microsoft 365 Solutions Architect / Senior M365 Engineer.Subject Matter Expert (SME) responsible for the design, implementation, administration, and support of enterprise Microsoft 365 environments... Show more
At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio.If you're looking for an exciting opportunity to grow in a innovative environment, this could be the pe... Show more
Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Show more
Bachelor's degree in Computer Science, Software Engineering, or a related field.Experience designing scalable, secure, and high-availability backend systems.Strong knowledge of SQL Server and datab... Show more
