# Active-Prompt
Chain-of-thought (CoT) methods rely on a fixed set of human-annotated exemplars. The problem with this is that the exemplars might not be the most effective examples for the different tasks. To address this, [Diao et al., (2023)](https://arxiv.org/pdf/2302.12246.pdf) recently proposed a new prompting approach called Active-Prompt to adapt LLMs to different task-specific example prompts (annotated with human-designed CoT reasoning).
Below is an illustration of the approach. The first step is to query the LLM with or without a few CoT examples. *k* possible answers are generated for a set of training questions. An uncertainty metric is calculated based on the *k* answers (disagreement used). The most uncertain questions are selected for annotation by humans. The new annotated exemplars are then used to infer each question.
<Screenshot src={ACTIVE} alt="ACTIVE" />
Image Source: [Diao et al., (2023)](https://arxiv.org/pdf/2302.12246.pdf)
<CoursesSection title="Related Learning">
<CourseCard
tag="Course"
tagColor="blue"
title="Prompt Engineering for LLMs"
description="Master Active-Prompt, chain-of-thought, and advanced prompting techniques for better LLM performance."
href="https://academy.dair.ai/courses/introduction-prompt-engineering"
level="Beginner"
duration="2 hours"
/>
<CourseCard
tag="Course"
tagColor="purple"
title="Building Effective AI Agents"
description="Learn to build effective AI agents. Covers function calling, tool integration, and debugging agentic systems."
href="https://academy.dair.ai/courses/building-effective-ai-agents"
level="Intermediate"
duration="5 hours"
/>
</CoursesSection>
<CoursePromo
title="Explore All Courses"
description="Discover our full catalog of AI and prompt engineering courses. From beginners to advanced practitioners."
href="https://academy.dair.ai/"
buttonText="Browse Academy"
promoCode="PROMPTING20"
/>