Agentic Table of Contents (so far)

RAG – A quick example

RAG in detail

Deeper into RAG

The R in RAG

PEAS for Agentic AI

AI Reasoning and Planning

REACT and Agents in AI

Creating a multi-agent system (Python & LangChain/LangGraph) part 1 of 6

Migrating Agentic Code Python -> C# Part 1 of 6

Dependency Injection & Microsoft Agentic Framework

Migrating C# to Microsoft Agentic Framework

Transparency in Agentics

Ensuring Agent Safety

Logging & OpenTelemetry in Microsoft Agentic Framework

Activity Source in Microsoft Agentic Framework

Middleware in Microsoft Agentic Framework

Limit token usage in Microsoft Agentic Framework

Using OpenTelemetry in Microsoft Agent Framework

LangChain/LangGraph vs. Microsoft Agent Framework

Long term memory in Microsoft Agent Framework

Agent vs ChatClient Middleware

Managing Secrets

Microsoft Agent Framework and Foundry

Note: many of these blog posts had initial research and drafts done by the Blog Writer multi-agent application that serves as a demo for these articles. All were then edited by me.

Posted in AI, Essentials | Comments Off on Agentic Table of Contents (so far)

Microsoft Agent Framework and Foundry

In the .NET development world the two most significant frameworks for AI are Microsoft Agent Framework and Microsoft Foundry. Together, they create a powerful ecosystem for building, deploying, and managing AI agents that can automate tasks, respond to user queries, and integrate seamlessly with various services. This post will explore how these two technologies relate to each other, their key features, and their real-world applications.

Continue reading
Posted in AI, Foundry, Microsoft Agent Framework | Leave a comment

Managing Secrets in Microsoft Agent Framework

In the realm of software development, managing configuration values and sensitive information is a critical aspect that can significantly impact the security and functionality of applications. Developers often find themselves at a crossroads when deciding how to store configuration values, particularly when it comes to sensitive data such as API keys, passwords, and other credentials. Two common approaches are using a config.json file for configuration values and utilizing a secrets management system, such as that provided by the Microsoft Agent Framework. This post delves into the differences, trade-offs, and considerations for each approach, helping developers make informed decisions based on their specific needs.

Note: Microsoft strongly suggests using secrets and not putting these values in config.json

Continue reading
Posted in AI | Comments Off on Managing Secrets in Microsoft Agent Framework

Detecting AI

I fed the first half of one of the blog posts generated by my demonstration program to Pangram. Here are the results:

Bzzzz Still your turn.

Posted in AI | Comments Off on Detecting AI

ChatClient Middleware vs. Agent Middleware

As noted in a previous post, middleware plays a pivotal role in enhancing the functionality and observability of agents. The Microsoft Agent Framework utilizes two primary types of middleware: ChatClient Middleware and Agent Middleware. Understanding the distinctions between these two middleware types is essential for developers looking to optimize their agents’ performance and capabilities. This post will delve into the differences between ChatClient Middleware and Agent Middleware, illustrating their functionalities with examples, including a demonstration of function-invocation middleware for a single agent.

This is the approach I use in the demonstration program to log the invocation of the Tavily search tool.

Continue reading
Posted in AI, Essentials | Comments Off on ChatClient Middleware vs. Agent Middleware

Long-term memory in Microsoft Agent Framework

Long-term memory in AI agents refers to the ability to retain information across multiple interactions and sessions. This is essential for creating a more personalized user experience, as it allows agents to recall user preferences, past conversations, and contextual information. The Microsoft Agent Framework employs a dual memory architecture that includes both short-term and long-term memory.

Continue reading
Posted in AI | Comments Off on Long-term memory in Microsoft Agent Framework

LangChain vs Microsoft Agent Framework

In the rapidly evolving landscape of artificial intelligence, developers are presented with a myriad of frameworks to build applications that leverage the power of large language models (LLMs) and multi-agent systems. Among these, LangChain, LangGraph, and the Microsoft Agent Framework stand out for their unique capabilities and target use cases. This post aims to examine the differences between these frameworks, helping developers make informed decisions based on their specific needs and environments.

Continue reading
Posted in AI | Comments Off on LangChain vs Microsoft Agent Framework

OpenTelemetry in Microsoft Agent Framework Apps

Observability has become a critical component for ensuring the performance and reliability of applications. OpenTelemetry, an open-source observability framework, provides developers with the tools necessary to collect and export telemetry data from their applications. When integrated with the Microsoft Agent Framework (MAF), OpenTelemetry offers profound insights into the performance and behavior of AI agents. This post will explore how to effectively use OpenTelemetry in a Microsoft Agent Framework application, highlighting key trends, real-world use cases, challenges, and providing practical code examples.

Continue reading
Posted in AI | Comments Off on OpenTelemetry in Microsoft Agent Framework Apps

Limit token usage in Microsoft Agent Framework

In the rapidly evolving landscape of artificial intelligence, managing costs associated with API usage is a critical concern for developers. The Microsoft Agent Framework offers a powerful tool in this regard: ChatClientAgentRunOptions. This component allows developers to cap the number of output tokens generated in a single call, ensuring that a single interaction does not exceed budgetary constraints. In this post, we will explore how ChatClientAgentRunOptions functions, its key features, real-world applications, and the challenges developers may face when implementing it.

Overview of ChatClientAgentRunOptions

At its core, ChatClientAgentRunOptions is designed to manage various parameters for chat interactions within the Microsoft Agent Framework. One of its most significant features is the ability to limit the number of tokens generated in a single response through the max_tokens parameter. This capability is essential for controlling costs, as excessive token consumption can lead to budget overruns, especially in applications with high user engagement.

Continue reading
Posted in AI, Essentials | Comments Off on Limit token usage in Microsoft Agent Framework

Middleware in Microsoft Agent Framework

A critical need, when creating multi-agent applications is to manage token usage in API calls. This is where middleware plays a crucial role. In this post, we will explore what middleware is within the Microsoft Agent Framework, why it is essential for capping token usage, and how to implement it effectively.

What is Middleware in the Microsoft Agent Framework?

Middleware serves as an intermediary layer that processes requests and responses between users and AI agents. It acts as a bridge, allowing developers to intercept, inspect, and modify the data flowing through the system. This capability is vital for implementing additional logic, such as validation, logging, and, importantly, token management.

In the context of the Microsoft Agent Framework, middleware can be utilized to enhance the functionality of AI agents by providing a structured way to handle requests and responses. This not only improves the overall efficiency of the system but also allows for greater control over how the AI interacts with users.

Continue reading
Posted in AI | Comments Off on Middleware in Microsoft Agent Framework

Activity Source in Microsoft Agent Framework

In the rapidly evolving landscape of artificial intelligence, the ability to monitor and debug multi-agent systems is paramount. The Microsoft Agent Framework (MAF) has taken a significant step forward by integrating OpenTelemetry, a powerful observability framework that enhances the monitoring capabilities of AI agents. This post delves into the key features, innovations, and real-world applications of this integration, providing developers with the insights they need to optimize their AI systems.

Continue reading
Posted in AI | Comments Off on Activity Source in Microsoft Agent Framework

Logging & OpenTelemetry in MAF

In the rapidly evolving landscape of software development, particularly in the realm of artificial intelligence and automation, the importance of robust logging mechanisms cannot be overstated. This is especially true for multi-agent systems, where numerous agents interact and collaborate to achieve complex tasks. In this post, we will explore the significance of logging in a multi-agent Microsoft Agent Framework application, the trends and innovations in logging practices, real-world use cases, and a practical implementation example.

Continue reading
Posted in AI | Comments Off on Logging & OpenTelemetry in MAF