As you build plugins and add them to planners, it's important to make sure they work as intended. This becomes more important as you add more and more plugins to your planners. With more functions, your planners have a greater chance of hallucinating and doing incorrect things. Until now, testing your plugins and planners was a manual process ...
Introduction We are EmbedElite, proud winners of the recent Semantic Kernel Plugins Hackathon. A common challenge for enterprises is the extensive effort in gathering and preparing the necessary context which isn't inherent to LLMs. Recognizing this, we at EmbedElite, set out on a mission to democratize this process, making context retrieval a mor...
This is a follow up blog post to Unlock the Power of Telemetry in Semantic Kernel SDK. We are excited to share we have added logging and metering for prompt, completion, and total tokens for each request to Azure OpenAI/Open AI using Semantic Kernel. This feature will help you monitor and optimize your API usage and costs, as well as troublesho...
We are introducing enhancements to greatly improve performance, reduce cost and data throughput for customers of Chat Copilot. In the current design, partitions are defined by an ID. Overtime as the CosmosDB grows with increased storage we have seen scenarios with extended processing time when customers try to load the list of chats for a curre...
Large language models such as GPT4 and chatGPT have created a revolution in the way people build innovative new applications and experiences. I describe how I got started with building LLM applications and point to some resources I created in this process that I hope will help in your own exploration into this exciting area of software application ...
Dynamic AI planners are a useful tool when you are not sure what type of asks are going to come in from your users. Let's learn how you can use planners in the Java kernel. In my previous blog on using the Java kernel, on Step #5 I explained how to use multiple Plugins and their Functions one after another. In this post, I will show you an exa...
The Emerging LLM Stack In a recent interview, the co-founder of Cohere stated - “For the first time in the history of our planet, we have machines that we’ve created that can use our language.” A bold statement indeed, but it couldn’t be more accurate and we’ve all witnessed the incredible power of said machines. It would be an understatement to s...
Welcome to the third and final blog post in this series about Semantic Kernel Planners. In the previous blogs we touched on discussed the action planner and sequential planner. In this blog we will discuss Semantic Kernal's latest generation of planner called Stepwise Planner. The Stepwise Planner is a powerful planning object based on a neuro...
For lovers of Microsoft Fabric as their data tool of choice, there's a terrific post up on the Fabric blog on how to get started using Semantic Kernel with your "Lakehouse" of choice. Semantic Kernel is used for the "AI Orchestration" layer in the Copilot Stack as featured at Build 2023. Kinfey Lo details how to use Azure Blob Storage, where...
Every system needs to be able to add AI to its workflow to empower the users to complete their task much faster. The Semantic Kernel team and community have been working hard to create a Java based kernel to support Java developers to unleash AI into their apps. I will walk you through this journey below. We will review the following concepts ...
