This is a follow up blog post to Unlock the Power of Telemetry in Semantic Kernel SDK. We are excited to share we have added logging and metering for prompt, completion, and total tokens for each request to Azure OpenAI/Open AI using Semantic Kernel. This feature will help you monitor and optimize your API usage and costs, as well as troublesho...
We are introducing enhancements to greatly improve performance, reduce cost and data throughput for customers of Chat Copilot. In the current design, partitions are defined by an ID. Overtime as the CosmosDB grows with increased storage we have seen scenarios with extended processing time when customers try to load the list of chats for a curre...
Large language models such as GPT4 and chatGPT have created a revolution in the way people build innovative new applications and experiences. I describe how I got started with building LLM applications and point to some resources I created in this process that I hope will help in your own exploration into this exciting area of software application ...
Dynamic AI planners are a useful tool when you are not sure what type of asks are going to come in from your users. Let's learn how you can use planners in the Java kernel. In my previous blog on using the Java kernel, on Step #5 I explained how to use multiple Plugins and their Functions one after another. In this post, I will show you an exa...
The Emerging LLM Stack In a recent interview, the co-founder of Cohere stated - “For the first time in the history of our planet, we have machines that we’ve created that can use our language.” A bold statement indeed, but it couldn’t be more accurate and we’ve all witnessed the incredible power of said machines. It would be an understatement to s...
Welcome to the third and final blog post in this series about Semantic Kernel Planners. In the previous blogs we touched on discussed the action planner and sequential planner. In this blog we will discuss Semantic Kernal's latest generation of planner called Stepwise Planner. The Stepwise Planner is a powerful planning object based on a neuro...
For lovers of Microsoft Fabric as their data tool of choice, there's a terrific post up on the Fabric blog on how to get started using Semantic Kernel with your "Lakehouse" of choice. Semantic Kernel is used for the "AI Orchestration" layer in the Copilot Stack as featured at Build 2023. Kinfey Lo details how to use Azure Blob Storage, where...
Every system needs to be able to add AI to its workflow to empower the users to complete their task much faster. The Semantic Kernel team and community have been working hard to create a Java based kernel to support Java developers to unleash AI into their apps. I will walk you through this journey below. We will review the following concepts ...
We've heard from many in the community who want to use Semantic Kernel to query their relational database using natural language expressions. We are excited to share this sandbox that enables you explore the capabilities of LLM to generate SQL queries (or SELECT statements): NL2SQL. This has been an area of interest for years (WikiSQL, Spider, et...
As more and more customers are becoming reliant on the Semantic Kernel SDK to create sophisticated and powerful applications, we have heard the need for greater transparency into end-to-end traceability and debugging. For example, if you want to know how a specific plugin can impact performance or looking for a way to debug a request this blog po...
