{"id":1504,"date":"2023-11-09T16:33:29","date_gmt":"2023-11-10T00:33:29","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/semantic-kernel\/?p=1504"},"modified":"2023-11-10T05:32:26","modified_gmt":"2023-11-10T13:32:26","slug":"assistants-a-first-look-into-using-openai-assistants-with-semantic-kernel","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/agent-framework\/assistants-a-first-look-into-using-openai-assistants-with-semantic-kernel\/","title":{"rendered":"OpenAI Assistants: a first look into using OpenAI Assistants with Semantic Kernel"},"content":{"rendered":"

\"Image<\/a><\/h2>\n

On Monday, we shared that the future of Semantic Kernel will leverage OpenAI Assistants<\/a> so you can take advantage of the ease-of-use they provide in creating agents and copilots.<\/p>\n

In this<\/em> blog post, we wanted to pick up where we left off and share an incremental update on our current progress while also<\/em> diving into some of the scenarios we want to enable once we\u2019ve launched the integration.<\/p>\n

So without further ado\u2026 check out this recorded demo of us using assistants with Semantic Kernel! In the demo, you\u2019ll see just how easy it\u2019ll be to update an existing Semantic Kernel v1.0 project from a standard kernel to an assistant kernel.<\/p>\n

As you likely saw from the video, we\u2019re able to use the Semantic Kernel SDK to let users chat with an entire team of agents. This functionality has been highly<\/em> influenced by the work pioneered by the Autogen team. With their framework, they\u2019ve shown that multiple agents can be better than one.<\/p>\n

For example, when you use a single assistant, you must give it all<\/em> your plugins and memory so it can answer any<\/em> request by a user. This, however, can be too much for a single assistant to handle. Plus, it becomes difficult to evaluate that a monolithic agent can actually<\/em> work across such a large domain.<\/p>\n

\"Image<\/a><\/p>\n

Instead, you can create individual assistants for each of your domains by giving them specialized plugins and memories. In the picture below, we show how you could have a single Project Manager agent that coordinates requests between the user and the rest of the team\u2013in this case, a scientist, artist, and investigator.<\/p>\n

We call this a hierarchical chat.<\/strong><\/p>\n

\"Image<\/a><\/p>\n

With plugins, we\u2019ll make it extremely easy to model a hierarchical structure like this. The benefit of this approach is that the project manager agent can make parallel requests to multiple agents. For example, the product manager agent may want to simultaneously get scientific, artistic, and investigative insight to answer a user\u2019s request.<\/p>\n

The challenge with this approach, however, is that the user must wait for the product manager to relay any information it receives from its team.<\/p>\n

Because of this, we\u2019re also in the process of implementing a solution that allows all agents to speak on the same thread. This is very similar to what Autogen<\/a> does today. By sharing a thread, all assistants instantly have awareness of what was said elsewhere, and<\/em> the sub-assistants can directly communicate with the user.<\/p>\n

We call this a joint chat.<\/strong><\/p>\n

\"Image<\/a><\/p>\n

This is just like a live Teams meeting. You can have faster collaboration, but each person can only speak one at a time\u2013therefore its more difficult to parallelize than hierarchical chat.<\/p>\n

The pros and cons of the two approaches mirror how people collaborate in businesses as well. For highly distributed tasks, having an org hierarchy is helpful (you wouldn\u2019t want an entire company on the same Teams call!) while other tasks are best hammered out over a meeting.<\/p>\n

As research in this space grows, the choice of which method to choose (and when) will become more clear, but in the meantime, the Semantic Kernel team believes that both will have an important part to play in orchestrating agents, so we want to make sure both routes are extremely easy to create with our SDK.<\/p>\n

Take a look at our prototype<\/h2>\n

If you\u2019re excited to see the sample code, you can look at our very<\/em> early prototype in our v1 proposal repo<\/a>. It still has some polishing to go through, so don\u2019t be surprised if it\u2019s a bit buggy at first. The team is now refining the implementation so we can bring it into the main branch of Semantic Kernel.<\/p>\n

Once it\u2019s in, I\u2019ll share another blog post that walks through how to use the SDK in more detail!<\/p>\n

Have feedback?<\/h2>\n

We\u2019ve already gotten great feedback on our proposal to integrate assistants into our SDK. If you have additional thoughts, consider sharing them with us there<\/a>!<\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

On Monday, we shared that the future of Semantic Kernel will leverage OpenAI Assistants so you can take advantage of the ease-of-use they provide in creating agents and copilots. In this blog post, we wanted to pick up where we left off and share an incremental update on our current progress while also diving into […]<\/p>\n","protected":false},"author":121401,"featured_media":1505,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1504","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-semantic-kernel"],"acf":[],"blog_post_summary":"

On Monday, we shared that the future of Semantic Kernel will leverage OpenAI Assistants so you can take advantage of the ease-of-use they provide in creating agents and copilots. In this blog post, we wanted to pick up where we left off and share an incremental update on our current progress while also diving into […]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/agent-framework\/wp-json\/wp\/v2\/posts\/1504","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/agent-framework\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/agent-framework\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/agent-framework\/wp-json\/wp\/v2\/users\/121401"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/agent-framework\/wp-json\/wp\/v2\/comments?post=1504"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/agent-framework\/wp-json\/wp\/v2\/posts\/1504\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/agent-framework\/wp-json\/wp\/v2\/media\/1505"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/agent-framework\/wp-json\/wp\/v2\/media?parent=1504"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/agent-framework\/wp-json\/wp\/v2\/categories?post=1504"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/agent-framework\/wp-json\/wp\/v2\/tags?post=1504"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}