Showing results for September 2023 - Surface Duo Blog

Sep 28, 2023
2
0

Speech-to-speech conversing with OpenAI on Android

Craig Dunn Kristen Halper
Craig,
Kristen

Hello prompt engineers, Just this week, OpenAI announced that their chat app and website can now ‘hear and speak’. In a huge coincidence (originally inspired by this Azure OpenAI speech to speech doc), we’ve added similar functionality to our Jetpack Compose LLM chat sample based on Jetchat. The screenshot below shows the ...

openaichatgpt
Sep 21, 2023
0
1

Infinite chat with history embeddings

Craig Dunn
Craig Dunn

Hello prompt engineers, The last few posts have been about the different ways to create an ‘infinite chat’, where the conversation between the user and an LLM model is not limited by the token size limit and as much historical context as possible can be used to answer future queries. We previously covered: These ...

openaichatgpt
Sep 14, 2023
0
0

“Infinite” chat with history summarization

Craig Dunn
Craig Dunn

Hello prompt engineers, A few weeks ago we talked about token limits on LLM chat APIs and how this prevents an infinite amount of history being remembered as context. A sliding window can limit the overall context size, and making the sliding window more efficient can help maximize the amount of context sent with each new chat query...

openaichatgpt
Sep 7, 2023
0
0

De-duplicating context in the chat sliding window

Craig Dunn
Craig Dunn

Hello prompt engineers, Last week’s post discussed the concept of a sliding window to keep recent context while preventing LLM chat prompts from exceeding the model’s token limit. The approach involved adding context to the prompt until we've reached the maximum number of tokens the model can accept, then ignoring any remaining older...

openaichatgpt