Showing results for August 2023 - Surface Duo Blog

Aug 31, 2023
0
0

Infinite chat using a sliding window

Craig Dunn
Craig Dunn

Hello prompt engineers, There are a number of different strategies to support an ‘infinite chat’ using an LLM, required because large language models do not store ‘state’ across API requests and there is a limit to how large a single request can be. In this OpenAI community question on token limit differences in API vs ...

openaichatgpt
Aug 24, 2023
2
2

OpenAI tokens and limits

Craig Dunn
Craig Dunn

Hello prompt engineers, The Jetchat demo that we’ve been covering in this blog series uses the OpenAI Chat API, and in each blog post where we add new features, it supports conversations with a reasonable number of replies. However, just like any LLM request API, there are limits to the number of tokens that can be processed, and the ...

openaichatgpt
Aug 17, 2023
0
1

Prompt engineering tips

Craig Dunn
Craig Dunn

Hello prompt engineers, We’ve been sharing a lot of OpenAI content the last few months, and because each blog post typically focuses on a specific feature or API, there’s often smaller learnings or discoveries that don’t get mentioned or highlighted. In this blog we’re sharing a few little tweaks that we discovered when ...

openaichatgpt
Aug 10, 2023
0
0

Dynamic Sqlite queries with OpenAI chat functions

Craig Dunn
Craig Dunn

Hello prompt engineers, Previous blogs explained how to add droidcon session favorites to a database and also cache the embedding vectors in a database – but what if we stored everything in a database and then let the model query it directly? The OpenAI Cookbook examples repo includes a section on how to call functions with ...

openaichatgpt
Aug 3, 2023
1
0

Embedding vector caching (redux)

Craig Dunn
Craig Dunn

Hello prompt engineers, Earlier this year I tried to create a hardcoded cache of embedding vectors, only to be thwarted by the limitations of Kotlin (the combined size of the arrays of numbers exceeded Kotlin’s maximum function size). Now that we’ve added Sqlite to the solution to support memory and querying, we can use that ...

openaichatgpt