add in new context parameter guide #220
Conversation
|
|
||
| ### Size limit | ||
|
|
||
| There is no size limit for the `context` parameter itself, but the request body size limit of 128 KiB applies to all text translation requests. |
There was a problem hiding this comment.
For classic models, the maximum context taken into account was 5 sentences, but I do not know how it works with next-gen. Is it truly unlimited except for request body size?
There was a problem hiding this comment.
Not an expert but we don't impose any size limitations on the context field for users (beyond the 128KiB request size limit). When translating I believe that for both model types we'll just use the last 5 sentences but I don't believe we expose that limitation to the user.
There was a problem hiding this comment.
Sounds like we should leave this as-is then?
docs/learning-how-tos/examples-and-guides/how-to-use-context-parameter.mdx
Show resolved
Hide resolved
|
|
||
| ### Size limit | ||
|
|
||
| There is no size limit for the `context` parameter itself, but the request body size limit of 128 KiB applies to all text translation requests. |
There was a problem hiding this comment.
Not an expert but we don't impose any size limitations on the context field for users (beyond the 128KiB request size limit). When translating I believe that for both model types we'll just use the last 5 sentences but I don't believe we expose that limitation to the user.
Co-authored-by: Brianna Delgado <[email protected]>
The context parameter is often misunderstood. We have 2 separate guides to it right now, neither of which fully describe its intended use. Let's unify those and clean them up!