Skip to content

new complete with options not returning meta data #151

@chx5

Description

@chx5
#  `snowflake-ml-python=1.8.1`
model = 'llama3.2-3b'
#options = cortex.CompleteOptions(top_p=0, temperature=0)
resp = cortex.complete(model, 'tell me a joke', options={})
print(resp)


options = cortex.CompleteOptions(guardrails=True)
resp = cortex.complete(model, 'tell me a joke', options=options)
print(resp)

Both return a string without meta data (usage, created, model).

While cortex.Complete with options argument in the old version snowflake-ml-python=1.6.0 returns a JSON string with meta data.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions