Add macOS support for Phi-3

[haoruilee]

Source link

https://huggingface.co/microsoft/Phi-3-mini-4k-instruct

Target platform

macOS

Use case

Add macOS Core AI export support for Phi-3 Mini 4K Instruct in apple/coreai-models, so developers can run a smaller Phi-3 language model on-device with explicit KV-cache inference.

Preferred precision / compression

No response

Additional context

No response

[haoruilee]

I implemented Phi-3 Mini 4K macOS support in my fork, but I cannot open a PR because this repository currently restricts PR creation to collaborators.

Branch: https://github.com/haoruilee/coreai-models/tree/feat/phi-3
Commit: haoruilee@c00949b

Happy to revise if maintainers have feedback. Could someone enable fork PRs, add me as a collaborator, or pull/cherry-pick this commit?