Seeing what AI can do on a PC
Alongside the brand new Home windows App SDK preview, Microsoft has rolled out a software to point out off the AI capabilities on a PC. Its AI Dev Gallery is meant to showcase Home windows’ AI instruments and its assist for ONNX, and it highlights a set of frequent AI functions, from textual content operations to audio and video processing. A few of the samples showcase integrating AI instruments into frequent Home windows controls, for instance, including semantic capabilities to a combo field.
There’s assist for a choice of totally different fashions, with Microsoft’s personal Phi 3 and Phi 3.5 on the prime of the record for textual content and imaginative and prescient. Fashions may be downloaded as wanted, with assist for CPU and GPU ONNX runtimes. NPU assist is lacking, which is odd, as with out it Microsoft can’t present the capabilities of its Copilot+ PCs.
Hopefully, this short-term oversight might be corrected in a future launch. For now, the Gallery is value exploring. I’d suggest sticking with one mannequin the place potential. Although edge fashions are comparatively small, they will nonetheless devour a number of gigabytes of reminiscence and disk. A built-in mannequin administration characteristic permits you to add and take away fashions out of your native cache as vital.