Anything like that should absolutely be left up to the user. The distro should not decide that for you. If you want it, install it and set it up yourself.
I dont see any harm in including support for running models built into the distro and then providing easy access to a pre-selected list of models to use with that if the user wants.
Hopefully the distros integrate ollama or similar so users don’t have to think about it. And it all runs locally.
Anything like that should absolutely be left up to the user. The distro should not decide that for you. If you want it, install it and set it up yourself.
I dont see any harm in including support for running models built into the distro and then providing easy access to a pre-selected list of models to use with that if the user wants.