52mon1lens0021 in artificial_intelDocker Model Runner is now Generally Availablehttps://www.docker.com/blog/rebooting-model-runner-community/cross-posted from: https://programming.dev/post/39062524
vermaterc - 2monDo you guys successfully use small self hosted models somewhere? Although I can see a use case for LLMs, it's always the biggest ones that can output any useful results (and by "biggest" I usually mean: the ones I can't afford to run by myself) 3
lens0021 in artificial_intel
Docker Model Runner is now Generally Available
https://www.docker.com/blog/rebooting-model-runner-community/cross-posted from: https://programming.dev/post/39062524
Do you guys successfully use small self hosted models somewhere? Although I can see a use case for LLMs, it's always the biggest ones that can output any useful results (and by "biggest" I usually mean: the ones I can't afford to run by myself)