Friends, what is some framework (preferably opensource) for outputting AI models to production?

Question

Machine learning

Friends, what is some framework (preferably opensource) for outputting AI models to production?
For example, I prepared a model in Jupiter, unloaded it and do not want to write my own web service. Is there any box in which you can put the resulting model and which can then work with the external environment?

Answer 1

https://www.tensorflow.org/tfx/guide/serving

Answer 2

I would recommend deploying a REST API microservice.
A microservice is a web service that fulfills one business need and can interact with other services in the IT infrastructure using, for example, HTTP. An architecture consisting of several microservices is called a microservice.
REST (Representational State Transfer) - the principles of organizing the interaction of services through the HTTP protocol. Clients send requests using the methods provided by the HTTP protocol and perform the operation. For example: getting, adding, modifying or deleting data.
API (Application Programming Interface) is an interface for communication between services.
Here I wrote a quite detailed post about it and posted the code - https://alimbekov.com/machine-learning-flask-rest-api/

Answer 3

create a web service from a notepad sketch -> that's what programmers do.
there are no magic open source boxes that will do it for you.