Deploying a model on a single-model server

OpenShift AI single-model servers host only one model. You create a new model server and deploy your model to it.

Prerequisites

  • A user with admin privileges has enabled the single-model serving platform on your OpenShift cluster.

Procedure

  1. In the OpenShift AI dashboard, navigate to the project details page and click the Models tab.

    Models
    Depending on how model serving has been configured on your cluster, you might see only one model serving platform option.

  2. In the Single-model serving platform tile, click Deploy model.

  3. In the form, provide the following values:

    1. For Model deployment name, type fraud.

    2. For Serving runtime, select OpenVINO Model Server.

    3. For Model framework (name - version), select onnx-1.

    4. For Existing data connection, select My Storage.

    5. Type the path that leads to the version folder that contains your model file: models/fraud

    6. Leave the other fields with the default settings.

      Deploy model form for single-model serving

  4. Click Deploy.

Verification

Notice the loading symbol under the Status section. The symbol changes to a green checkmark when the deployment completes successfully.

Deployed model status
Next step

Testing the model API