MindsDb

Integrate MindsDB with Portkey to build enterprise-grade AI use-cases

MindsDB connects to various data sources and LLMs, bringing data and AI together for easy AI automation.

With Portkey, you can run MindsDB AI systems with 250+ LLMs and implement enterprise-grade features like LLM observability, caching, advanced routing, and more to build production-grade MindsDB AI apps.

Prerequisites

Before proceeding, ensure the following prerequisites are met:

1. Install MindsDB locally via Docker or Docker Desktop.
2. To use Portkey within MindsDB, install the required dependencies following this instruction.
3. Obtain the Portkey API key required to deploy and use Portkey within MindsDB.

Setup

1. Create an AI engine from the Portkey handler

   • You can pass all the parameters that are supported by Portkey inside the USING clause.
   • Check out the Portkey handler implementation here.

   Using Portkey's Configs

   CREATE ML_ENGINE portkey_engine
   FROM portkey
   USING
       portkey_api_key = '{PORTKEY_API_KEY}',
       config = '{PORTKEY_CONFIG_ID}';
   

   Portkey’s configs are a powerful way to build robust AI systems. You can use them to implement guardrails, caching, conditional routing and much more in your AI apps.

2. Create a model with portkey_engine

   • You can pass all the parameters supported by Portkey Chat completions here inside the USING clause.

   Create Portkey Model

   CREATE MODEL portkey_model
   PREDICT answer
   USING
         engine = 'portkey_engine',
         temperature = 0.2;
   

   Learn more about the supported paramteres in Chat Completions here.

3. Query the model to get predictions

   Query Portkey Model

   SELECT question, answer
   FROM portkey_model
   WHERE question = 'Where is Stockholm located?';
   

   Here is the output:

   Output

   +-----------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
   | question                    | answer                                                                                                                                             |
   +-----------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
   | Where is Stockholm located? |  Stockholm is the capital and largest city of Sweden. It is located on Sweden's south-central east coast, where Lake Mälaren meets the Baltic Sea. |
   +-----------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
   

Next Steps

Check out the MindsDB Use Cases page to see more examples.