Skip to content

Genai main additions #11325

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
linaaaf wants to merge 16 commits into
base: development
Choose a base branch
from
+23 −44
Open

Genai main additions #11325

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
fd8cdcb
Update agent-commons.md
linaaaf Apr 17, 2026
ff7d6d5
Merge branch 'mendix:development' into development
linaaaf May 29, 2026
894eec7
Clarify GenAI Commons description in documentation
linaaaf May 29, 2026
e0c5242
Update model listings for OpenAI and image generation
linaaaf May 29, 2026
0596ccd
Revise model table and add API references
linaaaf May 29, 2026
710554d
Update Converse API output capabilities
linaaaf May 29, 2026
3f87e74
Update image generation row in model capabilities table
linaaaf May 29, 2026
652c01c
Remove titan embed references
liamsommer-mx Jun 8, 2026
3cdfb8d
updated model support for bedrock embeddings
liamsommer-mx Jun 8, 2026
37c484c
Update model support information in documentation
linaaaf Jun 8, 2026
d9f496d
Revise model listings and add reference links
linaaaf Jun 8, 2026
4052ce4
Update Gemini model listings in documentation
linaaaf Jun 9, 2026
e2f91a1
Reorder Mistral models in the documentation table
linaaaf Jun 9, 2026
2b40bfa
Fix formatting and update Mistral models list
linaaaf Jun 9, 2026
38e52fa
Merge branch 'development' into genai-main-additions
dbreseman Jun 9, 2026
88d2789
Language edit
dbreseman Jun 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 17 additions & 27 deletions content/en/docs/genai/_index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ Integrate AI capabilities into your applications with Agents Kit, a collection o
| [Agent Commons](/agents/genai-for-mx/agent-commons/) | Build agentic functionality by defining, testing, and evaluating agents at runtime. Iterate on prompts and agent configurations without app redeployment through the integrated Agent Builder UI. | 10.24 |
| [Agent Editor](/agents/genai-for-mx/agent-editor/) | Define agents as version-controlled documents in Studio Pro at design time. Author prompts, configure tools and knowledge bases, test locally, and deploy agents as part of your app model. | 11.9 |
| [Conversational UI](/agents/genai-for-mx/conversational-ui/) | Create chat interfaces for full-screen, sidebar, or modal GenAI conversations. Monitor token consumption and trace interactions with UI features built on GenAI Commons. | 10.24 |
| [GenAI Commons](/agents/genai-for-mx/commons/) | Use common capabilities that allow all GenAI connectors to be integrated with the other modules. You can also implement your own connector based on this module. | 10.24 |
| [GenAI Commons](/agents/genai-for-mx/commons/) | Integrate GenAI connectors with other modules using common capabilities provided by this base module. Required dependency for both core and connector modules. You can also implement your own connector based on this module. | 10.24 |

#### Connector Modules {#connectors}

Expand Down Expand Up @@ -103,49 +103,39 @@ Mendix [connectors](#connectors) offer direct support for the following models.

| Models | Category | Input | Output | Additional Capabilities |
| --- | --- | --- | --- | --- |
| gpt-4, gpt-4-turbo, gpt-4o, gpt-4o mini, gpt-4.1, gpt-4.1-mini, gpt-4.1-nano, gpt-5.0, gpt-5.0-mini, gpt-5.0-nano, gpt-5.1, gpt-5.2, o1, o1-mini, o3, o3-mini, o4-mini | Chat completions | text, image, document (OpenAI only) | text | Function calling |
| DALL·E 2, DALL·E 3, gpt-image-1 | Image generation | text | image | |
| gpt and o family, such as gpt-5.5 and o4 | Chat completions | text, image, document (OpenAI only) | text | Function calling |
| gpt-image-1, gpt-image-1.5, gpt-image-2 | Image generation | text | image | |
| text-embedding-ada-002, text-embedding-3-small, text-embedding-3-large | Embeddings | text | embeddings | |

For a list of all OpenAI models, see [Models](https://developers.openai.com/api/docs/models) in the OpenAI documentation.

#### Mistral

| Models | Category | Input | Output | Additional Capabilities |
| --- | --- | --- | --- | --- |
| Mistral Large 3, Mistral Medium 3.1, Mistral Small 3.2, Ministral 3 (3B, 8B, 14B), Magistral (Small, Medium) | Chat completions | text, image | text | Function calling |
| Codestral, Devstral (Small, Medium), Open Mistral 7B, Mistral Nemo 12B | Chat completions | text | text | Function calling |
| Mistral Small 4, Mistral Medium 3.5, Mistral Large 3, Ministral 3 (3B, 8B, 14B), and more | Chat completions | text, image | text | Function calling |

@dbreseman dbreseman Jun 11, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What exactly does "and more" mean here? Are all Mistral generalist models from https://docs.mistral.ai/models/overview supported?

| Codestral, Devstral | Chat completions | text | text | Function calling |
| (Open) Mistral Nemo 12B | Chat completions | text | text | |
| Mistral Embed, Codestral Embed | Embeddings | text | embeddings | |

For a list of all Mistral models, see [Models Overview](https://docs.mistral.ai/models/overview) in the Mistral documentation.

#### Google Gemini

| Models | Category | Input | Output | Additional Capabilities |
| --- | --- | --- | --- | --- |
| Gemini 2.5 Flash (+ Preview Sep 2025), Gemini 2.5 Flash-Lite (+ Preview Sep 2025), Gemini 2.5 Pro, Gemini Flash Latest, Gemini Flash-Lite Latest, Gemini Pro Latest | Chat completions | text, image | text | Function calling |
| Gemini 3 Flash Preview, Gemini 3 Pro Preview | Chat completions | text, image | text | |
| Gemini 2.5 Flash, Gemini 2.5 Flash-Lite, Gemini 2.5 Pro, Gemini Flash Latest, Gemini Flash-Lite Latest, Gemini Pro Latest | Chat completions | text, image | text | Function calling |
| Gemini 3 Flash Preview, Gemini 3.1 Flash-Lite, Gemini 3.1 Pro Preview, Gemini 3.5 Flash | Chat completions | text, image | text | |

#### Amazon Bedrock

| Models | Category | Input | Output | Additional Capabilities |
| --- | --- | --- | --- | --- |
| Amazon Titan Text G1 - Express, Amazon Titan Text G1 - Lite, Amazon Titan Text G1 - Premier | Chat completions | text, document (except Titan Premier) | text | |
| AI21 Jamba-Instruct | Chat completions | text | text | |
| AI21 Labs Jurassic-2 (Text) | Chat completions | text | text | |
| Amazon Nova Pro, Amazon Nova Lite | Chat completions | text, image, document | text | Function calling |
| Amazon Titan Image Generator G1 | Image generation | text | image | |
| Amazon Titan Embeddings Text v2 | Embeddings | text | embeddings | |
| Anthropic Claude 3 Sonnet, Anthropic Claude 3.5 Sonnet, Anthropic Claude 3.5 Sonnet v2, Anthropic Claude 3 Haiku, Anthropic Claude 3 Opus, Anthropic Claude 3.5 Haiku, Anthropic Claude 4.5 Sonnet, Anthropic Claude 4.5 Haiku, Anthropic Claude 4.5 Opus | Chat completions | text, image, document | text | Function calling |
| Cohere Command | Chat completions | text, document | text | |
| Cohere Command Light | Chat completions | text | text | |
| Cohere Command R, Cohere Command R+ | Chat completions | text, document | text | Function calling |
| Cohere Embed English, Cohere Embed Multilingual | Embeddings | text | embeddings | |
| DeepSeek, DeepSeek-R1 | Text | text | document | |
| Meta Llama 2, MetaLlama 3 | Chat completions | text, document | text | |
| Meta Llama 3.1 | Chat completions | text, document | text | Function calling |
| Mistral AI Instruct | Chat completions | text, document | text | |
| Mistral Large, Mistral Large 2 | Chat completions | text, document | text | Function calling |
| Mistral Small | Chat completions | text | text | Function calling |
| OpenAI gpt-oss-20B, gpt-oss-120b | Chat completions | text | text | |

For more details on limitations and supported model capabilities for the Bedrock Converse API used in the ChatCompletions operations, see [Supported models and model features](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference-supported-models-features.html) in the AWS documentation.
| Support for providers including Anthropic Claude, DeepSeek, Meta, and OpenAI (OSS models). For all models supporting the Converse API, see [Models at a glance](https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards.html) from Amazon Web Services (AWS). | Chat completions | text, document, image | text | Function calling |

@dbreseman dbreseman Jun 11, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do all of the models in Models at a glance support the Converse API? If not, how should the user determine which ones are relevant?

| Native support for models by Cohere. For all models supporting the InvokeModel API, see [Models at a glance](https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards.html) from AWS.| Embeddings | text | embeddings | |

@dbreseman dbreseman Jun 11, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it fine to update this description to something like "Models supported by Cohere, including Embed v4 and Embed English. For the full list of Cohere models, see Cohere in the AWS documentation."?

| Native support for Titan Image Generator G1 v2 (check availability for your region). For all models supporting the InvokeModel API, see [Models at a glance](https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards.html) from AWS. | Image generation | text | image | |

@dbreseman dbreseman Jun 11, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can this description be simplified to just "Titan Image Generator G1 v2"? Would Mendix need to change something for additional models to be supported, or is this list likely to expand due to changes on Bedrock's side?


For details on limitations and supported model capabilities for the Bedrock Converse API used in the ChatCompletions operations, see [Supported models and model features](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference-supported-models-features.html) in the AWS documentation.

@dbreseman dbreseman Jun 11, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Supported models and model features just redirects to Models at a glance. Okay to remove this paragraph?


#### Connecting to Other Models

Expand Down
23 changes: 6 additions & 17 deletions ...nt/en/docs/marketplace/platform-supported-content/modules/aws/amazon-bedrock.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -232,7 +232,6 @@ To invoke a Bedrock agent for your Mendix app, do the following steps:
* Chat Completions with History
* Chat Completion without History
* Embeddings with Cohere Embed
* Embeddings with Amazon Titan Embeddings

For more information about using this feature, refer to the [GenAI commons documentation](/agents/genai-for-mx/commons/#token-usage).

Expand Down Expand Up @@ -337,19 +336,19 @@ For Titan Image models, the `Image Generation: Add Titan Image Extension` operat

#### Generate Embeddings (String) {#embeddings-single-string}

The [Generate Embeddings (String)](/agents/genai-for-mx/commons/#embeddings-string) activity can be used to generate an embedding vector for a given input string with one of the Cohere Embed models or Titan Embeddings v2.
The [Generate Embeddings (String)](/agents/genai-for-mx/commons/#embeddings-string) activity can be used to generate an embedding vector for a given input string with one of the Cohere Embed models.

For Cohere Embed and Titan Embeddings, the request can be associated to their respective EmbeddingsOptions extension object which can be created with the [Embeddings Options: Add Cohere Embed Extension](#add-cohere-embed-extension) or [Embeddings Options: Add Titan Embeddings Extension](#add-titan-embeddings-extension) operation. Through this extension, it is possible to tailor the operation to more specific needs.
For Cohere Embed, the request can be associated to their respective EmbeddingsOptions extension object which can be created with the [Embeddings Options: Add Cohere Embed Extension](#add-cohere-embed-extension) operation. Through this extension, it is possible to tailor the operation to more specific needs.

Currently, embeddings are available for the Cohere Embed family and or Titan Embeddings v2.
Currently, embeddings are available for the Cohere Embed family.

#### Generate Embeddings (Chunk Collection) {#embeddings-chunk-collection}

The [Generate Embeddings (Chunk Collection)](/agents/genai-for-mx/commons/#embeddings-chunk-collection) activity can be used to generate a collection of embedding vectors for a given collection of text chunks with one of the Cohere Embed models or Titan Embeddings v2.
The [Generate Embeddings (Chunk Collection)](/agents/genai-for-mx/commons/#embeddings-chunk-collection) activity can be used to generate a collection of embedding vectors for a given collection of text chunks with one of the Cohere Embed models.

For each model family, the request can be associated to an extension of the EmbeddingsOptions object which can be created with either the [Embeddings Options: Add Cohere Embed Extension](#add-cohere-embed-extension) or the [Embeddings Options: Add Titan Embeddings Extension](#add-titan-embeddings-extension) operation. Through this extension, it is possible to tailor the operation to more specific needs.
For each model family, the request can be associated to an extension of the EmbeddingsOptions object which can be created with either the [Embeddings Options: Add Cohere Embed Extension](#add-cohere-embed-extension) operation. Through this extension, it is possible to tailor the operation to more specific needs.

Currently, embeddings are available for the Cohere Embed family and Titan Embeddings v2.
Currently, embeddings are available for the Cohere Embed family.

#### Retrieve {#retrieve}

Expand Down Expand Up @@ -443,16 +442,6 @@ This operation corresponds to the **CohereEmbedOptions_Extension_Create** microf
| --- | --- |
| `GenAICommons.EmbeddingsOptions (object)`, `InputType (enumeration)`, `EmbeddingTypes (enumeration, optional)`, `Truncate (enumeration, optional)` | `CohereEmbedOptions_Extension (object)`|

#### Embeddings Options: Add Titan Embeddings Extension {#add-titan-embeddings-extension}

Use this microflow to add a new TitanEmbeddingsOptions_Extension object to your `EmbeddingsOptions` object. You can use it to include parameters that are unique to Titan Embeddings models.

This operation corresponds to the **TitanEmbeddingsOptions_Extension_Create** microflow.

| Input | Output |
| --- | --- |
| `GenAICommons.EmbeddingsOptions (object)`, `Normalize (boolean)`| `TitanEmbeddingsOptions_Extension (object)`|

#### Set Bedrock Retrieve Options {#add-r-extension}

Use this microflow to add a new RetrieveRequest_Extension object to your request. This is required in order to use the [Retrieve](#retrieve) activity.
Expand Down
Loading