Skip to main content
Completed

Connect software factory with local LLM

Related products:Software FactoryIndicium Service Tier
  • February 23, 2025
  • 6 replies
  • 100 views

Forum|alt.badge.img+13

In conjunction with:

It could be a good addition for the software factory to be able to connect to a highly specialized on-premise LLM instance for reviewing and writing SQL code. This LLM instance would have full access to our database but because it doesn’t need access to the outside world our data would remain safe.

6 replies

Ricky
Superhero
Forum|alt.badge.img+8
  • Superhero
  • February 24, 2025

This indeed will be an excellent feature.

I was wondering ​@Mark Jongeling, do you have an LLM currently learning the whole idea on how the SF works? For example to give advice when or when not to use a template or make it dedicated for a certain item/feature/object, or maybe explicitly suggesting to apply dynamic logic, or to separate/split domains due to their usage in the model etc etc etc...

 


Mark Jongeling
Administrator
Forum|alt.badge.img+23
  • Administrator
  • February 24, 2025

We are currently working on something more generic than just the SF and IAM. This LLM model would then be able to work effectively for all customers. A demo was given during last years’ Thinkwise Summit. The way you would give information to the LLM via the model would be the same way we could provide info about the IAM and SF models. 


Jeroen van den Belt
Administrator
Forum|alt.badge.img+10
NewOpen

Mark Jongeling
Administrator
Forum|alt.badge.img+23
  • Administrator
  • September 10, 2025
OpenWorking on it!

Arie V
Community Manager
Forum|alt.badge.img+12
  • Community Manager
  • November 26, 2025
Working on it!Completed

Arie V
Community Manager
Forum|alt.badge.img+12
  • Community Manager
  • November 26, 2025

With Thinkwise Platform release 2025.3 we have made it possible to integrate with any OpenAI-compatible AI model. As most LLMs are OpenAI-compatible, this means you can now use almost any LLM with the Thinkwise Platform, including Open-Source models which you could host yourself. Some examples:

Note that you need at least Indicium 2025.3.12 to get these models working.