Yesterday I spoke with ​@Ricardo about our SF database which is almost 265gb. Quite large, and also in need of maintenance. I also found some very, very old records… 

Currently on 25.1 and very interested in how this can be optimized/cleaned.

Blommetje

Hi Marijn,

We are currently working on a feature for this that will allow developers to clean their Software Factory database of old data. We indeed already have the task to clean-up history data for removed and archived branches. We are expanding this functionality to also be able to clean history data for active branches, taking into account the model versions of the model.

In essence, we want to give developers the ability to clean up branches and remove history data that is no longer relevant for development. For instance, you can clean up all records prior to 2024-01-01 stored in history tables. We are in the midst of working on it. However, I cannot say for sure it will make the 2025.3 release as we need to test this thoroughly.

We could opt to place Retention periods on the Software Factory tables, but the downside is that history data will be removed automatically with no way of preventing that. For most customers, this will not be any issue, but for others it may be. So defining a proper generic retention period for everyone is a tough call to make.

Sounds good ​@Mark Jongeling . Is your advice for us to just normally upgrade to 2025.2 and wait for the feature you are working on? Will the scheduled clean flow of Thinkwise not be a problem? It will possibly try to remove too many rows in one go.

Hi Marijn, 

We currently may have a way to clean up data without any model changes, so if this method is deemed successful, we can hotfix this to older versions as well. The clean-up could indeed be a little heavy initially, but this new (experimental) method should no longer have the potential of being unlinked with its history table may the process be killed for any reason.

We currently have disabled the clean-up part in the task, so no worries.

You can freely upgrade to 2025.2, and also enjoy the other features that have been added to the platform 

Hi ​@Marijn Metzlar,

We have released a hotfix yesterday that re-enables the history deletion part of the Clean-up model history task.

This means the history data is removed in small transactions and can be run whilst people continue to work in the Software Factory. We ensured that when history is cleaned up, there is a brief window in which waiting transactions can continue so this deletion is not holding up development too much.

For 2024.3, 2025.1 and 2025.2 it has been fixed, and in the upcoming 2025.3 of course too