Support to Delete files from AWS/Azure/FTP File Storage locations

Related products: Software Factory

For the File Storage locations AWS / Azure / FTP there is no standard supported way to delete files. For File Storage location FileSystem a Process action is available to delete files. We would like to be able to use the same/a similar Process action to delete files from other locations for (at least) the following reasons:

  • Integrity & Clean-up: if there is no reference to a file from any record in the Database, there is no use in keeping the file, while still costing us storage capacity
  • GDPR: a potential request based on the right to be forgotten requires to delete both records and files which are related to personally identifiable information of the requestor
Updated idea statusNewOpen

Hi,

This is exactly what seems to be missing.
Right now the File Storage on Azure is basically unusable because you'll end up with a huge pile of unused/dead data.

I'd love to see this 'feature’ in the near future 😀👍


@Marius Korff @Jeroen van den Belt I haven't tested it myself yet, but I assume this is now possible with the new version of the Delete File process action in Release 2022.2 for both Azure and AWS?

One additional remark is worth making though: if you use Versioning on your File Storage it might not delete all versions. For AWS S3 a Delete Marker is added as ‘new’ version of the File, but the original is not really deleted. To fix that we have added a Lifecycle policy. More details can be found here:

https://docs.aws.amazon.com/AmazonS3/latest/userguide/DeletingObjectVersions.html

https://stackoverflow.com/questions/41436132/s3-versioning-why-leave-an-expired-delete-marker-behind