Event processing with Versity S3 Gateway and BeeGFS gRPC event notifications

2 months ago
2

BeeGFS v8 features a new notification mechanism that uses gRPC. The Versity S3 Gateway, as the name says, shares filesystem contents via the S3 API.

Because every S3 put triggers a FS event on BeeGFS, we can use gRPC to trigger antivirus scans (as well as other data processing). Secondly, because S3 objects are also files, we can scan them for viruses without downloading from S3. The same pattern can be used for other data-driven pipelines.
More here:
https://scaleoutsean.github.io/2025/06/22/data-pipeline-with-beegfs-file-system-notifications-and-versity-s3-gateway.html

Loading comments...