fdsn-holdings-consumer

Documentation

Overview

fdsn-holdings-consumer receives notifications for the creation of miniSEED objects in AWS S3. Notifications are received from SQS. The the miniSEED file referred to by the notification is fetched and indexed. The results are saved to the holdings DB.

Multiple instances (workers) of this code can be run against the same queue for Large data reindexing tasks. Reindexing files that already exist in the bucket would require sending messages in the notification format to the SQS queue. See github.com/GeoNet/kit/aws/s3 for the Event type.