Update METjson2db to react to events

[ian-noaa]

Problem

In the cloud, METjson2db will need to react to events from SQS. It will be deployed in Kubernetes, and so will need to be able to do so with minimal config changes between runs outside of what's been added to the stat file tarballs.

Solution

A concise description of the solution to this problem.

No Go's

Describe any features or behaviors that have been considered and rejected as out of scope for this feature

Additional context

• In the short term, we will need to be able to be cron-driven as well as event-driven.
• We will want to be able to mock out calls to SQS for unit testing
• We will want an example SQS payload
• This work will need Update METjson2db to interact with object storage #54 as the SQS payload be an S3 Event

[ian-noaa]

Sample event structure. This is an S3 event, broadcast through SNS, into our application's SQS queue.

We'll want to unpack the stringified JSON in the "Message" field. That stringified JSON has bucket.name and object.key fields.

{
  "Type" : "Notification",
  "MessageId" : "5b592a3f-bbce-53ff-b61c-4b16e8630297",
  "TopicArn" : "arn:aws:sns:us-east-1:123901341784:NewNBMGRIBObject",
  "Subject" : "Amazon S3 Notification",
  "Message" : "{\"Records\":[{\"eventVersion\":\"2.1\",\"eventSource\":\"aws:s3\",\"awsRegion\":\"us-east-1\",\"eventTime\":\"2025-08-27T18:41:49.474Z\",\"eventName\":\"ObjectCreated:Put\",\"userIdentity\":{\"principalId\":\"AWS:AIDAJSLYAQIR3HHVYDOK2\"},\"requestParameters\":{\"sourceIPAddress\":\"34.195.147.78\"},\"responseElements\":{\"x-amz-request-id\":\"0MKS1RWDYT1CX574\",\"x-amz-id-2\":\"SP7hruFxIYbCRsJ+7HY79a2ee75rkhFxe2qMxhT6TlJ/hvyv6P9fQSqznAq/RsmWJA9EkkbecEY6pBolSkQ42Nonyie32AQfIfSBlIo6GUs=\"},\"s3\":{\"s3SchemaVersion\":\"1.0\",\"configurationId\":\"NewObjects\",\"bucket\":{\"name\":\"noaa-nbm-grib2-pds\",\"ownerIdentity\":{\"principalId\":\"A2AJV00K47QOI1\"},\"arn\":\"arn:aws:s3:::noaa-nbm-grib2-pds\"},\"object\":{\"key\":\"blend.20250827/12/qmd/blend.t12z.qmd.f042.pr.grib2\",\"size\":9337693,\"eTag\":\"78b79d512b65ec30905bcb544030dcab\",\"sequencer\":\"0068AF516D4CB31AA2\"}}}]}",
  "Timestamp" : "2025-08-27T18:41:49.964Z",
  "SignatureVersion" : "1",
  "Signature" : "Tz2sgHZp/uRbnsivCP+U4lkEaUd2yXFdElO/IwBA6q8ME+i8i03x81xiH6SYaFI+gD6VBTR95IYzahetGjxS3V/B3rQdV7O5ydfChbCEu8KmHuMu9nXoT2b97evrpYiUrlQwOzWZA0lnlXwPdsvWOgS+cmH38Yxf/wUidOQ1gvBLDlIimX4P7vHLeP1iSjUGsZ+oZ1WbKctZg91dp1s5hpZcRHty5Zvd5zqF/jI4JtGgcnSAPOdwBqf80m3Aw+oyjHdJPM8pIOjwloRfY/RbJsvF5GhHxTTqiC3Kltw9qsiSmjPSy+We/ZcWHiUIcW1MKxK4zd7f91GO1YxBnUYK1A==",
  "SigningCertURL" : "https://sns.us-east-1.amazonaws.com/SimpleNotificationService-6209c161c6221fdf56ec1eb5c821d112.pem",
  "UnsubscribeURL" : "https://sns.us-east-1.amazonaws.com/?Action=Unsubscribe&SubscriptionArn=arn:aws:sns:us-east-1:123901341784:NewNBMGRIBObject:d0df3ff2-aa8e-4c59-9153-26862d9d861d"
}