maurice/snix
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
snix/users/flokli/archivist
History
Florian Klink 2bdb497c85 refactor(users/flokli): unify archeology and archivist 
This merges the two directories together, and explains the two different
AWS profiles and what they're used for.

Change-Id: Ieaa09be5af02491056f5ad83b1d639e2de9a218b
Reviewed-on: https://cl.snix.dev/c/snix/+/30102
Autosubmit: Florian Klink <flokli@flokli.de>
Reviewed-by: Ryan Lahfa <masterancpp@gmail.com>
Tested-by: besadii
2025-03-18 17:23:37 +00:00
..
default.nix refactor(users/flokli): unify archeology and archivist 2025-03-18 17:23:37 +00:00
OWNERS feat(users/flokli/archivist): init 2023-11-25 16:17:46 +00:00
parse_bucket_logs.rs refactor(users/flokli): unify archeology and archivist 2025-03-18 17:23:37 +00:00
README.md refactor(users/flokli): unify archeology and archivist 2025-03-18 17:23:37 +00:00

README.md

archivist

This directory contains various scripts and helpers used for nix-archivist tasks.

It's used from some of the archivist EC2 instance, as well as standalone.

AWS Profile setup

There's 2 AWS Accounts, reachable via the nixos.awsapps.com SSO portal.

archeologist

This is assuming the archeologist AWS role in the main NixOS account.

archivist

This is a separate AWS Account, only for the archivist project. We can assume AWSAdministratorAccess in there.

Machine

The archivist-ec2 machine currently is deployed in the main NixOS account.

It regularly processes S3 bucket logs and dumps them in parquet format into another bucket. In the future, we want to move this machine to the dedicated archivist AWS account.