maurice/snix
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

chore(ops): move archivist machine to ops and contrib

Browse source 
contrib/ gets the clickhouse patching, the bucket log parsing code and
the awscli setup and shell.

ops/ gets the machine config itself.

Change-Id: If8b8f8cce5ca9c2b4d19e17be9a8b895ac35e84a
Reviewed-on: https://cl.snix.dev/c/snix/+/30163
Autosubmit: Florian Klink <flokli@flokli.de>
Tested-by: besadii
Reviewed-by: Ryan Lahfa <masterancpp@gmail.com>
This commit is contained in:
Florian Klink 2025-03-19 23:42:36 +00:00 • committed by clbot
parent c3de9e21eb
commit ae4d967288
14 changed files with 21 additions and 40 deletions
Download patch file Download diff file Expand all files Collapse all files

23
contrib/archivist/README.md Normal file
View file

@ -0,0 +1,23 @@
# archivist
This directory contains various scripts and helpers used for nix-archivist tasks.
It's used from the archivist EC2 instance, as well as standalone.
## AWS Profile setup
There's 2 AWS Accounts, reachable via the nixos.awsapps.com SSO portal.
### archeologist
This is assuming the `archeologist` AWS role in the main NixOS account.
### archivist
This is a separate AWS Account, only for the archivist project. We can assume
`AWSAdministratorAccess` in there.
## archivist-ec2 Machine
The `archivist-ec2` machine currently is deployed in the main NixOS account.
It regularly processes S3 bucket logs and dumps them in parquet format into
another bucket.
In the future, we want to move this machine to the dedicated `archivist` AWS
account.