feat(ops/pipelines): Dynamically generate CI pipeline from targets

Create the pipeline by outputting a file that contains nix-build
invocations for each target's *derivation path*.

Each invocation has a generated Nix expression passed to it with `-E`
which fetches the correct target from the tree while correctly
handling targets with strange characters (such as in Go-packages).

This makes it possible to run target-level granular pipelines. We're
getting somewhere!

Change-Id: Ia6946e389dafd1d4926130bb8891446d6e17133b
Reviewed-on: https://cl.tvl.fyi/c/depot/+/1855
Tested-by: BuildkiteCI
Reviewed-by: glittershark <grfn@gws.fyi>
Reviewed-by: lukegb <lukegb@tvl.fyi>
This commit is contained in:
Vincent Ambo 2020-08-27 01:05:45 +01:00 committed by tazjin
parent 21690c644b
commit 61d2d2d503
6 changed files with 78 additions and 20 deletions

View file

@ -73,9 +73,14 @@ in fix(self: {
# List of all buildable targets, for CI purposes.
#
# Note: This *must* be a nested attribute, otherwise we will get
# infinite recursion and everything blows up.
ci.targets = gather self;
# Note: To prevent infinite recursion, this *must* be a nested
# attribute set (which does not have a __readTree attribute).
ci.targets = gather (self // {
# remove the pipelines themselves from the set over which to
# generate pipelines because that also leads to infinite
# recursion.
ops = self.ops // { pipelines = null; };
});
}
# Add local packages as structured by readTree