The way in which the system (and specifically, the crawler) is a mess.
There are currently multiple disparate config files, some of which are optional.
We should really look at tidying those up - whether that's by collapsing into a single config file (probably YAML as we're already shipping pyyaml as a dep)
Activity
24-Aug-24 10:35
assigned to @btasker