Salt-Orchestrated OpenSource based Software-Defined-Freifunk-Infrastructre-Network configuration

Maximilian Wilhelm 89781ebb00 snmpd: Don't generate synthetica bandwidth for VLAN and VXLAN interfaces 1 rok temu
Documentation 80c977116f Doc: Add monitoring rule configuration examples 1 rok temu
_modules 56639cfd8e nftables: Generate set of iBGP peers 1 rok temu
anycast-healthchecker 2455517ceb Add anycast-healthcecker state 1 rok temu
apt bb26185b9c apt: Update Salt to version 3004 3 lat temu
apu2 0ae03f896f apu2: Document how to force firmware update. 5 lat temu
bash 517b3b0d4a bash: Increase history and make sure it's always appended. 5 lat temu
batman 24ffdc622c Use global root alias for cron job mails 3 lat temu
bird 7eeb7b9041 bird: Remove problematic characters from BGP peer name 1 rok temu
build 6cb331e575 GIT: Use internal DNS alias for our GIT 1 rok temu
burp 0b3ae3b258 burp: Let server listen on IPv6 4 lat temu
certs 42fdb07d21 certs: Allow more flexibal configuration 1 rok temu
dhcp-server fb3141938a Clean up obsolete templates for Debian Stretch (which is long gone) 1 rok temu
dns-server d8ac36a679 bind9: Allow statistics scraping by bind-exporter 1 rok temu
docker 4cf47cbc5f Add docker state. 5 lat temu
elasticsearch 5b3cbfb6c3 Added elasticsearch config 4 lat temu
fastd 4e1d44b0f0 fastd: Use SDN to determine B.A.T.M.A.N. adv. iface penalty 2 lat temu
ffinfo ab3833e402 ffinfo: Store main node role (from NetBox) on the system 1 rok temu
firewall a77faefab6 firewall: Add files to load on boot-up 3 lat temu
firmware 6cb331e575 GIT: Use internal DNS alias for our GIT 1 rok temu
gogs bef28a1d26 gogs: Replace us-ascii with binary key 3 lat temu
grafana a59933b2c1 Grafana: Set up Prometheus front end with some dashboards 1 rok temu
graylog 172990e9c3 graylog: Use mongodb with authentication 1 rok temu
icinga2 9619087f37 icinga2: Store primary node role in configuration 1 rok temu
icingaweb2 dd46e91fbe icingaweb2: The icingaweb2-module-monitoring pkg doesn't seem required 1 rok temu
influxdb 1ea0d959e7 influxdb: Switch to new repo key 1 rok temu
install-server 57645b4099 Set up install server on infra service VMs 1 rok temu
kernel 5ee6a1bd4e kernel: Install backports Kernel for Buster for B.A.T.M.A.N. iface penalty support 3 lat temu
kvm 9c7c0bd8b1 KVM: Remove need for ifupdown* to configure VM interfaces 1 rok temu
locales 38c9622968 locales: Store full generatd configuration to avoid unnecessary diff 1 rok temu
mongodb 29b4318138 mongodb: Enable authorization by default 1 rok temu
mosh d243476e23 First bunch of ffho salt configuration files to be public. 8 lat temu
motd 6605a8fd50 add motd state 7 lat temu
needrestart d77bad69c3 Install needrestart on all nodes. 4 lat temu
network 5295aa0bd8 Make ifupdown-ng the default suite to configure interfaces 1 rok temu
nftables 56639cfd8e nftables: Generate set of iBGP peers 1 rok temu
nginx 533917fb8b Update firmware/openwrt redirect path to up-to-date mirror 2 lat temu
ntp d243476e23 First bunch of ffho salt configuration files to be public. 8 lat temu
openvpn df8977fb36 openvpn: Add configuration for OPS VPNs 3 lat temu
postfix bcc3747de7 postfix: smtp_use_tls is legacy and can go away. 2 lat temu
pppoe 2032bdc052 pppoe: Remove Debian stretch Sonderlocke 3 lat temu
prometheus-exporters c69ac4fd59 Prometheus: Install bird-exporter on routers 1 rok temu
prometheus-server b1dbf6c161 prometheus-server: Scrape routers (bird_exporter) 1 rok temu
respondd 16d83640de respondd: Start respondd service after network-online target 3 lat temu
rsyslog 825d0c5915 rsyslog: Rotate slapd logs 3 lat temu
salt-minion 10f714bd5f salt-minion: python3-tornado isn't required anymore 3 lat temu
screen d243476e23 First bunch of ffho salt configuration files to be public. 8 lat temu
slapd ebaf2828e5 Add slapd state to configure LDAP servers. 4 lat temu
snmpd 89781ebb00 snmpd: Don't generate synthetica bandwidth for VLAN and VXLAN interfaces 1 rok temu
ssh f2e3a9f6ac ssh: Add sshd_config for Debian bullseye 3 lat temu
sudo f7e5578fe0 sudo: Fix typo, D'oh. 1 rok temu
sury 74dbf64e12 Add sury php repository 1 rok temu
sysctl 67ebce5507 sysctl: Wireguard with fwmark requires udp_l3mdev_accept 2 lat temu
systemd 1c6d5423bd systemd: Work around new systemd persistent MAC "feature" 3 lat temu
timezone f07fb87dcd Set system timezone to Europe/Berlin. 5 lat temu
unattended-upgrades 51aba08c0b unattended-upgrades: Use Bullseye repos for icinga2/Salt 1 rok temu
users 07d06cc8dc Add users statee to manage users and passwords 2 lat temu
vim 40755b33a6 vim: Do not use the Debian default vimrc. Ever. 4 lat temu
wireguard 4c2f0c4408 Wireguard: Reflect data structure changes 2 lat temu
yanic d39f2267be yanic: Forget offline nodes after 14d (instead of 30d) 1 rok temu
.gitignore 5d8869e75a Ignore VIM's *.swp files 1 rok temu
README.md 26bc096db5 Update README 1 rok temu
top.sls 8c0b4f9e3e Highstate Grafana on Prometheus servers 1 rok temu
utils.sls 47b4966ae8 Add simple utils state to list utils worth installing 3 lat temu

README.md

Freifunk Hochstift infrastructure - SaltStack configuration

This repository contains the Salt environment (states + modules) used to configure the infrastructure of the Freifunk Hochstift community network.

It uses the NetBox Abstraction and Caching Layer (NACL) as its interface to communicate with NetBox, which holds all node specific configuration. This includes the node name, role(s), interfaces, IP addresses, tags, config contexts, etc.

Principles

This whole code base follows the principles of Holistic (network) automation, which means that as much configuration bits are derived from properties of nodes or its relationship(s) to other nodes. This includes but is not limited to, OSPF adjacencies, internal BGP sessions, B.A.T.M.A.N. adv. configuration, Nftables rules, etc.

Most of these bits live inside the Python modules which are included in this repository (see the _modules/ directory), which contains modules for authentication, netfilter, and networking related configuration. The ffho_net modules currently is the heart of our SDN logic, with more recent pieces (e.g. iBGP mesh calculation) living inside NACL. Eventually most logic should move over to NACL or another daemon which takes over the SDN role, so that Salt is only used to apply configuration based on a generic device configuration.

Further Reading

Our CTO, @BarbarossaTM, has started a blog series about our infrastructure, its architecture and evolution and also blogs about NetBox related things, which may or may not be related to this code base - it mostly is though :-)