Salt-Orchestrated OpenSource based Software-Defined-Freifunk-Infrastructre-Network configuration

Philipp Fromme 24eedfa9d9 unattended-upgrades: Fix icinga-bullseye origin hai 1 ano
Documentation 80c977116f Doc: Add monitoring rule configuration examples hai 1 ano
_modules 56639cfd8e nftables: Generate set of iBGP peers hai 1 ano
anycast-healthchecker 2455517ceb Add anycast-healthcecker state hai 1 ano
apt bb26185b9c apt: Update Salt to version 3004 %!s(int64=3) %!d(string=hai) anos
apu2 0ae03f896f apu2: Document how to force firmware update. %!s(int64=5) %!d(string=hai) anos
bash 517b3b0d4a bash: Increase history and make sure it's always appended. %!s(int64=5) %!d(string=hai) anos
batman 24ffdc622c Use global root alias for cron job mails %!s(int64=3) %!d(string=hai) anos
bird 7eeb7b9041 bird: Remove problematic characters from BGP peer name hai 1 ano
build 6cb331e575 GIT: Use internal DNS alias for our GIT hai 1 ano
burp 0b3ae3b258 burp: Let server listen on IPv6 %!s(int64=4) %!d(string=hai) anos
certs 42fdb07d21 certs: Allow more flexibal configuration hai 1 ano
dhcp-server fb3141938a Clean up obsolete templates for Debian Stretch (which is long gone) hai 1 ano
dns-server d8ac36a679 bind9: Allow statistics scraping by bind-exporter hai 1 ano
docker 4cf47cbc5f Add docker state. %!s(int64=5) %!d(string=hai) anos
elasticsearch 5b3cbfb6c3 Added elasticsearch config %!s(int64=4) %!d(string=hai) anos
fastd 4e1d44b0f0 fastd: Use SDN to determine B.A.T.M.A.N. adv. iface penalty %!s(int64=2) %!d(string=hai) anos
ffinfo ab3833e402 ffinfo: Store main node role (from NetBox) on the system hai 1 ano
firewall a77faefab6 firewall: Add files to load on boot-up %!s(int64=3) %!d(string=hai) anos
firmware 6cb331e575 GIT: Use internal DNS alias for our GIT hai 1 ano
gogs bef28a1d26 gogs: Replace us-ascii with binary key %!s(int64=3) %!d(string=hai) anos
grafana a59933b2c1 Grafana: Set up Prometheus front end with some dashboards hai 1 ano
graylog 172990e9c3 graylog: Use mongodb with authentication hai 1 ano
icinga2 ea38f8e566 icinga2: Add overdue snapshot check hai 1 ano
icingaweb2 dd46e91fbe icingaweb2: The icingaweb2-module-monitoring pkg doesn't seem required hai 1 ano
influxdb 1ea0d959e7 influxdb: Switch to new repo key hai 1 ano
install-server 57645b4099 Set up install server on infra service VMs hai 1 ano
kernel 5ee6a1bd4e kernel: Install backports Kernel for Buster for B.A.T.M.A.N. iface penalty support %!s(int64=3) %!d(string=hai) anos
kvm 9c7c0bd8b1 KVM: Remove need for ifupdown* to configure VM interfaces hai 1 ano
locales 38c9622968 locales: Store full generatd configuration to avoid unnecessary diff hai 1 ano
mongodb 29b4318138 mongodb: Enable authorization by default hai 1 ano
mosh d243476e23 First bunch of ffho salt configuration files to be public. %!s(int64=8) %!d(string=hai) anos
motd 6605a8fd50 add motd state %!s(int64=7) %!d(string=hai) anos
needrestart d77bad69c3 Install needrestart on all nodes. %!s(int64=4) %!d(string=hai) anos
network 5295aa0bd8 Make ifupdown-ng the default suite to configure interfaces hai 1 ano
nftables 56639cfd8e nftables: Generate set of iBGP peers hai 1 ano
nginx 533917fb8b Update firmware/openwrt redirect path to up-to-date mirror %!s(int64=2) %!d(string=hai) anos
ntp d243476e23 First bunch of ffho salt configuration files to be public. %!s(int64=8) %!d(string=hai) anos
openvpn df8977fb36 openvpn: Add configuration for OPS VPNs %!s(int64=3) %!d(string=hai) anos
postfix bcc3747de7 postfix: smtp_use_tls is legacy and can go away. %!s(int64=2) %!d(string=hai) anos
pppoe 2032bdc052 pppoe: Remove Debian stretch Sonderlocke %!s(int64=3) %!d(string=hai) anos
prometheus-exporters c69ac4fd59 Prometheus: Install bird-exporter on routers hai 1 ano
prometheus-server b1dbf6c161 prometheus-server: Scrape routers (bird_exporter) hai 1 ano
respondd 16d83640de respondd: Start respondd service after network-online target %!s(int64=3) %!d(string=hai) anos
rsyslog 825d0c5915 rsyslog: Rotate slapd logs %!s(int64=3) %!d(string=hai) anos
salt-minion 10f714bd5f salt-minion: python3-tornado isn't required anymore %!s(int64=3) %!d(string=hai) anos
screen d243476e23 First bunch of ffho salt configuration files to be public. %!s(int64=8) %!d(string=hai) anos
slapd ebaf2828e5 Add slapd state to configure LDAP servers. %!s(int64=4) %!d(string=hai) anos
snmpd 89781ebb00 snmpd: Don't generate synthetica bandwidth for VLAN and VXLAN interfaces hai 1 ano
ssh f2e3a9f6ac ssh: Add sshd_config for Debian bullseye %!s(int64=3) %!d(string=hai) anos
sudo f7e5578fe0 sudo: Fix typo, D'oh. hai 1 ano
sury 74dbf64e12 Add sury php repository hai 1 ano
sysctl 67ebce5507 sysctl: Wireguard with fwmark requires udp_l3mdev_accept %!s(int64=2) %!d(string=hai) anos
systemd 1c6d5423bd systemd: Work around new systemd persistent MAC "feature" %!s(int64=3) %!d(string=hai) anos
timezone f07fb87dcd Set system timezone to Europe/Berlin. %!s(int64=5) %!d(string=hai) anos
unattended-upgrades 24eedfa9d9 unattended-upgrades: Fix icinga-bullseye origin hai 1 ano
users 07d06cc8dc Add users statee to manage users and passwords %!s(int64=2) %!d(string=hai) anos
vim 40755b33a6 vim: Do not use the Debian default vimrc. Ever. %!s(int64=4) %!d(string=hai) anos
wireguard 4c2f0c4408 Wireguard: Reflect data structure changes %!s(int64=2) %!d(string=hai) anos
yanic d39f2267be yanic: Forget offline nodes after 14d (instead of 30d) hai 1 ano
.gitignore 5d8869e75a Ignore VIM's *.swp files hai 1 ano
README.md 26bc096db5 Update README hai 1 ano
top.sls 8c0b4f9e3e Highstate Grafana on Prometheus servers hai 1 ano
utils.sls 47b4966ae8 Add simple utils state to list utils worth installing %!s(int64=3) %!d(string=hai) anos

README.md

Freifunk Hochstift infrastructure - SaltStack configuration

This repository contains the Salt environment (states + modules) used to configure the infrastructure of the Freifunk Hochstift community network.

It uses the NetBox Abstraction and Caching Layer (NACL) as its interface to communicate with NetBox, which holds all node specific configuration. This includes the node name, role(s), interfaces, IP addresses, tags, config contexts, etc.

Principles

This whole code base follows the principles of Holistic (network) automation, which means that as much configuration bits are derived from properties of nodes or its relationship(s) to other nodes. This includes but is not limited to, OSPF adjacencies, internal BGP sessions, B.A.T.M.A.N. adv. configuration, Nftables rules, etc.

Most of these bits live inside the Python modules which are included in this repository (see the _modules/ directory), which contains modules for authentication, netfilter, and networking related configuration. The ffho_net modules currently is the heart of our SDN logic, with more recent pieces (e.g. iBGP mesh calculation) living inside NACL. Eventually most logic should move over to NACL or another daemon which takes over the SDN role, so that Salt is only used to apply configuration based on a generic device configuration.

Further Reading

Our CTO, @BarbarossaTM, has started a blog series about our infrastructure, its architecture and evolution and also blogs about NetBox related things, which may or may not be related to this code base - it mostly is though :-)