Salt-Orchestrated OpenSource based Software-Defined-Freifunk-Infrastructre-Network configuration

Philipp Fromme 24eedfa9d9 unattended-upgrades: Fix icinga-bullseye origin 1 jaar geleden
Documentation 80c977116f Doc: Add monitoring rule configuration examples 1 jaar geleden
_modules 56639cfd8e nftables: Generate set of iBGP peers 1 jaar geleden
anycast-healthchecker 2455517ceb Add anycast-healthcecker state 1 jaar geleden
apt bb26185b9c apt: Update Salt to version 3004 3 jaren geleden
apu2 0ae03f896f apu2: Document how to force firmware update. 5 jaren geleden
bash 517b3b0d4a bash: Increase history and make sure it's always appended. 5 jaren geleden
batman 24ffdc622c Use global root alias for cron job mails 3 jaren geleden
bird 7eeb7b9041 bird: Remove problematic characters from BGP peer name 1 jaar geleden
build 6cb331e575 GIT: Use internal DNS alias for our GIT 1 jaar geleden
burp 0b3ae3b258 burp: Let server listen on IPv6 4 jaren geleden
certs 42fdb07d21 certs: Allow more flexibal configuration 1 jaar geleden
dhcp-server fb3141938a Clean up obsolete templates for Debian Stretch (which is long gone) 1 jaar geleden
dns-server d8ac36a679 bind9: Allow statistics scraping by bind-exporter 1 jaar geleden
docker 4cf47cbc5f Add docker state. 5 jaren geleden
elasticsearch 5b3cbfb6c3 Added elasticsearch config 4 jaren geleden
fastd 4e1d44b0f0 fastd: Use SDN to determine B.A.T.M.A.N. adv. iface penalty 2 jaren geleden
ffinfo ab3833e402 ffinfo: Store main node role (from NetBox) on the system 1 jaar geleden
firewall a77faefab6 firewall: Add files to load on boot-up 3 jaren geleden
firmware 6cb331e575 GIT: Use internal DNS alias for our GIT 1 jaar geleden
gogs bef28a1d26 gogs: Replace us-ascii with binary key 3 jaren geleden
grafana a59933b2c1 Grafana: Set up Prometheus front end with some dashboards 1 jaar geleden
graylog 172990e9c3 graylog: Use mongodb with authentication 1 jaar geleden
icinga2 ea38f8e566 icinga2: Add overdue snapshot check 1 jaar geleden
icingaweb2 dd46e91fbe icingaweb2: The icingaweb2-module-monitoring pkg doesn't seem required 1 jaar geleden
influxdb 1ea0d959e7 influxdb: Switch to new repo key 1 jaar geleden
install-server 57645b4099 Set up install server on infra service VMs 1 jaar geleden
kernel 5ee6a1bd4e kernel: Install backports Kernel for Buster for B.A.T.M.A.N. iface penalty support 3 jaren geleden
kvm 9c7c0bd8b1 KVM: Remove need for ifupdown* to configure VM interfaces 1 jaar geleden
locales 38c9622968 locales: Store full generatd configuration to avoid unnecessary diff 1 jaar geleden
mongodb 29b4318138 mongodb: Enable authorization by default 1 jaar geleden
mosh d243476e23 First bunch of ffho salt configuration files to be public. 8 jaren geleden
motd 6605a8fd50 add motd state 7 jaren geleden
needrestart d77bad69c3 Install needrestart on all nodes. 4 jaren geleden
network 5295aa0bd8 Make ifupdown-ng the default suite to configure interfaces 1 jaar geleden
nftables 56639cfd8e nftables: Generate set of iBGP peers 1 jaar geleden
nginx 533917fb8b Update firmware/openwrt redirect path to up-to-date mirror 2 jaren geleden
ntp d243476e23 First bunch of ffho salt configuration files to be public. 8 jaren geleden
openvpn df8977fb36 openvpn: Add configuration for OPS VPNs 3 jaren geleden
postfix bcc3747de7 postfix: smtp_use_tls is legacy and can go away. 2 jaren geleden
pppoe 2032bdc052 pppoe: Remove Debian stretch Sonderlocke 3 jaren geleden
prometheus-exporters c69ac4fd59 Prometheus: Install bird-exporter on routers 1 jaar geleden
prometheus-server b1dbf6c161 prometheus-server: Scrape routers (bird_exporter) 1 jaar geleden
respondd 16d83640de respondd: Start respondd service after network-online target 3 jaren geleden
rsyslog 825d0c5915 rsyslog: Rotate slapd logs 3 jaren geleden
salt-minion 10f714bd5f salt-minion: python3-tornado isn't required anymore 3 jaren geleden
screen d243476e23 First bunch of ffho salt configuration files to be public. 8 jaren geleden
slapd ebaf2828e5 Add slapd state to configure LDAP servers. 4 jaren geleden
snmpd 89781ebb00 snmpd: Don't generate synthetica bandwidth for VLAN and VXLAN interfaces 1 jaar geleden
ssh f2e3a9f6ac ssh: Add sshd_config for Debian bullseye 3 jaren geleden
sudo f7e5578fe0 sudo: Fix typo, D'oh. 1 jaar geleden
sury 74dbf64e12 Add sury php repository 1 jaar geleden
sysctl 67ebce5507 sysctl: Wireguard with fwmark requires udp_l3mdev_accept 2 jaren geleden
systemd 1c6d5423bd systemd: Work around new systemd persistent MAC "feature" 3 jaren geleden
timezone f07fb87dcd Set system timezone to Europe/Berlin. 5 jaren geleden
unattended-upgrades 24eedfa9d9 unattended-upgrades: Fix icinga-bullseye origin 1 jaar geleden
users 07d06cc8dc Add users statee to manage users and passwords 2 jaren geleden
vim 40755b33a6 vim: Do not use the Debian default vimrc. Ever. 4 jaren geleden
wireguard 4c2f0c4408 Wireguard: Reflect data structure changes 2 jaren geleden
yanic d39f2267be yanic: Forget offline nodes after 14d (instead of 30d) 1 jaar geleden
.gitignore 5d8869e75a Ignore VIM's *.swp files 1 jaar geleden
README.md 26bc096db5 Update README 1 jaar geleden
top.sls 8c0b4f9e3e Highstate Grafana on Prometheus servers 1 jaar geleden
utils.sls 47b4966ae8 Add simple utils state to list utils worth installing 3 jaren geleden

README.md

Freifunk Hochstift infrastructure - SaltStack configuration

This repository contains the Salt environment (states + modules) used to configure the infrastructure of the Freifunk Hochstift community network.

It uses the NetBox Abstraction and Caching Layer (NACL) as its interface to communicate with NetBox, which holds all node specific configuration. This includes the node name, role(s), interfaces, IP addresses, tags, config contexts, etc.

Principles

This whole code base follows the principles of Holistic (network) automation, which means that as much configuration bits are derived from properties of nodes or its relationship(s) to other nodes. This includes but is not limited to, OSPF adjacencies, internal BGP sessions, B.A.T.M.A.N. adv. configuration, Nftables rules, etc.

Most of these bits live inside the Python modules which are included in this repository (see the _modules/ directory), which contains modules for authentication, netfilter, and networking related configuration. The ffho_net modules currently is the heart of our SDN logic, with more recent pieces (e.g. iBGP mesh calculation) living inside NACL. Eventually most logic should move over to NACL or another daemon which takes over the SDN role, so that Salt is only used to apply configuration based on a generic device configuration.

Further Reading

Our CTO, @BarbarossaTM, has started a blog series about our infrastructure, its architecture and evolution and also blogs about NetBox related things, which may or may not be related to this code base - it mostly is though :-)