Salt-Orchestrated OpenSource based Software-Defined-Freifunk-Infrastructre-Network configuration

Maximilian Wilhelm b1dbf6c161 prometheus-server: Scrape routers (bird_exporter) 1 gadu atpakaļ
Documentation c35d5ff817 Examples: Update DNS example pillar 1 gadu atpakaļ
_modules 8416ee42b4 nftables: Check for system role too when calculating monitoring config 1 gadu atpakaļ
anycast-healthchecker 2455517ceb Add anycast-healthcecker state 1 gadu atpakaļ
apt bb26185b9c apt: Update Salt to version 3004 3 gadi atpakaļ
apu2 0ae03f896f apu2: Document how to force firmware update. 5 gadi atpakaļ
bash 517b3b0d4a bash: Increase history and make sure it's always appended. 5 gadi atpakaļ
batman 24ffdc622c Use global root alias for cron job mails 3 gadi atpakaļ
bird 49004e4a9b Bird/Icinga2: Bird related monitoring config should ship with bird 1 gadu atpakaļ
build 6cb331e575 GIT: Use internal DNS alias for our GIT 1 gadu atpakaļ
burp 0b3ae3b258 burp: Let server listen on IPv6 4 gadi atpakaļ
certs 42fdb07d21 certs: Allow more flexibal configuration 1 gadu atpakaļ
dhcp-server fb3141938a Clean up obsolete templates for Debian Stretch (which is long gone) 1 gadu atpakaļ
dns-server d8ac36a679 bind9: Allow statistics scraping by bind-exporter 1 gadu atpakaļ
docker 4cf47cbc5f Add docker state. 5 gadi atpakaļ
elasticsearch 5b3cbfb6c3 Added elasticsearch config 4 gadi atpakaļ
fastd 4e1d44b0f0 fastd: Use SDN to determine B.A.T.M.A.N. adv. iface penalty 2 gadi atpakaļ
ffinfo ab3833e402 ffinfo: Store main node role (from NetBox) on the system 1 gadu atpakaļ
firewall a77faefab6 firewall: Add files to load on boot-up 3 gadi atpakaļ
firmware 6cb331e575 GIT: Use internal DNS alias for our GIT 1 gadu atpakaļ
gogs bef28a1d26 gogs: Replace us-ascii with binary key 3 gadi atpakaļ
grafana 3109dffb24 grafana: Switch to new repo URL 1 gadu atpakaļ
graylog 1f8ffd3a77 graylog: Use keystore to verify ldap connection 1 gadu atpakaļ
icinga2 3594940a1d Icinga2: Read NS replica information from DNS pillar 1 gadu atpakaļ
icingaweb2 dd46e91fbe icingaweb2: The icingaweb2-module-monitoring pkg doesn't seem required 1 gadu atpakaļ
influxdb 1ea0d959e7 influxdb: Switch to new repo key 1 gadu atpakaļ
install-server 57645b4099 Set up install server on infra service VMs 1 gadu atpakaļ
kernel 5ee6a1bd4e kernel: Install backports Kernel for Buster for B.A.T.M.A.N. iface penalty support 3 gadi atpakaļ
kvm 9c7c0bd8b1 KVM: Remove need for ifupdown* to configure VM interfaces 1 gadu atpakaļ
locales 38c9622968 locales: Store full generatd configuration to avoid unnecessary diff 1 gadu atpakaļ
mongodb efcc12bfd4 mongodb: Set repo version by variable 1 gadu atpakaļ
mosh d243476e23 First bunch of ffho salt configuration files to be public. 8 gadi atpakaļ
motd 6605a8fd50 add motd state 7 gadi atpakaļ
needrestart d77bad69c3 Install needrestart on all nodes. 4 gadi atpakaļ
network 5295aa0bd8 Make ifupdown-ng the default suite to configure interfaces 1 gadu atpakaļ
nftables 5998da7d83 nftables: Allow specifying node role specific monitoring services 1 gadu atpakaļ
nginx 533917fb8b Update firmware/openwrt redirect path to up-to-date mirror 2 gadi atpakaļ
ntp d243476e23 First bunch of ffho salt configuration files to be public. 8 gadi atpakaļ
openvpn df8977fb36 openvpn: Add configuration for OPS VPNs 3 gadi atpakaļ
postfix bcc3747de7 postfix: smtp_use_tls is legacy and can go away. 2 gadi atpakaļ
pppoe 2032bdc052 pppoe: Remove Debian stretch Sonderlocke 3 gadi atpakaļ
prometheus-exporters c69ac4fd59 Prometheus: Install bird-exporter on routers 1 gadu atpakaļ
prometheus-server b1dbf6c161 prometheus-server: Scrape routers (bird_exporter) 1 gadu atpakaļ
respondd 16d83640de respondd: Start respondd service after network-online target 3 gadi atpakaļ
rsyslog 825d0c5915 rsyslog: Rotate slapd logs 3 gadi atpakaļ
salt-minion 10f714bd5f salt-minion: python3-tornado isn't required anymore 3 gadi atpakaļ
screen d243476e23 First bunch of ffho salt configuration files to be public. 8 gadi atpakaļ
slapd ebaf2828e5 Add slapd state to configure LDAP servers. 4 gadi atpakaļ
snmpd b408b8d06f snmpd: Generate interface configs for VMs running on this host 2 gadi atpakaļ
ssh f2e3a9f6ac ssh: Add sshd_config for Debian bullseye 3 gadi atpakaļ
sudo f7e5578fe0 sudo: Fix typo, D'oh. 1 gadu atpakaļ
sury 74dbf64e12 Add sury php repository 1 gadu atpakaļ
sysctl 67ebce5507 sysctl: Wireguard with fwmark requires udp_l3mdev_accept 2 gadi atpakaļ
systemd 1c6d5423bd systemd: Work around new systemd persistent MAC "feature" 3 gadi atpakaļ
timezone f07fb87dcd Set system timezone to Europe/Berlin. 5 gadi atpakaļ
unattended-upgrades 51aba08c0b unattended-upgrades: Use Bullseye repos for icinga2/Salt 1 gadu atpakaļ
users 07d06cc8dc Add users statee to manage users and passwords 2 gadi atpakaļ
vim 40755b33a6 vim: Do not use the Debian default vimrc. Ever. 4 gadi atpakaļ
wireguard 4c2f0c4408 Wireguard: Reflect data structure changes 2 gadi atpakaļ
yanic d39f2267be yanic: Forget offline nodes after 14d (instead of 30d) 1 gadu atpakaļ
.gitignore 5d8869e75a Ignore VIM's *.swp files 1 gadu atpakaļ
README.md 26bc096db5 Update README 1 gadu atpakaļ
top.sls e10852f001 Install Set up nginx reverse proxy on Prometheus servers 1 gadu atpakaļ
utils.sls 47b4966ae8 Add simple utils state to list utils worth installing 3 gadi atpakaļ

README.md

Freifunk Hochstift infrastructure - SaltStack configuration

This repository contains the Salt environment (states + modules) used to configure the infrastructure of the Freifunk Hochstift community network.

It uses the NetBox Abstraction and Caching Layer (NACL) as its interface to communicate with NetBox, which holds all node specific configuration. This includes the node name, role(s), interfaces, IP addresses, tags, config contexts, etc.

Principles

This whole code base follows the principles of Holistic (network) automation, which means that as much configuration bits are derived from properties of nodes or its relationship(s) to other nodes. This includes but is not limited to, OSPF adjacencies, internal BGP sessions, B.A.T.M.A.N. adv. configuration, Nftables rules, etc.

Most of these bits live inside the Python modules which are included in this repository (see the _modules/ directory), which contains modules for authentication, netfilter, and networking related configuration. The ffho_net modules currently is the heart of our SDN logic, with more recent pieces (e.g. iBGP mesh calculation) living inside NACL. Eventually most logic should move over to NACL or another daemon which takes over the SDN role, so that Salt is only used to apply configuration based on a generic device configuration.

Further Reading

Our CTO, @BarbarossaTM, has started a blog series about our infrastructure, its architecture and evolution and also blogs about NetBox related things, which may or may not be related to this code base - it mostly is though :-)