Networking

Networking

Networking Section
Networking Section

Networking

Starting at the top of the rack, we first encounter the networking devices. Here’s a little diagram of how the flow works

      flowchart LR
    A(Modem) --> B(Firewall)
    B --> C{Switch}
    C --> D{Unifi U7 InWall}
    C --> E{Unifi U7 Lite}
    C --> J(Wired Clients)
    C --> H(10GbE Clients)
    D --> F(Wired Clients)
    D --> G(WiFi Clients)
    E --> I(WiFi Clients)

Below is a detailed explaination of each device’s purpose and role.

Internet

Internet is provided by an Xfinity 300/100 Cable connection. I’m not a fan of renting the ISP’s equipment, so we went with a Hitron CODA56 DOCSIS 3.1 ($120) cable modem.

The cable modem is connected via 1GB ethernet to the WAN port of the firewall.

Firewall

The firewall is a bit of a custom box that will be hard to replicate. The main board is a PC Engines APU4d4 ($168) that unfortunately, isn’t being made anymore. The PC Engines boards are a great value and really fun to work with.

The APU board is stuffed into a varia-store 1U case ($80?) that I’m not even sure how much I paid for. The site is in German (I can’t speak German) and was interesting to use their configurator to order the proper parts (case, powersupply, etc.), but it all works perfectly.

All of this gear is running pfSense though I will be migrating to opnSense sometime in the future.

I won’t detail out any configuration but some of the technologies running on the firewall are:

  • DNS
  • VLANs
  • DHCP
  • Firewall Rules (some scheduled)
  • NAT
  • IPsec site-to-site VPNs (for the offsite connections)
  • WireGuard VPNs (for clients)

The LAN side ports are all connected to the switches via 1GB ethernet.

Switching

Switching is handled by a number of devices.

Make Model Price Purpose
Brocade ICX7250-48P-2X10G ~$100 eBay Main Switch
Ubiquiti Unifi Switch 48 POE ~$600 Not Used
Ubiquiti Unifi Flex Mini $30 Office
Ubiquiti Unifi Flex Mini $30 Main TV

Brocade ICX7250-48P-2x10G

The Brocade is awesome. There’s a solid write up on Serve The Home which details out the features of a number of Brocade switches. I chose the ICX7250-48P-2x10G for the following reasons:

  • 48 POE+ gigabit ports
  • 8x 10GbE ports (for compute nodes and storage)
  • Low cost
  • Modifiable (replacement fans)
  • Layer 3 routing

It’s cool to get all of those features in a single low-cost device and not having to split up the duties to multiple expensive pieces of hardware. Yes, it introduces a single point of failure, but enterprise grade switches tend to be pretty bullet proof and this is an area I’m willing to risk fault tolerance.

The one big downside for me is that the standard fans are very loud. I have a project lined up to replace the fans and may document that here.

Ubiquiti Unifi Switch 48 POE

This switch is great, but it’s not currently in use. It’s hard to get rid of it because I’m still debating how to put it back in the lineup. It’s relatively low cost, has 48 gigabit (32 are POE+) ports, and is fanless!

Ubiquiti Unifi Flex Mini

These things are awesome. For $30 you get five managed gigabit ports. One port is an uplink port, and allows you to power the whole switch with POE+! I have one in my office, and one behind our main TV. Each of the ports are configurable through the Unifi Network Controller Application. So, you can toggle VLANS, rename ports, all that right through the web app, or mobile app.

WiFi

Again, we have a few devices used for WiFi coverage.

Make Model Price Purpose
Ubiquiti Unifi U7 InWall $150 Main Bedroom
Ubiquiti Unifi U7 Lite $100 Basement

The U7 InWall is cool because it provides both WiFi and Wired connectivity options. I use it as both a WiFi access point, and to provide wired connections to the media devices in our Main bedroom. Again, it has a POE passthrough port, so you can power one external POE device too. I like POE.

Patch Panels

To help keep the cabling tidy, we have two path panels in the rack, and one overhead. The overhead path panel is the termination point for all drops running through the house. Each room has at least two drops. Some rooms have more drops (for TVs, gaming consoles, etc.).