For IP Addresses, we need to do the comparison using `to_string` instead of `to_s` so we also get the cidr. https://github.com/ipaddress-gem/ipaddress/blob/064502c6a943f983cabea38fccdb528ad9469aec/lib/ipaddress/ipv4.rb#L179