Setup Indexing 3+ million IP addresses
In the next few blog posts I’m going to go into detail on creating an IP mapping service: IPbot. One of the first challanges was being able to efficiently query three million IP addresses and their associated metadata.
Using MaxMind’s free GeoLite data:
GeoLite2 IP databases
I got a set of some three million addresses and their associated metadata.
My first approach used SQLite for its ease of set up and ingestion but I discovered it took quite a long time to return a single record.
Road Map I wanted to automate the tedious and error-prone process of creating a Redis instance that I could reuse when going between my laptop and a remote serer. I settled on writing an Ansible playbook for deploying a secured and optimized Redis instance.
Based originally on DigitalOcean’s guide to deploying a Redis instance:
How to install and configure redis on Ubuntu 16.04
This playbook looks to automate the tedious setup process by performing the following tasks: