Setup Indexing 3+ million IP addresses
In the next few blog posts I’m going to go into detail on creating an IP mapping service: IPbot. One of the first challanges was being able to efficiently query three million IP addresses and their associated metadata.
Using MaxMind’s free GeoLite data:
GeoLite2 IP databases
I got a set of some three million addresses and their associated metadata.
My first approach used SQLite for its ease of set up and ingestion but I discovered it took quite a long time to return a single record.