Skip to content

[feature] Add support for performing WHOIS lookups through local db #1052

@DragnEmperor

Description

@DragnEmperor

It would be better to have a local database for WHOIS lookup as the webservice approach has rate limitations. This will also ensure faster lookups without any dependency on internet connectivity.

These are the observations and information collected till now regarding the services provided by Maxmind and DB-IP:

More information regarding services provided by Maxmind:

Webservices

  • GeoLite2 Web services are free but are Limited to 1000 requests per day
  • GeoIP2 Web services are paid and starts with 20$ (10,000 queries amounting to 0.002$ per query)
  • Both these services do not require any additional licensing

More info can be found here:
https://www.maxmind.com/en/geoip-api-web-services#buy-now
https://geoip2.readthedocs.io/en/latest/#sync-web-service-example

Maxmind's webservice repository : https://github.com/maxmind/GeoIP2-python

Databases

  • GeoLite2 Databases are free to download but requires commercial licensing. The total size can vary between 50 - 70 mb.
  • GeoIP2 Databases are paid with starting price of 134$ (we require city database as the fields we require are present in city db only)

NOTE : GeoLite2 databases are limited to 30 downloads per day
More References:
https://dev.maxmind.com/geoip/docs/databases/city-and-country/#database-sizes
https://www.maxmind.com/en/site-license-overview
https://www.maxmind.com/en/geoip-databases

Account Creation

Following link can be used for account creation : https://www.maxmind.com/en/geolite2/signup?utm_source=kb&utm_medium=kb-link&utm_campaign=kb-create-account

After successful creation,

  • user can go to Manage License Keys or use https://www.maxmind.com/en/accounts/<<account_id>>/license-key to create a license which can be used for web services, or
  • go to download databases to download the GeoLite2 City and ASN database.

More information regarding services provided by DB-IP:

Databases

Free Databases are updated monthly with total size of 100 - 130mb.

More on database pricing:
https://db-ip.com/db/ip-to-location-isp

Webservice

Requires Paid account creation with prices starting at 11.49 Euros (~13$) for Core API which has the fields required by us.

More info can be found here:
https://db-ip.com/api/

Dependencies

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions