- Fixed validation of empty maps and arrays at the end of the metadata section.
MMDB_openwould incorrectly reject databases where a 0-element map or array was the last field in metadata. Reported in vimt/MaxMind-DB-Writer-python#16.
- Fixed a compilation failure on macOS 26 (Tahoe) where
sys/endian.hdefinesbswap32andbswap64as macros, conflicting with our function declarations. Reported by Anton Melnikov. GitHub #419.
- Re-release for Ubuntu PPA. No code changes.
MMDB_get_entry_data_list()now validates that the claimed array/map size is plausible given the remaining bytes in the data section. A crafted database could previously claim millions of array elements while only having a few bytes of data, causing disproportionate memory allocation (memory amplification DoS).- On Windows,
GetFileSize()was replaced withGetFileSizeEx()to correctly handle files larger than 4GB. The previous code passedNULLfor the high DWORD, discarding the upper 32 bits of the file size. - Fixed integer overflow in
MMDB_read_node()andfind_ipv4_start_node()pointer arithmetic. Thenode_number * record_lengthmultiplication was performed inuint32_t, which could overflow for very large databases. Now cast touint64_tbefore multiplying, matching the pattern already used infind_address_in_search_tree(). - Fixed printf format specifier mismatches in
mmdblookup's metadata dump.%iwas used for unsigned types and%lluforuint64_t, which is technically undefined behavior. Now uses the portablePRIu32,PRIu16, andPRIu64macros from<inttypes.h>. - Fixed an integer overflow in the search tree bounds check in
find_address_in_search_tree(). The addition ofnode_countanddata_section_sizewas performed inuint32_tarithmetic, which could wrap on very large databases, causing valid lookups to be incorrectly rejected as corrupt. - Fixed a NULL pointer dereference in
mmdblookupwhen displaying metadata for a database with an out-of-rangebuild_epoch. Thegmtime()return value is now checked before passing tostrftime(). MMDB_close()now NULLs thefile_content,data_section, andmetadata_sectionpointers and zeroesfile_size,data_section_size, andmetadata_section_sizeafter unmapping. Previously, callingMMDB_close()twice on the same struct (or calling it after a failedMMDB_open()that succeeded at mapping) would double-munmap the file content, which is undefined behavior.- Fixed a stack buffer overflow in
print_indentation()whenMMDB_dump_entry_data_list()was called with a negativeindentvalue. The negative integer was cast tosize_t, producing a massive value passed tomemset(). Negative indent values are now clamped to 0. MMDB_lookup_string()now sets*mmdb_errortoMMDB_SUCCESSwhengetaddrinfofails (non-zero*gai_error). Previously,*mmdb_errorwas left uninitialized in this case, which could cause callers to read an indeterminate value.- Fixed an off-by-one in
mmdblookupon Windows whereallocaallocated one byte too few for the program name buffer, causing_splitpathto write one byte past the end when appending the null terminator. - Added a recursion depth limit to
skip_map_or_array(), matching the existingMAXIMUM_DATA_STRUCTURE_DEPTH(512) limit already used byget_entry_data_list(). A crafted MMDB file with deeply nested maps or arrays could previously cause a stack overflow via unbounded recursion in theMMDB_aget_value/MMDB_get_valuecode path. - Fixed an off-by-one error in
MMDB_read_node()that allowed reading one node past the end of the search tree when called withnode_number == node_count. This caused the function to read from the data section separator and return an invalid record with an underflowed data offset. The check now correctly rejectsnode_number >= node_count. - The handling of float and double types was rewritten to fix compiler errors and to eliminate the use of volatile.
- Improved endian preprocessor check if
MMDB_LITTLE_ENDIANis not set.
MMDB_get_entry_data_list()now always sets the passedentry_data_listparameter to eitherNULLor valid memory. This makes it safe for callers to useMMDB_free_entry_data_list()on it even in case of error. In 1.12.0MMDB_get_entry_data_list()was changed to not set this parameter to valid memory in additional error cases. That change caused segfaults for certain libraries that assumed it was safe to free memory on error. Doing so was never safe, but worked in some cases. This change makes such calls safe. Reported by Petr Pisar. GitHub maxmind/MaxMind-DB-Reader-XS#39.
- Added missing
cmake_uninstall.cmake.into the source distribution. This was missing from 1.12.0, causing CMake builds to fail. Reported by Marcel Raad. GitHub #367.
- Fixed memory leaks in
MMDB_open(). These could happen with invalid databases or in error situations such as failing to allocate memory. As part of the fix,MMDB_get_entry_data_list()now frees memory it allocates on additional errors. Previously it failed to clean up when certain errors occurred. Pull request by pkillarjun. GitHub #356. - There is now a build target to fuzz the library. Pull request by pkillarjun. GitHub #357.
- Updated
cmake_minimum_requiredto a version range to quiet deprecation warnings on new CMake versions. Reported by gmou3. GitHub #359. - The script for generating man pages no longer uses
autodie. This eliminates the dependency onIPC::System::Simple. Reported by gmou3. GitHub #359. - An uninstall target is now included for CMake. Pull request by gmou3. GitHub #362.
- When building with CMake, the man pages will now be generated and installed. Requested by Thomas Klausner. GitHub #351.
- Removed unnecessary
$<INSTALL_INTERFACE:generated>directory fromtarget_include_directoriesin the CMake build configuration. This is a private build directory. Pull request by Ankur Verma. GitHub #354.
- When building with CMake, it is now possible to disable the building of
binaries (e.g.,
mmdblookup) with theMAXMINDDB_BUILD_BINARIESoption and the install target generation with theMAXMINDDB_INSTALLoption. Pull request by Seena Fallah. GitHub #342. - CMake now makes greater use of GNUInstallDirs. Pull request by Maximilian Downey Twiss. GitHub #346.
- The reader can now look up records on a database with a search tree that is greater than 4 gigabytes without sometimes returning erroneous results due to an integer overflow.
SSIZE_MAXis now defined conditionally on Windows. The 1.9.0 release would cause a redefinition warning when compiled with MinGW. Reported by Andreas Vögele. GitHub #338.
- On very large databases, the calculation to determine the search tree size could overflow. This was fixed and several additional guards against overflows were added. Reported by Sami Salonen. GitHub #335.
- Removed
sa_family_ttypedef from the public header on Windows. Pull request by Noah Treuhaft. GitHub #334. - The CMake build was adjusted to allow running builds in parallel. Pull request by Vladyslav Miachkov. GitHub #332.
PACKAGE_VERSIONis now a private compile definition when building with CMake. Pull request by bsergean. GitHub #308.PACKAGE_VERSIONis no longer defined inmaxminddb.hon Windows.- The feature test macro
_POSIX_C_SOURCEis no longer set bymaxminddb.h. As discussed in GitHub #318, this should be set by applications rather than by libraries. assert()is no longer used outside test code.- The deprecated Visual Studio 12 project files in the
projects/directory have been removed. CMake should be used when building on Windows.
- The external symbols test now only runs on Linux. It assumes a Linux environment. Reported by Carlo Cabrera. GitHub #304.
FD_CLOEXECis now set on platforms that do not supportO_CLOEXEC. Reported by rittneje. GitHub #273.- When building with Visual Studio, you may now build a static runtime with
CMake by setting
MSVC_STATIC_RUNTIMEtoON. Pull request by Rafael Santiago. GitHub #269. - The CMake build now works on iOS. Pull request by SpaceIm. GitHub #271.
- The CMake build now uses the correct library directory on Linux systems using alternate directory structures. Pull request by Satadru Pramanik. GitHub #284.
- File size check now correctly compares the size to
SSIZE_MAX. Reported by marakew. GitHub #301.
- This release includes several improvements to the CMake build. In particular:
- C99 support is now properly enabled, fixing builds on older
gccversions. Pull request by Jan Včelák. GitHub #257. CMAKE_SHARED_LIBRARY_PREFIXandCMAKE_STATIC_LIBRARY_PREFIXare no longer explicitly set and now use the default values for the platform. Pull request by Jan Včelák. GitHub #258.target_include_directoriesnow works as expected. Pull request by Jan Včelák. GitHub #259.- DLLs are now installed on Windows when
libmaxminddbis built as a shared library. Pull request by Jan Včelák. GitHub #261. - When built as a dynamic library on Windows, all symbols are now exported. Pull request by Jan Včelák. GitHub #262.
- C99 support is now properly enabled, fixing builds on older
- With
libmaxminddbon Windows andmmdblookupgenerally, there were instances where the return value ofcallocwas not checked, which could lead to issues in low memory situations or when resource limits had been set. Reported by cve-reporting. GitHub #252.
- The formatting of the manpages has been improved and the script that generates
them now supports
lowdownin addition topandoc. Pull request by Faidon Liambotis. GitHub #248.
- A CMake build script has been added for Windows builds. The Visual Studio
project files in
projectsare now considered deprecated and will be removed in a future release.
- On Windows, always call
CreateFileWinstead ofCreateFile.CreateFilecould be mapped toCreateFileAand not work as expected. Pull request by Sandu Liviu Catalin. GitHub #228. - Fixed use of uninitialized memory in
dump_entry_data_list()that could cause a heap buffer overflow inmmdblookup. As part of this fix, most uses ofmallocwere replaced withcalloc. Reported by azhou. GitHub #236.
- The 1.4.0 release introduced a change that increased the size of
MMDB_s, unintentionally causing an ABI break. This release reverts the relevant commit.
- The man page links for function calls were not generated correctly in 1.4.0. This has been corrected.
- A negative array index may now be used with
MMDB_get_value,MMDB_vget_value, andMMDB_aget_value. This specifies the element from the end of the array. For instance,-1would refer to the last element of the array. PR by Kyle Box. GitHub #205. - On Windows, the file name passed to
MMDB_openis now expected to be UTF-8 encoded. This allows Unicode characters to be used in file names. As part of this change,mmdblookupon Windows now converts its arguments to UTF-8. PR by Gerald Combs. GitHub #189 & #191. - Fix a memory leak that occurred when freeing an
MMDB_swhere the database had no languages defined in the metadata. If you are using an official MaxMind database, this leak does not affect you. Pull request by Kókai Péter. GitHub #180. - Add
--disable-binariesoption toconfigure. Pull request by Fabrice Fontaine. GitHub #166. - Previous releases incorrectly included
*.Pofiles in thetdirectory. This has been corrected. Reported by Daniel Macks. GitHub #168. - The internal use of the
MMDB_snow has theconstmodifier. Public functions that accepted anMMDB_sas an argument now also declare it asconst. Pull request by Kurt Johnson. GitHub #199. mmdblookupnow displays the prefix length for the record when using the verbose flag. GitHub #172.
- Allocate memory for
MMDB_entry_data_list_sstructs in separate chunks rather than one large chunk. This simplifies accessing memory inMMDB_get_entry_data_list()and increases performance. It builds on the changes in 1.3.0 and 1.3.1. - We no longer export
data_pool_*symbols. These are internal functions but we were previously exporting them. Pull request by Faidon Liambotis. GitHub #162. - Build with POSIX.1-2008 by default if the system supports it. This allows use
of
open()withO_CLOEXEC. We retain support for systems that provide only POSIX.1-2001. - Open the database with the
O_CLOEXECflag if the system provides it. This avoids cases where we could leak fds when called in multi-threaded programs thatfork()andexec(). Original report and PR by Brandon L Black. - Added a test to ensure we export only intended symbols (e.g. MMDB_*).
- Fix build problems related to
rpl_malloc(). Pull request by Rainer Gerhards. GitHub #152. - Fix a race to set and read data in a field on the
MMDB_sstruct (ipv4_start_node). GitHub #153. - Fix cases of invalid memory access when using
MMDB_get_entry_data_list(). This was introduced in 1.3.0 and occurred when performing large lookups. GitHub #153.
- Perform fewer memory allocations in
MMDB_get_entry_data_list(). This significantly improves its performance. GitHub #147. - Fix
mmdblookup's build epoch reporting on some systems. Big endian systems with a 32-bittime_tno longer show a database build date of 1970-01-01 00:00:00. Pull request by Rainer Jung. GitHub #143.
- Use autoconf to check the system's endianness rather than trying to do this
with compiler-defined macros like
__BYTE_ORDER__. Apparently this didn't work properly on a Sparc system. GitHub #120. - Several compiler warnings on Visual C++ were fixed. Pull request by Marcel Raad. GitHub #130.
- Fix segmentation faults found in
MMDB_open()using afl-fuzz. This occurred on corrupt databases that had a data pointer large enough to cause an integer overflow when doing bound checking. Reported by Ryan Whitworth. GitHub #140. - Add --disable-tests option to
configure. Pull request by Fabrice Fontaine. GitHub #136.
- Four additional fields were added to the end of the
MMDB_search_node_sstruct returned byMMDB_read_node. These fields allow the user to iterate through the search tree without making undocumented assumptions about how this library works internally and without knowing the specific details of the database format. GitHub #110.
- Previously, reading a database with a pointer in the metadata would cause an
MMDB_INVALID_METADATA_ERRORto be returned. This was due to an invalid offset being used when calculating the pointer. Thedata_sectionandmetadata_sectionfields now both point to the beginning of the data section. Previously,data_sectionpointed to the beginning of the data separator. This will not affect anyone using only documented fields fromMMDB_s. MMDB_lookup_sockaddrwill setmmdb_errortoMMDB_IPV6_LOOKUP_IN_IPV4_DATABASE_ERRORif an IPv6sockaddris looked up in an IPv4-only database. Previously onlyMMDB_lookup_stringwould set this error code.- When resolving an address, this library now relies on
getaddrinfoto determine the address family rather than trying to guess it itself.
- Packaging fixes. The 1.1.3 tarball release contained a lot of extra junk in the t/ directory.
- Added several additional checks to make sure that we don't attempt to read past the end of the databases's data section. Implemented by Tobias Stoeckmann. GitHub #103.
- When searching for the database metadata, there was a bug that caused the code to think it had found valid metadata when none existed. In addition, this could lead to an attempt to read past the end of the database entirely. Finally, if there are multiple metadata markers in the database, we treat the final one as the start of the metadata, instead of the first. Implemented by Tobias Stoeckmann. GitHub #102.
- Don't attempt to mmap a file that is too large to be mmapped on the system. Implemented by Tobias Stoeckmann. GitHub #101.
- Added a missing out of memory check when reading a file's metadata. Implemented by Tobias Stoeckmann. GitHub #101.
- Added several additional checks to make sure that we never attempt to
mallocmore thanSIZE_MAXmemory, which would lead to integer overflow. This could only happen with pathological databases. Implemented by Tobias Stoeckmann. GitHub #101.
- IMPORTANT: This release includes a number of important security fixes. Among
these fixes is improved validation of the database metadata. Unfortunately,
MaxMind GeoIP2 and GeoLite2 databases created earlier than January 28, 2014
had an invalid data type for the
record_sizein the metadata. Previously these databases worked on little endian machines with libmaxminddb but did not work on big endian machines. Due to increased safety checks when reading the file, these databases will no longer work on any platform. If you are using one of these databases, we recommend that you upgrade to the latest GeoLite2 or GeoIP2 database - Added pkg-config support. If your system supports it, then running
make installnow installs alibmaxminddb.pcfile for pkgconfig. Implemented by Jan Vcelak. - Several segmentation faults found with afl-fuzz were fixed. These were caused by missing bounds checking and missing data type verification checks.
MMDB_get_entry_data_listwill now fail on data structures with a depth greater than 512 and data structures that are cyclic. This should not affect any known MaxMind DB in production. All databases produced by MaxMind have a depth of less than five.
- Added
maxminddb-compat-util.has a source file to dist.
- Previously, when there was an error in
MMDB_open(),errnowould generally be overwritten during cleanup, preventing a useful value from being returned to the caller. This was changed so that theerrnovalue from the function call that caused the error is restored before returning to the caller. In particular, this is important forMMDB_IO_ERRORerrors as checkingerrnois often the only way to determine what actually failed. - If
mmap()fails due to running out of memory space, anMMDB_OUT_OF_MEMORY_ERRORis now returned fromMMDB_openrather than anMMDB_IO_ERROR. - On Windows, the
CreateFileMappingA()handle was not properly closed if opening the database succeeded. Fixed by Bly Hostetler. GitHub #75 & #76. - On Windows, we were not checking the return value of
CreateFileMappingA()properly for errors. Fixed by Bly Hotetler. GitHub #78. - Several warnings from Clang's scan-build were fixed. GitHub #86.
- All headers are now installed in
$(includedir). GitHub #89. - We no longer install
maxminddb-compat-util.h. This header was intended for internal use only.
- If you used a non-integer string as an array index when doing a lookup with
MMDB_get_value(),MMDB_vget_value(), orMMDB_aget_value(), the first element of the array would be returned rather than an error. AMMDB_LOOKUP_PATH_DOES_NOT_MATCH_DATA_ERRORerror will now be returned. GitHub #61. - If a number larger than
LONG_MAXwas used in the same functions,LONG_MAXwould have been used in the lookup. Now aMMDB_INVALID_LOOKUP_PATH_ERRORerror will be returned. - Visual Studio build files were added for unit tests and some compatibility issues with the tests were fixed.
- Visual Studio project was updated to use property pages. Patch by Andre. GitHub #69.
- A test failure in
t/compile_c++_t.plon new installs was fixed.
- A memory and file handle leak on Win32 was fixed when getting the database size fails. Patch by Federico G. Schwindt. GitHub PR #49.
- Documentation fix. Federico G. Schwindt. GitHub PR #50.
- Added Visual Studio build files and fixed incorrect CreateFileMappingA usage. Patch by Andre. GitHub #52.
- The includes for the Windows header files were made lowercase in order to match the actual file names on case-sensitive file systems. GitHub PR #57.
- Removed
realloc()calls that caused warnings on Windows and generally cleaned up memory allocation inMMDB_vget_value(). See relevant discussion in GitHub #52. - Added an
extern "C" { ... }wrapper to maxminddb.h when compiling with a C++ compiler. GitHub #55.
- Fixed a number of small issues found by Coverity.
- When freeing the MMDB struct in
MMDB_close()we make sure to set the pointers to NULL after freeing the memory they point to. This makes it safe to callMMDB_closemore than once on the sameMMDB_sstruct pointer. Before this change, calling this function twice on the same pointer could cause the code to free memory that belonged to something else in the process. Patch by Shuxin Yang. GitHub PR #41.
- Added missing LICENSE and NOTICE files to distribution. No code changes.
- Bumped version to 1.0.0. No code changes.
- There was a leak in the
MMDB_open()sub when it was called against a file which did not contain any MMDB metadata. Reported by Federico G. Schwindt. GitHub issue #36. - Fixed an error that occurred when passing AI_V4MAPPED to
getaddrinfo()on FreeBSD. Apparently this macro is defined but doesn't work the way we expected it to on that platform. - Made sure to call
freeaddrinfo()when a call togetaddrinfo()fails but still allocated memory. - Fixed a segfault in the tests that occurred on FreeBSD if we passed a NULL
value to
freeaddrinfo(). - Added a missing step to the README.md file for installing from our GitHub repository. Patch by Yasith Fernando.
- Added instructions for installing via Homebrew. Patch by Yasith Fernando.
- The previous tarball failed to compile because it was missing the src/maxminddb-compat-util.h file. Reported by Günter Grodotzki. GitHub issue #18.
- Added support for compiling in the MinGW environment. Patch by Michael Eisendle.
- Added const declarations to many spots in the public API. None of these should require changes to existing code.
- Various documentation improvements.
- Changed the license to the Apache 2.0 license.
- The internal value_for_key_as_uint16 method was returning a uint32_t instead of a uint16_t. Reported by Robert Wells. GitHub issue #11.
- The ip_version member of the MMDB_metadata_s struct was a uint8_t, even though the docs and spec said it should be a uint16_t. Reported by Robert Wells. GitHub issue #11.
- The mmdblookup_t.pl test now reports that it needs IPC::Run3 to run (which it always did, but it didn't tell you this). Patch by Elan Ruusamäe. GitHub issue #10.
- Running
makefrom the tarball failed. This is now fixed.
- Renamed MMDB_LOOKUP_PATH_DOES_NOT_MATCH_DATA define to MMDB_LOOKUP_PATH_DOES_NOT_MATCH_DATA_ERROR for consistency. Fixes github issue #5. Reported by Albert Strasheim.
- Updated README.md to show git clone with --recursive flag so you get the needed submodules. Fixes github issue #4. Reported by Ryan Peck.
- Fixed some bugs with the MMDBget*value functions when navigating a data structure that included pointers. Fixes github issue #3. Reported by bagadon.
- Fixed compilation problems on OSX and OpenBSD. We have tested this on OSX and OpenBSD 5.4. Fixes github issue #6.
- Removed some unneeded memory allocations and added const to many variable declarations. Based on patches by Timo Teräs. Github issue #8.
- Added a test that uses threads to check for thread safety issue in the library.
- Distro tarball now includes man pages, tests, and test data