Topics | |
| Checking and Recovery | |
Enumerations | |
| enum | MDBX_copy_flags_t { MDBX_CP_DEFAULTS = 0 , MDBX_CP_COMPACT = 1u , MDBX_CP_FORCE_DYNAMIC_SIZE = 2u , MDBX_CP_DONT_FLUSH = 4u , MDBX_CP_THROTTLE_MVCC = 8u , MDBX_CP_DISPOSE_TXN = 16u , MDBX_CP_RENEW_TXN = 32u , MDBX_CP_OVERWRITE = 64u } |
| Environment copy flags. More... | |
| enum | MDBX_env_delete_mode_t { MDBX_ENV_JUST_DELETE = 0 , MDBX_ENV_ENSURE_UNUSED = 1 , MDBX_ENV_WAIT_FOR_UNUSED = 2 } |
| Deletion modes for mdbx_env_delete(). More... | |
Functions | |
| LIBMDBX_API int | mdbx_env_delete (const char *pathname, MDBX_env_delete_mode_t mode) |
| Delete the environment's files in a proper and multiprocess-safe way. | |
| LIBMDBX_API int | mdbx_env_deleteW (const wchar_t *pathname, MDBX_env_delete_mode_t mode) |
| Delete the environment's files in a proper and multiprocess-safe way. | |
| LIBMDBX_API int | mdbx_env_copy (MDBX_env *env, const char *dest, MDBX_copy_flags_t flags) |
| Copy an MDBX environment to the specified path, with options. | |
| LIBMDBX_API int | mdbx_txn_copy2pathname (MDBX_txn *txn, const char *dest, MDBX_copy_flags_t flags) |
| Copy an MDBX environment by given read transaction to the specified path, with options. | |
| LIBMDBX_API int | mdbx_env_copyW (MDBX_env *env, const wchar_t *dest, MDBX_copy_flags_t flags) |
| Copy an MDBX environment to the specified path, with options. | |
| LIBMDBX_API int | mdbx_txn_copy2pathnameW (MDBX_txn *txn, const wchar_t *dest, MDBX_copy_flags_t flags) |
| Copy an MDBX environment by given read transaction to the specified path, with options. | |
| LIBMDBX_API int | mdbx_env_copy2fd (MDBX_env *env, mdbx_filehandle_t fd, MDBX_copy_flags_t flags) |
| Copy an environment to the specified file descriptor, with options. | |
| LIBMDBX_API int | mdbx_txn_copy2fd (MDBX_txn *txn, mdbx_filehandle_t fd, MDBX_copy_flags_t flags) |
| Copy an environment by given read transaction to the specified file descriptor, with options. | |
| LIBMDBX_API int | mdbx_env_sync_ex (MDBX_env *env, bool force, bool nonblock) |
| Flush the environment data buffers to disk. | |
| int | mdbx_env_sync (MDBX_env *env) |
| The shortcut to calling mdbx_env_sync_ex() with the force=true and nonblock=false arguments. | |
| int | mdbx_env_sync_poll (MDBX_env *env) |
| The shortcut to calling mdbx_env_sync_ex() with the force=false and nonblock=true arguments. | |
| LIBMDBX_API int | mdbx_env_resurrect_after_fork (MDBX_env *env) |
| Restores an instance of the environment in a child process after forking the parent process using fork() or similar system calls. | |
| LIBMDBX_API int | mdbx_is_readahead_reasonable (size_t volume, intptr_t redundancy) |
| Find out whether to use readahead or not, based on the given database size and the amount of available memory. | |
| LIBMDBX_API int | mdbx_cursor_ignord (MDBX_cursor *cursor) |
| An auxiliary function for use in tools. | |
| LIBMDBX_API MDBX_cmp_func * | mdbx_get_keycmp (MDBX_db_flags_t flags) |
| Returns default internal key's comparator for given table flags. | |
| LIBMDBX_API MDBX_cmp_func * | mdbx_get_datacmp (MDBX_db_flags_t flags) |
| Returns default internal data's comparator for given table flags. | |
| LIBMDBX_API int | mdbx_reader_check (MDBX_env *env, int *dead) |
| Check for stale entries in the reader lock table. | |
| LIBMDBX_API int | mdbx_thread_register (const MDBX_env *env) |
| Registers the current thread as a reader for the environment. | |
| LIBMDBX_API int | mdbx_thread_unregister (const MDBX_env *env) |
| Unregisters the current thread as a reader for the environment. | |
| LIBMDBX_API int | mdbx_env_open_for_recoveryW (MDBX_env *env, const wchar_t *pathname, unsigned target_meta, bool writeable) |
| Open an environment instance using specific meta-page for checking and recovery. | |
| enum MDBX_copy_flags_t |
Environment copy flags.
| Enumerator | |
|---|---|
| MDBX_CP_DEFAULTS | |
| MDBX_CP_COMPACT | Copy with compactification: Omit free space from copy and renumber all pages sequentially |
| MDBX_CP_FORCE_DYNAMIC_SIZE | Force to make resizable copy, i.e. dynamic size instead of fixed |
| MDBX_CP_DONT_FLUSH | Don't explicitly flush the written data to an output media |
| MDBX_CP_THROTTLE_MVCC | Use read transaction parking during copying MVCC-snapshot
|
| MDBX_CP_DISPOSE_TXN | Abort/dispose passed transaction after copy |
| MDBX_CP_RENEW_TXN | Enable renew/restart read transaction in case it use outdated MVCC shapshot, otherwise the MDBX_MVCC_RETARDED will be returned |
| MDBX_CP_OVERWRITE | Silently overwrite the target file, if it exists, instead of returning an error |
Deletion modes for mdbx_env_delete().
| LIBMDBX_API int mdbx_cursor_ignord | ( | MDBX_cursor * | cursor | ) |
An auxiliary function for use in tools.
When using user-defined comparison functions, checking the order of keys or values will lead to incorrect results and return the error MDBX_CORRUPTED.
This function disables the control of the order of keys when reading database pages for this cursor, and thus allows to access data in the absence/unavailability of the comparison functions used.
| LIBMDBX_API int mdbx_env_copy | ( | MDBX_env * | env, |
| const char * | dest, | ||
| MDBX_copy_flags_t | flags ) |
Copy an MDBX environment to the specified path, with options.
This function may be used to make a backup of an existing environment. No lockfile is created, since it gets recreated at need.
| [in] | env | An environment handle returned by mdbx_env_create(). It must have already been opened successfully. |
| [in] | dest | The pathname of a file in which the copy will reside. This file must not be already exist, but parent directory must be writable. |
| [in] | flags | Specifies options for this operation. This parameter must be bitwise OR'ing together any of the constants described here: |
| LIBMDBX_API int mdbx_env_copy2fd | ( | MDBX_env * | env, |
| mdbx_filehandle_t | fd, | ||
| MDBX_copy_flags_t | flags ) |
Copy an environment to the specified file descriptor, with options.
This function may be used to make a backup of an existing environment. No lockfile is created, since it gets recreated at need.
| [in] | env | An environment handle returned by mdbx_env_create(). It must have already been opened successfully. |
| [in] | fd | The file descriptor to write the copy to. It must have already been opened for Write access. |
| [in] | flags | Special options for this operation. |
| LIBMDBX_API int mdbx_env_copyW | ( | MDBX_env * | env, |
| const wchar_t * | dest, | ||
| MDBX_copy_flags_t | flags ) |
Copy an MDBX environment to the specified path, with options.
This function may be used to make a backup of an existing environment. No lockfile is created, since it gets recreated at need.
| [in] | env | An environment handle returned by mdbx_env_create(). It must have already been opened successfully. |
| [in] | dest | The pathname of a file in which the copy will reside. This file must not be already exist, but parent directory must be writable. |
| [in] | flags | Specifies options for this operation. This parameter must be bitwise OR'ing together any of the constants described here: |
| LIBMDBX_API int mdbx_env_delete | ( | const char * | pathname, |
| MDBX_env_delete_mode_t | mode ) |
Delete the environment's files in a proper and multiprocess-safe way.
| [in] | pathname | The pathname for the database or the directory in which the database files reside. |
| [in] | mode | Specifies deletion mode for the environment. This parameter must be set to one of the constants described above in the MDBX_env_delete_mode_t section. |
| MDBX_RESULT_TRUE | No corresponding files or directories were found, so no deletion was performed. |
| LIBMDBX_API int mdbx_env_deleteW | ( | const wchar_t * | pathname, |
| MDBX_env_delete_mode_t | mode ) |
Delete the environment's files in a proper and multiprocess-safe way.
| [in] | pathname | The pathname for the database or the directory in which the database files reside. |
| [in] | mode | Specifies deletion mode for the environment. This parameter must be set to one of the constants described above in the MDBX_env_delete_mode_t section. |
| MDBX_RESULT_TRUE | No corresponding files or directories were found, so no deletion was performed. |
| LIBMDBX_API int mdbx_env_open_for_recoveryW | ( | MDBX_env * | env, |
| const wchar_t * | pathname, | ||
| unsigned | target_meta, | ||
| bool | writeable ) |
Open an environment instance using specific meta-page for checking and recovery.
This function mostly of internal API for mdbx_chk utility and subject to change at any time. Do not use this function to avoid shooting your own leg(s).
| LIBMDBX_API int mdbx_env_resurrect_after_fork | ( | MDBX_env * | env | ) |
Restores an instance of the environment in a child process after forking the parent process using fork() or similar system calls.
Without calling mdbx_env_resurrect_after_fork(), it is not possible to use an open instance of the environment in a child process, including all transactions running at the moment of forking.
The actions performed by the function can be considered as reopening the database in a child process, while preserving the set options and addresses of already created instances of most objects accesible via the API.
Forking does not affect the state of the MDBX environment in the parent process. All transactions that were in the parent process at the moment of forking will continue to be performed without interference after forking in the parent process. However, in a child process, all relevant transactions are no longer valid, and an attempt to use ones will result in an error being returned or sending the SIGSEGV signal by the OS kernel.
Using an instance of the environment in a child process is not possible until calling mdbx_env_resurrect_after_fork(), because as a result of forking, the process's PID changes, the value of which is used to organize collaboration with the database, including to track processes/threads performing reading transactions related to the corresponding MVCC-snapshots. All transactions active at the moment of forking cannot continue in the child process, as ones do not own any locks or any MVCC-snapshot and do not keep it from being recycled during garbage collection.
The mdbx_env_resurrect_after_fork() function restores the transferred instance of the environment in the child process after forking, namely: updates the system identifiers used, reopens file descriptors, acquires the necessary locks associated with LCK and DXB database files, restores the memory mappings of the database file, reader tables and auxiliary data to memory. However, transactions inherited from the parent process are not restored, and writing and reading transactions are handled differently:
The reason for not releasing the resources of reading transactions is that historically MDBX does not maintain any general list of reading transaction instances, as this is not required for normal operation, but requires using of atomic operations or additional synchronization objects when creating/destroying instances MDBX_txn.
Calling mdbx_env_resurrect_after_fork() without forking, or not in a child process, or repeated calls do not lead to any actions or changes.
| [in,out] | env | An instance of the environment created by the mdbx_env_create() function. |
| MDBX_BUSY | The database was opened in MDBX_EXCLUSIVE mode. |
| MDBX_EBADSIGN | If the signature of an object instance is corrupted, as well as if mdbx_env_resurrect_after_fork() is called simultaneously from different threads. |
| MDBX_PANIC | A critical error occurred when restoring an instance of the environment, or there was already such an error before calling the function. |
|
inline |
The shortcut to calling mdbx_env_sync_ex() with the force=true and nonblock=false arguments.
| LIBMDBX_API int mdbx_env_sync_ex | ( | MDBX_env * | env, |
| bool | force, | ||
| bool | nonblock ) |
Flush the environment data buffers to disk.
Unless the environment was opened with no-sync flags (MDBX_NOMETASYNC, MDBX_SAFE_NOSYNC and MDBX_UTTERLY_NOSYNC), then data is always written an flushed to disk when mdbx_txn_commit() is called. Otherwise mdbx_env_sync() may be called to manually write and flush unsynced data to disk.
Besides, mdbx_env_sync_ex() with argument force=false may be used to provide polling mode for lazy/asynchronous sync in conjunction with mdbx_env_set_syncbytes() and/or mdbx_env_set_syncperiod().
| [in] | env | An environment handle returned by mdbx_env_create() |
| [in] | force | If non-zero, force a flush. Otherwise, If force is zero, then will run in polling mode, i.e. it will check the thresholds that were set mdbx_env_set_syncbytes() and/or mdbx_env_set_syncperiod() and perform flush if at least one of the thresholds is reached. |
| [in] | nonblock | Don't wait if write transaction is running by other thread. |
| MDBX_EACCES | The environment is read-only. |
| MDBX_BUSY | The environment is used by other thread and nonblock=true. |
| MDBX_EINVAL | An invalid parameter was specified. |
| MDBX_EIO | An error occurred during the flushing/writing data to a storage medium/disk. |
|
inline |
The shortcut to calling mdbx_env_sync_ex() with the force=false and nonblock=true arguments.
| LIBMDBX_API MDBX_cmp_func * mdbx_get_datacmp | ( | MDBX_db_flags_t | flags | ) |
Returns default internal data's comparator for given table flags.
| LIBMDBX_API MDBX_cmp_func * mdbx_get_keycmp | ( | MDBX_db_flags_t | flags | ) |
Returns default internal key's comparator for given table flags.
| LIBMDBX_API int mdbx_is_readahead_reasonable | ( | size_t | volume, |
| intptr_t | redundancy ) |
Find out whether to use readahead or not, based on the given database size and the amount of available memory.
| [in] | volume | The expected database size in bytes. |
| [in] | redundancy | Additional reserve or overload in case of negative value. |
| MDBX_RESULT_TRUE | Readahead is reasonable. |
| MDBX_RESULT_FALSE | Readahead is NOT reasonable, i.e. MDBX_NORDAHEAD is useful to open environment by mdbx_env_open(). |
| OTHERWISE | the error code. |
| LIBMDBX_API int mdbx_reader_check | ( | MDBX_env * | env, |
| int * | dead ) |
Check for stale entries in the reader lock table.
| [in] | env | An environment handle returned by mdbx_env_create(). |
| [out] | dead | Number of stale slots that were cleared. |
| LIBMDBX_API int mdbx_thread_register | ( | const MDBX_env * | env | ) |
Registers the current thread as a reader for the environment.
To perform read operations without blocking, a reader slot must be assigned for each thread. However, this assignment requires a short-term lock acquisition which is performed automatically. This function allows you to assign the reader slot in advance and thus avoid acquiring a lock when the reading transaction starts firstly from the current thread.
| [in] | env | An environment handle returned by mdbx_env_create(). |
| LIBMDBX_API int mdbx_thread_unregister | ( | const MDBX_env * | env | ) |
Unregisters the current thread as a reader for the environment.
To perform read operations without blocking, a reader slot must be assigned for each thread. However, the assigned reader slot will remain occupied until the thread ends or the environment closes. This function allows you to explicitly release the assigned reader slot.
| [in] | env | An environment handle returned by mdbx_env_create(). |
| LIBMDBX_API int mdbx_txn_copy2fd | ( | MDBX_txn * | txn, |
| mdbx_filehandle_t | fd, | ||
| MDBX_copy_flags_t | flags ) |
Copy an environment by given read transaction to the specified file descriptor, with options.
This function may be used to make a backup of an existing environment. No lockfile is created, since it gets recreated at need.
| [in] | txn | A transaction handle returned by mdbx_txn_begin(). |
| [in] | fd | The file descriptor to write the copy to. It must have already been opened for Write access. |
| [in] | flags | Special options for this operation. |
| LIBMDBX_API int mdbx_txn_copy2pathname | ( | MDBX_txn * | txn, |
| const char * | dest, | ||
| MDBX_copy_flags_t | flags ) |
Copy an MDBX environment by given read transaction to the specified path, with options.
This function may be used to make a backup of an existing environment. No lockfile is created, since it gets recreated at need.
| [in] | txn | A transaction handle returned by mdbx_txn_begin(). |
| [in] | dest | The pathname of a file in which the copy will reside. This file must not be already exist, but parent directory must be writable. |
| [in] | flags | Specifies options for this operation. This parameter must be bitwise OR'ing together any of the constants described here: |
| LIBMDBX_API int mdbx_txn_copy2pathnameW | ( | MDBX_txn * | txn, |
| const wchar_t * | dest, | ||
| MDBX_copy_flags_t | flags ) |
Copy an MDBX environment by given read transaction to the specified path, with options.
This function may be used to make a backup of an existing environment. No lockfile is created, since it gets recreated at need.
| [in] | txn | A transaction handle returned by mdbx_txn_begin(). |
| [in] | dest | The pathname of a file in which the copy will reside. This file must not be already exist, but parent directory must be writable. |
| [in] | flags | Specifies options for this operation. This parameter must be bitwise OR'ing together any of the constants described here: |