mirror of
https://github.com/openimsdk/open-im-server.git
synced 2025-04-05 20:11:14 +08:00
383758782e
* optimization: change the configuration file from being read globally to being read independently. * optimization: change the configuration file from being read globally to being read independently. * optimization: change the configuration file from being read globally to being read independently. * optimization: config file changed to dependency injection. * fix: replace global config with dependency injection * fix: replace global config with dependency injection * fix: import the enough param * fix: import the enough param * fix: import the enough param * fix: fix the component check of path * fix: fix the kafka of tls is nil problem * fix: fix the TLS.CACrt is nil error * fix: fix the valiable shadows problem * fix: fix the comflect * optimization: message remove options. * fix: fix the param pass error * fix: find error * fix: find error * fix: find eror * fix: find error * fix: find error * fix: del the undifined func * fix: find error * fix: fix the error * fix: pass config * fix: find error * fix: find error * fix: find error * fix: find error * fix: find error * fix: fix the config * fix: fix the error * fix: fix the config pass error * fix: fix the eror * fix: fix the error * fix: fix the error * fix: fix the error * fix: find error * fix: fix the error * fix: fix the config * fix: add return err * fix: fix the err2 * fix: err * fix: fix the func * fix: del the chinese comment * fix: fix the func * fix: fix the gateway_test logic * fix: s3 * test * test * fix: not found --------- Co-authored-by: luhaoling <2198702716@qq.com> Co-authored-by: withchao <993506633@qq.com>
README for OpenIM Server Data Conversion Tool
Overview
This tool is part of the OpenIM Server suite, specifically designed for data conversion between MySQL and MongoDB databases. It handles the migration of various data types, including user information, friendships, group memberships, and more from a MySQL database to MongoDB, ensuring data consistency and integrity during the transition.
Features
- Configurable Database Connections: Supports connections to both MySQL and MongoDB, configurable through a YAML file.
- Data Conversion Tasks: Converts a range of data models, including user profiles, friend requests, group memberships, and logs.
- Version Control: Maintains data versioning, ensuring only necessary migrations are performed.
- Error Handling: Robust error handling for database connectivity and query execution.
Requirements
- Go programming environment
- MySQL and MongoDB servers
- OpenIM Server dependencies installed
Installation
- Ensure Go is installed and set up on your system.
- Clone the OpenIM Server repository.
- Navigate to the directory containing this tool.
- Install required dependencies.
Configuration
- Configuration is managed through a YAML file specified at runtime.
- Set up the MySQL and MongoDB connection parameters in the config file.
Usage
To run the tool, use the following command from the terminal:
make build BINS="up35"
Where path/to/config.yaml is the path to your configuration file.
Functionality
The main functions of the script include:
InitConfig(path string): Reads and parses the YAML configuration file.GetMysql(): Establishes a connection to the MySQL database.GetMongo(): Establishes a connection to the MongoDB database.Main(path string): Orchestrates the data migration process.SetMongoDataVersion(db *mongo.Database, curver string): Updates the data version in MongoDB after migration.NewTask(...): Generic function to handle the migration of different data types.insertMany(coll *mongo.Collection, objs []any): Inserts multiple records into a MongoDB collection.getColl(obj any): Retrieves the MongoDB collection associated with a given object.convert struct: Contains methods for converting MySQL models to MongoDB models.
Notes
- Ensure that the MySQL and MongoDB instances are accessible and that the credentials provided in the config file are correct.
- It is advisable to backup databases before running the migration to prevent data loss.
Contributing
Contributions to improve the tool or address issues are welcome. Please follow the project's contribution guidelines.
License
Refer to the project's license document for usage and distribution rights.