Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
V
Vietnamese text moderation
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
Cao Duc Anh
Vietnamese text moderation
Commits
4a0e8c30
Commit
4a0e8c30
authored
Sep 04, 2024
by
Cao Duc Anh
Browse files
Options
Browse Files
Download
Plain Diff
Merge branch 'master' of
https://gitlab.vivas.vn/anhcd/vietnamese-text-moderation
parents
cc451504
d8c42f39
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
17 additions
and
5 deletions
+17
-5
README.md
README.md
+17
-5
No files found.
README.md
View file @
4a0e8c30
...
@@ -52,13 +52,20 @@ training:
...
@@ -52,13 +52,20 @@ training:
```
```
3.
Theo dõi thông số quá trình huấn luyện tại màn hình tensorboard: http://0.0.0.0:6006/. Model save in bucket "model"
3.
Theo dõi thông số quá trình huấn luyện tại màn hình tensorboard: http://0.0.0.0:6006/. Model save in bucket "model"
## Hướng dẫn cập nhật model
Tải model lên bucket "model" Minio theo format: phobert_best_21-08-2024_08h58m.pth
Khởi động lại docker container
## Hướng dẫn triển khai với registry vivas
## Hướng dẫn triển khai với registry vivas
Yêu cầu cấu hình tối thiểu:
Yêu cầu cấu hình tối thiểu:
-
CPU intel core i5
-
CPU intel core i5
-
GPU 8GB VRam
-
GPU 8GB VRam
-
Disk 40GB
-
Disk 40GB
-
Ram 6 GB
-
Ram 6 GB
### 1. Pull docker images
### Step 0. Git pull this project
### Step 1. Pull docker images
Pull images with robot account:
Pull images with robot account:
-
vietnam_text_moderation/vn-text-moderation-data
-
vietnam_text_moderation/vn-text-moderation-data
-
vietnam_text_moderation/vn-text-moderation
-
vietnam_text_moderation/vn-text-moderation
...
@@ -73,7 +80,8 @@ Secret
...
@@ -73,7 +80,8 @@ Secret
```
```
0ZX8kHmvm1OwGoIGeOBHXopsYh8bl2OC
0ZX8kHmvm1OwGoIGeOBHXopsYh8bl2OC
```
```
### 2. Run
### Step 2. Run
Bạn có thể cần sửa config.yaml cho phù hợp.
```
```
docker compose up
docker compose up
```
```
...
@@ -84,11 +92,14 @@ Yêu cầu cấu hình tối thiểu:
...
@@ -84,11 +92,14 @@ Yêu cầu cấu hình tối thiểu:
-
GPU 8GB VRam
-
GPU 8GB VRam
-
Disk 40GB
-
Disk 40GB
-
Ram 6GB
-
Ram 6GB
### 1. Download model pretrain
### Step 0. Git pull this project
### Step 1. Download model pretrain
Download pytorch-model.bin: https://huggingface.co/vinai/phobert-base/resolve/main/pytorch_model.bin?download=true
<br>
Download pytorch-model.bin: https://huggingface.co/vinai/phobert-base/resolve/main/pytorch_model.bin?download=true
<br>
then save in
**./phobert-base/pytorch_model.bin**
then save in
**./phobert-base/pytorch_model.bin**
### 2. Build docker images
###
Step
2. Build docker images
Server inference
Server inference
```
```
docker build -f infer.Dockerfile -t registry.vivas.vn/vietnam_text_moderation/vn-text-moderation .
docker build -f infer.Dockerfile -t registry.vivas.vn/vietnam_text_moderation/vn-text-moderation .
...
@@ -102,7 +113,8 @@ Server manage data
...
@@ -102,7 +113,8 @@ Server manage data
docker build -f data.Dockerfile -t registry.vivas.vn/vietnam_text_moderation/vn-text-moderation-data .
docker build -f data.Dockerfile -t registry.vivas.vn/vietnam_text_moderation/vn-text-moderation-data .
```
```
### 3. Run
### Step 3. Run
Bạn có thể cần sửa config.yaml cho phù hợp.
```
```
docker compose up
docker compose up
```
```
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment