ld/moe_explore
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2 Commits 1 Branch 0 Tags
6738855fb15bf3b2f6169e43c6950478b64d35bc
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Huxley 6738855fb1 Basic script for OLMoE inference. 
Add: basic script for OLMoE inference and saving expert logits.

Add: OLMoE vLLM module with logits saving.

Add: vLLM model registering.

Fix: update DataLogger module for multiprocessing.
2025-09-28 11:41:30 +08:00
models
Basic script for OLMoE inference.
2025-09-28 11:41:30 +08:00
utils
Basic script for OLMoE inference.
2025-09-28 11:41:30 +08:00
.clineignore
Init commit.
2025-09-27 16:39:55 +08:00
.gitignore
Init commit.
2025-09-27 16:39:55 +08:00
olmoe_inference_vllm.py
Init commit.
2025-09-27 16:39:55 +08:00
olmoe_inference.ipynb
Init commit.
2025-09-27 16:39:55 +08:00
olmoe_log_expert_vllm.py
Basic script for OLMoE inference.
2025-09-28 11:41:30 +08:00
requirements.txt
Init commit.
2025-09-27 16:39:55 +08:00
Description
No description provided
63 KiB
Languages
Python 100%