264 MB

Ctrl+K

1 contributor

History: 84 commits

mineself2016

Update examples/3_pretrain_from_scratch.py

dac10b0 verified 20 days ago

converted_checkpoints
Upload GeneMamba model 22 days ago
examples
Update examples/3_pretrain_from_scratch.py 20 days ago
hf_space
Add GitHub dataset source link in README 22 days ago
scripts
Sync latest GeneMamba docs and next-token training updates 20 days ago
.gitattributes

1.52 kB
initial commit 22 days ago
.gitignore

900 Bytes
Upload GeneMamba model 22 days ago
COMPLETION_SUMMARY.md

9.24 kB
Upload GeneMamba model 22 days ago
LICENSE

8.76 kB
Upload GeneMamba model 22 days ago
PROJECT_STRUCTURE.md

7.67 kB
Upload GeneMamba model 22 days ago
README.md

13.8 kB
Sync latest GeneMamba docs and next-token training updates 20 days ago
__init__.py

768 Bytes
Upload GeneMamba model 22 days ago
config.json

800 Bytes
Sync latest GeneMamba docs and next-token training updates 20 days ago
configuration_genemamba.py

3.59 kB
Unify repo: default 24l-512d at root, add size variants via subfolder 22 days ago
model.safetensors

263 MB
xet

Fix Mamba2 loading mismatch and sync model definition files 22 days ago
modeling_genemamba.py

14 kB
Align to Mamba2 checkpoint keys and config 22 days ago
modeling_outputs.py

2.92 kB
Fix ModelOutput dataclass defaults 22 days ago
requirements.txt

149 Bytes
Upload GeneMamba model 22 days ago
setup.py

1.16 kB
Upload GeneMamba model 22 days ago
special_tokens_map.json

51 Bytes
Unify repo: default 24l-512d at root, add size variants via subfolder 22 days ago
tokenizer.json

803 kB
Unify repo: default 24l-512d at root, add size variants via subfolder 22 days ago
tokenizer_config.json

224 Bytes
Unify repo: default 24l-512d at root, add size variants via subfolder 22 days ago
trainer_state.json

4.34 kB
Fix Mamba2 loading mismatch and sync model definition files 22 days ago
training_args.bin
Detected Pickle imports (9)
- "accelerate.state.PartialState",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.SchedulerType",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.training_args.TrainingArguments",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.utils.dataclasses.DistributedType",
- "torch.device"
How to fix it?
5.05 kB
xet

Fix Mamba2 loading mismatch and sync model definition files 22 days ago
verify_setup.sh

2.38 kB
Upload GeneMamba model 22 days ago

Detected Pickle imports (9)