Datasets for high quality small LM model pre-training.
George Grigorev
thepowerfuldeez
AI & ML interests
Building stuff with LLMs. Fine-tuning, context extension
Recent Activity
updated
a model
about 9 hours ago
thepowerfuldeez/imu1_base_decay_continue_checkpoints
updated
a model
4 days ago
thepowerfuldeez/imu1_base_stable_continue_checkpoints
updated
a dataset
5 days ago
thepowerfuldeez/imu1_base_decay_corpus
Organizations
None yet
models
15
thepowerfuldeez/imu1_base_decay_continue_checkpoints
Updated
thepowerfuldeez/imu1_base_stable_continue_checkpoints
Updated
thepowerfuldeez/imu_1_midtrain
0.5B
•
Updated
•
22
thepowerfuldeez/imu_1_base
0.5B
•
Updated
•
32
thepowerfuldeez/seGPT-tokenizer
Updated
thepowerfuldeez/0925_bigbench_code_tokenizer
Updated
thepowerfuldeez/sft_saved_merged
Updated
thepowerfuldeez/Openthoughts-SFT-Qwen3-0.6B-GRPO
Updated
thepowerfuldeez/nGPT-tokenizer
Updated
thepowerfuldeez/cube-aurora-lamp
Text-to-Image
•
Updated
•
6
•
datasets
10
thepowerfuldeez/imu1_base_decay_corpus
Updated
•
788
thepowerfuldeez/imu1_base_stable_corpus
Updated
•
45
thepowerfuldeez/the-stack-v2-extra-python-content
Viewer
•
Updated
•
10.6k
•
27
thepowerfuldeez/the-stack-v2-train-smol-ids-updated-content
Viewer
•
Updated
•
387k
•
204
thepowerfuldeez/the-stack-v2-train-smol-ids-updated
Viewer
•
Updated
•
409k
•
57
thepowerfuldeez/deepscale_r_math_problems_balanced
Viewer
•
Updated
•
14.7k
•
16
•
1
thepowerfuldeez/deepscale_r_math_problems
Viewer
•
Updated
•
79.5k
•
14
thepowerfuldeez/wiki_articles_reverse_cot
Viewer
•
Updated
•
13.8k
•
22
thepowerfuldeez/Qwen-summarize-dataset-train
Viewer
•
Updated
•
20.4k
•
36
•
1
thepowerfuldeez/Qwen-summarize-dataset-test
Viewer
•
Updated
•
187
•
31