deepdml/whisper-small-ar-quran-mix

Whisper Small ar-quran

This model is a fine-tuned version of openai/whisper-small on the Quran dataset. It achieves the following results on the evaluation set:

• Loss: 1.1161
• Wer: 11.9246

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 1e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• lr_scheduler_warmup_ratio: 0.04
• training_steps: 41811

Training results

Training Loss	Epoch	Step	Validation Loss	Wer
0.069	0.0239	1000	0.6098	18.3529
0.0331	0.0478	2000	0.6068	21.3135
0.0362	0.0718	3000	0.6658	12.6054
0.0119	0.0957	4000	0.7669	77.1810
0.0097	0.1196	5000	0.7483	0.7036
0.0465	0.1435	6000	0.8107	71.6345
0.0103	0.1674	7000	0.8574	0.5642
0.01	0.1913	8000	0.9754	66.6750
0.0088	0.2153	9000	0.8795	6.2410
0.006	0.2392	10000	0.9043	29.0623
0.007	0.2631	11000	1.0010	82.3004
0.0056	0.2870	12000	0.9681	59.1593
0.0103	0.3109	13000	1.0676	52.7744
0.0157	0.3348	14000	1.0371	37.3935
0.0036	0.3588	15000	0.9451	0.1759
0.0108	0.3827	16000	0.9329	0.4752
0.0042	0.4066	17000	0.9960	45.4826
0.0052	0.4305	18000	1.0721	77.3752
0.004	0.4544	19000	0.9658	0.1850
0.0167	1.0072	20000	0.9981	11.4495
0.0046	1.0311	21000	1.0030	68.6625
0.0072	1.0550	22000	0.9918	34.6865
0.0084	1.0789	23000	1.0646	90.7870
0.0046	1.1028	24000	1.1421	82.4877
0.0076	1.1267	25000	1.0337	1.9966
0.0046	1.1507	26000	1.0411	5.1742
0.0046	1.1746	27000	1.0758	1.0988
0.0057	1.1985	28000	1.0331	18.5471
0.0012	1.2224	29000	1.0715	0.2901
0.0015	1.2463	30000	1.0870	0.1005
0.0032	1.2702	31000	1.0910	17.0029
0.0016	1.2942	32000	1.1208	48.9275
0.0021	1.3181	33000	1.1441	0.0366
0.0022	1.3420	34000	1.2570	76.4797
0.0124	1.3659	35000	1.1071	3.5043
0.0106	1.3898	36000	1.1721	42.3507
0.011	1.4137	37000	1.1471	4.5688
0.0107	1.4377	38000	1.1831	26.8624
0.0034	1.4616	39000	1.1529	7.2302
0.0111	2.0148	40000	1.1303	42.4854
0.0077	2.0387	41000	1.1161	11.9246

Framework versions

• Transformers 4.42.0.dev0
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.19.1

Citation

Please cite the model using the following BibTeX entry:

@misc{deepdml/whisper-small-ar-quran-mix,
      title={Fine-tuned Whisper small ASR model for speech recognition in Arabic},
      author={Jimenez, David},
      howpublished={\url{https://huggingface.co/deepdml/whisper-small-ar-quran-mix}},
      year={2025}
    }