Update README.md
Browse files
README.md
CHANGED
|
@@ -1,2 +1,20 @@
|
|
| 1 |
# Description
|
| 2 |
A Blip-2 classifier fine-tuned for classification tasks on the EasyVQA dataset. See the [github repository](https://github.com/atomwalk12/VisualQA/).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# Description
|
| 2 |
A Blip-2 classifier fine-tuned for classification tasks on the EasyVQA dataset. See the [github repository](https://github.com/atomwalk12/VisualQA/).
|
| 3 |
+
|
| 4 |
+
If you decide to reuse this model, here are the LoRa and bnb configurations that were used for training:
|
| 5 |
+
|
| 6 |
+
```python
|
| 7 |
+
BitsAndBytesConfig(
|
| 8 |
+
load_in_4bit=True,
|
| 9 |
+
bnb_4bit_quant_type="nf4",
|
| 10 |
+
bnb_4bit_compute_dtype=torch.float32,
|
| 11 |
+
)
|
| 12 |
+
|
| 13 |
+
LoraConfig(
|
| 14 |
+
r=8,
|
| 15 |
+
lora_alpha=8,
|
| 16 |
+
lora_dropout=0.1,
|
| 17 |
+
target_modules="all-linear",
|
| 18 |
+
init_lora_weights="gaussian",
|
| 19 |
+
)
|
| 20 |
+
```
|