Update README.md
Browse files
README.md
CHANGED
@@ -1,7 +1,7 @@
|
|
1 |
---
|
2 |
license: mit
|
3 |
datasets:
|
4 |
-
- Bifrost-AI/Solana-
|
5 |
language:
|
6 |
- en
|
7 |
metrics:
|
@@ -19,32 +19,27 @@ tags:
|
|
19 |
library_name: transformers
|
20 |
---
|
21 |
# Phi 4 Bifrost SOL 3B (Mini Instruct)
|
22 |
-
### This fine-tuned variant of Microsoft's Phi 4 Mini Instruct model was fine-tuned via supervised fine-tuning (SFT) on blockchain-specific datasets(Bifrost-AI/Solana-
|
23 |
-
The dataset
|
24 |
|
25 |
-
Phi 4 Bifrost SOL Mini Instruct is in active development with
|
26 |
|
27 |
## Training Session:
|
28 |
-
- Time:
|
29 |
- GPU: NVIDIA GeForce RTX 3090
|
30 |
-
- Batches:
|
31 |
- Batch-size: 1
|
32 |
- Learning-rate: 2e-5
|
33 |
-
- Training-loss: 0.
|
34 |
-
- Eval-loss: 0.
|
35 |
|
36 |
-
|
37 |
-
|
38 |
-
-
|
39 |
-
-
|
40 |
-
|
41 |
-
|
42 |
-
|
43 |
-
- 201 Solana blockchain knowledge samples
|
44 |
-
- 49 Solana typescript coding samples
|
45 |
-
- 86 Solana rust coding samples
|
46 |
-
- 13 Solnet SDK knowledge samples
|
47 |
-
- 11 Solana c# coding samples
|
48 |
|
49 |
#### Example
|
50 |
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
datasets:
|
4 |
+
- Bifrost-AI/Solana-Vanguard-Challenge
|
5 |
language:
|
6 |
- en
|
7 |
metrics:
|
|
|
19 |
library_name: transformers
|
20 |
---
|
21 |
# Phi 4 Bifrost SOL 3B (Mini Instruct)
|
22 |
+
### This fine-tuned variant of Microsoft's Phi 4 Mini Instruct model was fine-tuned via supervised fine-tuning (SFT) on blockchain-specific datasets(Bifrost-AI/Solana-Vanguard-Challenge), optimized for downstream tasks in blockchain coding and smart contract development on the Solana ecosystem.
|
23 |
+
The **Solana Vanguard Challenge** dataset, comprising 1,000 diverse and in-depth questions, offers full-spectrum coverage of the Solana ecosystem. It spans fundamental blockchain concepts, advanced on-chain programming in Rust and the Anchor framework, client-side integration in TypeScript, detailed security strategies, and performance as well as regulatory considerations.
|
24 |
|
25 |
+
Phi 4 Bifrost SOL Mini Instruct is in active development with additional fine-tuning sessions, & benchmark statistics coming soon!
|
26 |
|
27 |
## Training Session:
|
28 |
+
- Time: 9 hours & 33 minutes
|
29 |
- GPU: NVIDIA GeForce RTX 3090
|
30 |
+
- Batches: 2500
|
31 |
- Batch-size: 1
|
32 |
- Learning-rate: 2e-5
|
33 |
+
- Training-loss: 0.88
|
34 |
+
- Eval-loss: 0.68
|
35 |
|
36 |
+
## Dataset Composition
|
37 |
+
- **Total Questions:** 1,000
|
38 |
+
- **Languages Covered:**
|
39 |
+
- **Rust:** On-chain smart contract development, security best practices, advanced state management, CPIs, PDAs, and more.
|
40 |
+
- **TypeScript:** Client-side integration using @solana/web3.js, wallet adapters, Metaplex for NFT protocols, dynamic transaction composition, and front-end dApp development.
|
41 |
+
- **Planned Extensions:**
|
42 |
+
- **C# (Solnet):** To be integrated later for .NET ecosystem coverage.
|
|
|
|
|
|
|
|
|
|
|
43 |
|
44 |
#### Example
|
45 |
|