diff --git a/README.md b/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..bc5f30d6632ac0efdc7be2e9095e9e9579af2e33
--- /dev/null
+++ b/README.md
@@ -0,0 +1,199 @@
+---
+library_name: transformers
+tags: []
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
\ No newline at end of file
diff --git a/config.json b/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..2b1b33253efa01270a364f8d0c9f4b1f75457f91
--- /dev/null
+++ b/config.json
@@ -0,0 +1,36 @@
+{
+  "_name_or_path": "/workspace/ckpt/truthfulqa-preference/lora-llama3-70b-incontext-shuffle-split1-5e-5-maxepoch20/42/checkpoint-114",
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 128000,
+  "eos_token_id": 128001,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 8192,
+  "initializer_range": 0.02,
+  "intermediate_size": 28672,
+  "max_position_embeddings": 131072,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 64,
+  "num_hidden_layers": 80,
+  "num_key_value_heads": 8,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": {
+    "factor": 8.0,
+    "high_freq_factor": 4.0,
+    "low_freq_factor": 1.0,
+    "original_max_position_embeddings": 8192,
+    "rope_type": "llama3"
+  },
+  "rope_theta": 500000.0,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.49.0",
+  "use_cache": true,
+  "vocab_size": 128256
+}
diff --git a/generation_config.json b/generation_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..655c2799211d6ea8fa10f8c3ffd538335eb6801c
--- /dev/null
+++ b/generation_config.json
@@ -0,0 +1,9 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 128000,
+  "do_sample": true,
+  "eos_token_id": 128001,
+  "temperature": 0.6,
+  "top_p": 0.9,
+  "transformers_version": "4.49.0"
+}
diff --git a/model-00001-of-00062.safetensors b/model-00001-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..22523bc4a4ead5d1fff0f89c1a334ee6e7150f63
--- /dev/null
+++ b/model-00001-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7636b7ca2b94715d58a9feaa1523b9a915a80b69c3f79f58242f7cd6b586f8fe
+size 4806672984
diff --git a/model-00002-of-00062.safetensors b/model-00002-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..3a8727248bc7ed32320a381e6855e1a47f8b3839
--- /dev/null
+++ b/model-00002-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:00fc6c300d9dcc216b3262094ee64bab53857f169334d8218da89215ca0f4bf3
+size 4362142864
diff --git a/model-00003-of-00062.safetensors b/model-00003-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..dbee79e073c73fe33b0feb1776f1d8098916b3c8
--- /dev/null
+++ b/model-00003-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2dc67a7028af8b7d15b7fc72822fb83c16bed0dc6ff1660ac60867b16c37005c
+size 4362142864
diff --git a/model-00004-of-00062.safetensors b/model-00004-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..b11ed1faa23dbb67c6604cfe996bbc34b940a05c
--- /dev/null
+++ b/model-00004-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3f616f0f72cdde09539b9868d077365be4541435f329b8a91c9f054db9cd76ce
+size 4966188864
diff --git a/model-00005-of-00062.safetensors b/model-00005-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..4c8cd2d85177f32f92ce8a22fcbcbd8813123278
--- /dev/null
+++ b/model-00005-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eb232fe678ce0ee58892373379a46c1141b3f20e59a0f0cf90fe29965a776a76
+size 4362142864
diff --git a/model-00006-of-00062.safetensors b/model-00006-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..9cdc208d1af667ea5777df279921028c8af609fe
--- /dev/null
+++ b/model-00006-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de6db62a0897374c74b3fde17d08c4d9280864225b587f61e3cc85dfad43958e
+size 4362142864
diff --git a/model-00007-of-00062.safetensors b/model-00007-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..bdbc2aaacde1a5059a45c9c90a5677f3c3ab8c01
--- /dev/null
+++ b/model-00007-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:73880980e0881ee180ba88276ed7880d41397086f8b32484a8b4d857935888e8
+size 4966188864
diff --git a/model-00008-of-00062.safetensors b/model-00008-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..14e7c51dc86544060bd7ef0f9832f1a8441f6d68
--- /dev/null
+++ b/model-00008-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:621fc2d08c2064ca9ff40216749ed3689b993e6d6b992a45feab95b92485e020
+size 4362142864
diff --git a/model-00009-of-00062.safetensors b/model-00009-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..f719a00e945efd907539d4684196406dffc79405
--- /dev/null
+++ b/model-00009-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca728ba85f132908223617c573d7760221279219ad26ad5672a5a8ad6569ef00
+size 4362142880
diff --git a/model-00010-of-00062.safetensors b/model-00010-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..f01e09c953a884bf4c089fece2889db1e16850f7
--- /dev/null
+++ b/model-00010-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a6301a0a5c803b377eb3b1816a0a670a5d2d7ddc55081373c261d5797f16f57
+size 4966188880
diff --git a/model-00011-of-00062.safetensors b/model-00011-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..baedf57773d00b3e6ae97a758a08443c8e73915a
--- /dev/null
+++ b/model-00011-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:feae989430f2f6b77c0eea8c142485bb591b81b8c4b7add9de0efe8f14099d48
+size 4362142872
diff --git a/model-00012-of-00062.safetensors b/model-00012-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ec58bb415b7c75c9289e06fdb9e1c9cb9abb3313
--- /dev/null
+++ b/model-00012-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:daac8ecd89032185a5db4a3be38333f0f30a072a788a3d1f8996adf06d14587a
+size 4362142872
diff --git a/model-00013-of-00062.safetensors b/model-00013-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..697b4222ed57495bb71ca4966cd861791f12d6b9
--- /dev/null
+++ b/model-00013-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cf7888211249e29569aaf298b98480014e0d8be637aeebcfcc32f9c6322c7181
+size 4966188880
diff --git a/model-00014-of-00062.safetensors b/model-00014-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..3b1d5727d4c9f03c8adfa21613d72a444a035313
--- /dev/null
+++ b/model-00014-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc9bd690bc92d793eec7172efe895820b6e4e760f39b950925c412a7d48d5037
+size 4362142872
diff --git a/model-00015-of-00062.safetensors b/model-00015-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2b82b34cea55c2936d68aeb71eef5acb953b1c9e
--- /dev/null
+++ b/model-00015-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f45a645d25628c50291803f5de93a6735354e1a1a8d50019fe60365407ae89fe
+size 4362142872
diff --git a/model-00016-of-00062.safetensors b/model-00016-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..937440708ab1f5a21a131472dda960b4db4d80bf
--- /dev/null
+++ b/model-00016-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:474641fba6f540269bf1dc1fc90f330d43ba1941f764bf91cfaa847ad54659ba
+size 4966188880
diff --git a/model-00017-of-00062.safetensors b/model-00017-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d5199b3064b8c9a82a7fd2bd8776b9b807dff4c6
--- /dev/null
+++ b/model-00017-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe1b588432531f247442856b7fef54f048da4e6fb0e8969022bead7b1bfc52d1
+size 4362142872
diff --git a/model-00018-of-00062.safetensors b/model-00018-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..46146a97704fe98d07c521c639c2c1f43f9dab89
--- /dev/null
+++ b/model-00018-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e5db71cb584363d4ca825e3f10478963082d0bdac81b8b8617d688de81999610
+size 4362142872
diff --git a/model-00019-of-00062.safetensors b/model-00019-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..7bc045aae01b25e0b865d19877bd3df59e962832
--- /dev/null
+++ b/model-00019-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:755ccbe7d110e7c6123b8ab3ff671b9c59f327807baf06124be33438334812ee
+size 4966188880
diff --git a/model-00020-of-00062.safetensors b/model-00020-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..6eb50319ef999155b58f3c77b6968e7547792c9e
--- /dev/null
+++ b/model-00020-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0fda72724738c73a3ac2181be2e69f4adbbeecb117dd5490850b0b8e480ad017
+size 4362142872
diff --git a/model-00021-of-00062.safetensors b/model-00021-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..66809bab4005620367435972080088e4f151be26
--- /dev/null
+++ b/model-00021-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1602b09e868b1bed4dc1b8e66b1062e4a5124aa8a17ea0794887cccebacd02c7
+size 4362142872
diff --git a/model-00022-of-00062.safetensors b/model-00022-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..a71d3e8fc20d7d591157bc6ce901d5fe88a1fc00
--- /dev/null
+++ b/model-00022-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc2bcd47a344cfab468527bacf765e296768d3cb4787b238ec2153eabbdde529
+size 4966188880
diff --git a/model-00023-of-00062.safetensors b/model-00023-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..41b61c3dc9d8c4ece761b3dc39ed2427dbbaa600
--- /dev/null
+++ b/model-00023-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:49c9a8c2653e0628ee58d678f739a342f87cbb9de37ea3aa8f90303d41bd4603
+size 4362142872
diff --git a/model-00024-of-00062.safetensors b/model-00024-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ea56161851ab057ea22fa81a96b6d241bde06d0a
--- /dev/null
+++ b/model-00024-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:35ba92cb9e518f392797f73b4cb95c8922f1c22e0ccedad63a9627781900c926
+size 4362142872
diff --git a/model-00025-of-00062.safetensors b/model-00025-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..25abaefe984ef919c6e10b1d132233b5932ae02d
--- /dev/null
+++ b/model-00025-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6fa89d34ac6719f8927e6d63473739280dae7410df09922ac63c123455d8db6
+size 4966188880
diff --git a/model-00026-of-00062.safetensors b/model-00026-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..70f3e2fea56389605a95020f15f49b602d315004
--- /dev/null
+++ b/model-00026-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b32aa067ccd4fb2728b1d6b5e3d36bba0484378dfb454f3d0f00aa08eb0bbb61
+size 4362142872
diff --git a/model-00027-of-00062.safetensors b/model-00027-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..51a421c25fc41e67332a7b0ea5c573f8eca3a02d
--- /dev/null
+++ b/model-00027-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dc9bdeea576c7ee5e21bf5ee922de00d516fe1c64ba3d1689cadf948d334693c
+size 4362142872
diff --git a/model-00028-of-00062.safetensors b/model-00028-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..914a0ebb12fff4617b03c822005c0fea7e37e251
--- /dev/null
+++ b/model-00028-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a795d96973c055d01b2daca6948685641254acec099b11b8e99eaf234e068ce
+size 4966188880
diff --git a/model-00029-of-00062.safetensors b/model-00029-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..9b5d6eaa104349df3bdf2e9c8e87b66a41b0b687
--- /dev/null
+++ b/model-00029-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b512c5852a2728ea425082956868cabd6978f69801470f93253d6463c220236b
+size 4362142872
diff --git a/model-00030-of-00062.safetensors b/model-00030-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..5076bb7132e80c2685cbd67dba671b38fc28bedc
--- /dev/null
+++ b/model-00030-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:600e8f4ff0215c9754d883a4fecdb40b72bcc48c50d8b597fb7e5569e546833d
+size 4362142872
diff --git a/model-00031-of-00062.safetensors b/model-00031-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..6a365048fdb41b69c54a78790cd12380b1005bb8
--- /dev/null
+++ b/model-00031-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ee66d489131268209e077b0ac87db85b6061a2352792c9e76b667f309c1175d
+size 4966188880
diff --git a/model-00032-of-00062.safetensors b/model-00032-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d674403433ec5c487e09fa69983d50fe7516bcff
--- /dev/null
+++ b/model-00032-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:82b1105dc0070dc663a97b032579ffa6e5a1cfb6b6dfbc314f361dbc8cbb817b
+size 4362142872
diff --git a/model-00033-of-00062.safetensors b/model-00033-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..6c55e5b5081337db4b87a05223b12edd761ea6e8
--- /dev/null
+++ b/model-00033-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:52dc93a34e95deab89e0c19bf50b921a23a3a4a5cfe902e9c31c7b230d759fb9
+size 4362142872
diff --git a/model-00034-of-00062.safetensors b/model-00034-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..8d51c1e512653e6e834555c19606cd9e82ec7d03
--- /dev/null
+++ b/model-00034-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ff6bd7c0d21ae9dd47c11741af41ff09691a675865ccf2ef218b698070960d39
+size 4966188880
diff --git a/model-00035-of-00062.safetensors b/model-00035-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..6f42efb27b465897b7ac4a8a8be152a724e0f328
--- /dev/null
+++ b/model-00035-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8bf4628e5bf5f8efc2651ee48695f8b17d2df2a5d1832eed1f10de0881e930b2
+size 4362142872
diff --git a/model-00036-of-00062.safetensors b/model-00036-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..7a14db1daf09f2d806f4216d4daee119dd7ea0f0
--- /dev/null
+++ b/model-00036-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:44f0173fe688359224812a6835a32b0e3a567fca18e941dcdd198336fe05de4f
+size 4362142872
diff --git a/model-00037-of-00062.safetensors b/model-00037-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..b982fd131d0b23fdd521c6012acfa901675c50ab
--- /dev/null
+++ b/model-00037-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca265054a4a7405b52464609c2bbbe7d74ec820c5c674e101eae8efe968eacf0
+size 4966188880
diff --git a/model-00038-of-00062.safetensors b/model-00038-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..1130820b0df8359481216e4f69b745efe394607c
--- /dev/null
+++ b/model-00038-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b9a9cca12a07f3ffbee16d3dcad31acca94f0eb804bf441f33e1fbb80a19a66e
+size 4362142872
diff --git a/model-00039-of-00062.safetensors b/model-00039-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..05ae35c70b79ab6982092469e860c791c6b15e6b
--- /dev/null
+++ b/model-00039-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2a35e261d45db888281b70fbec6dacf97a10d677dcfe7c29464cd1324bb27005
+size 4362142872
diff --git a/model-00040-of-00062.safetensors b/model-00040-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..25190be3fa42767bc37bcde837aa6ab4dbb1f707
--- /dev/null
+++ b/model-00040-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:59b17933c7dc261fb00b117d15fc1d214c8ae9384a3453cc37a5c6dc53cd5517
+size 4966188880
diff --git a/model-00041-of-00062.safetensors b/model-00041-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..7cd3cd1cd0f008be5e1ea9fa3f2d8229034e4243
--- /dev/null
+++ b/model-00041-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:407b062eee090010990df7723338a282157d6daca7ee64869f72a5bbb492f5fa
+size 4362142872
diff --git a/model-00042-of-00062.safetensors b/model-00042-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2775f72e651e90e9691c9e83ea242b8daabb5951
--- /dev/null
+++ b/model-00042-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb0e7303fc631a6d7a395892d962360702148d443e5d3532f6edfbfb9bf4470d
+size 4362142872
diff --git a/model-00043-of-00062.safetensors b/model-00043-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d388b726f7f3fdf24147da122d3fb23072989604
--- /dev/null
+++ b/model-00043-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:453b77d5cd0f295044e8c39c7f92cd021c80230ad34a756a099a377dfc561ecf
+size 4966188880
diff --git a/model-00044-of-00062.safetensors b/model-00044-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..88c84d01c134f1d22a7daf74437e01345f20be1c
--- /dev/null
+++ b/model-00044-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c8ec1762e3e616fa657e1277c4aa0bc62cfd7ce17592de967d028f45be12566
+size 4362142872
diff --git a/model-00045-of-00062.safetensors b/model-00045-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..3f67afe47bbc85b4c69fa369617798d0924838e3
--- /dev/null
+++ b/model-00045-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db408827c09c8aa85702e7f6e840a792267acf82e1a70816ca01e368f37448e2
+size 4362142872
diff --git a/model-00046-of-00062.safetensors b/model-00046-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..77cb62ebb7803f21e7ffa6b706d651974cc14f61
--- /dev/null
+++ b/model-00046-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e44789137e87d21e93bc87380415f132cccc09225d49cbbf4281d7ddecfea92
+size 4966188880
diff --git a/model-00047-of-00062.safetensors b/model-00047-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..70249416178406e502eac7dd60fa6b57491b2c9e
--- /dev/null
+++ b/model-00047-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e1c49684dda91bddc7e314a36d62b37546d8961f8e89c1c4394f176ebf8c286
+size 4362142872
diff --git a/model-00048-of-00062.safetensors b/model-00048-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ee1995357e02e4b91a454ac533fa6243be0afb41
--- /dev/null
+++ b/model-00048-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:00405f9c4efa05e58bd8e837c37a741fd79b4167e00cf0eb62a29a8388fbf3b1
+size 4362142872
diff --git a/model-00049-of-00062.safetensors b/model-00049-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..dd2d1273445b2d2f348941a03c2d285d8239b71d
--- /dev/null
+++ b/model-00049-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c421245465baafe9c2787b4fac6e645b2e1127d4a93f48529c89ba02dda264e
+size 4966188880
diff --git a/model-00050-of-00062.safetensors b/model-00050-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2f1c15ac3461c3eb049390a01d1c1477b19c8269
--- /dev/null
+++ b/model-00050-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6a100b59a1cd412ca2d12211b6449b9ca8e49dd6f286e500a50514eb662b642
+size 4362142872
diff --git a/model-00051-of-00062.safetensors b/model-00051-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..60b7dd10f3fdd00c5ee81deec098c7f713ca1fde
--- /dev/null
+++ b/model-00051-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b2fcf81f71189c241a7d116a3d2915113e4ae7255486c7346de81e8fe1552368
+size 4362142872
diff --git a/model-00052-of-00062.safetensors b/model-00052-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..b87884a999cd6e904654dfaad6bb3caf26d90202
--- /dev/null
+++ b/model-00052-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3429736b5204657f33d8152f47b02b8c1ef3f812dd8f41f8a73624e3c07d2d33
+size 4966188880
diff --git a/model-00053-of-00062.safetensors b/model-00053-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..69b4b71cb313598f31f305697b49bde5abe5842c
--- /dev/null
+++ b/model-00053-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dd31d7ee3313484fea919562072296bb06e680916a9c8eab071b3d19c53d69e3
+size 4362142872
diff --git a/model-00054-of-00062.safetensors b/model-00054-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..4b50243408b0730337cdaa2534f389d65f5dcf90
--- /dev/null
+++ b/model-00054-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee49b25fd27fde8c7b20000f0dbab4d1f09fbd16b8ec2cae0ae88ecb00477472
+size 4362142872
diff --git a/model-00055-of-00062.safetensors b/model-00055-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..58c6df69c7873abd05a0193899ba108e04359dad
--- /dev/null
+++ b/model-00055-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26f04474f930ff4ff8f0f4f6a4f9855df097d8d38bb76763dfda8b73a2909c00
+size 4966188880
diff --git a/model-00056-of-00062.safetensors b/model-00056-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..fd09bc73d02fb0f1dd018e6c3bb2bc44eb485f89
--- /dev/null
+++ b/model-00056-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c2caf90372d124d9991218f18b311671171b014650e7ccfde328ed0592d772f
+size 4362142872
diff --git a/model-00057-of-00062.safetensors b/model-00057-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..73b1203b1e14bc31ad117550ea9fb6593618b6d1
--- /dev/null
+++ b/model-00057-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9fb3dea3dfcc79f19a71c9a78a418d696a4faf3bb8ca5e10cef889c100216a0f
+size 4362142872
diff --git a/model-00058-of-00062.safetensors b/model-00058-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d9142678026a73846bb2ffded22c176e8046ec42
--- /dev/null
+++ b/model-00058-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32bbcaa3afd325d99435af8803984b251522d4e95144665cf53596d85bd2aa61
+size 4966188880
diff --git a/model-00059-of-00062.safetensors b/model-00059-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..69894df93933158d24ee39a65b8e9e14d0996fb5
--- /dev/null
+++ b/model-00059-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e04349d8a07162cea822ee22a2971be7b624ecf74c8bc8654f146fbceca7d218
+size 4362142872
diff --git a/model-00060-of-00062.safetensors b/model-00060-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..86b7d7924c3781dc0865e476825636365e0a8ff8
--- /dev/null
+++ b/model-00060-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a8073954b408fbea66cf68b6f6d0e9ae47a806f6dee1c808150c848b3d9adc16
+size 4362142872
diff --git a/model-00061-of-00062.safetensors b/model-00061-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..298e7e02a79555646ce72ac11b85d39804e5f5ca
--- /dev/null
+++ b/model-00061-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8b0a4c100ce347cf34075fb8bee23a8d921b363c4e84d082798648c2ee1d94c0
+size 4362241496
diff --git a/model-00062-of-00062.safetensors b/model-00062-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..3ae0bf5a162a1f01091797f92cb56f932a0d0c71
--- /dev/null
+++ b/model-00062-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e4016f2c0cfb4accb6a98dccb5b0d6bdb2ed46110de2224d6c6c06e262f5bcb
+size 4202692736
diff --git a/model.safetensors.index.json b/model.safetensors.index.json
new file mode 100644
index 0000000000000000000000000000000000000000..8aab69e95f0d7da106bad45a4e7c35897ecf3d80
--- /dev/null
+++ b/model.safetensors.index.json
@@ -0,0 +1,730 @@
+{
+  "metadata": {
+    "total_size": 282214825984
+  },
+  "weight_map": {
+    "lm_head.weight": "model-00062-of-00062.safetensors",
+    "model.embed_tokens.weight": "model-00001-of-00062.safetensors",
+    "model.layers.0.input_layernorm.weight": "model-00002-of-00062.safetensors",
+    "model.layers.0.mlp.down_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.0.mlp.gate_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.0.mlp.up_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.0.post_attention_layernorm.weight": "model-00002-of-00062.safetensors",
+    "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00062.safetensors",
+    "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00062.safetensors",
+    "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00062.safetensors",
+    "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00062.safetensors",
+    "model.layers.1.input_layernorm.weight": "model-00003-of-00062.safetensors",
+    "model.layers.1.mlp.down_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.1.mlp.gate_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.1.mlp.up_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.1.post_attention_layernorm.weight": "model-00003-of-00062.safetensors",
+    "model.layers.1.self_attn.k_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.1.self_attn.o_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.1.self_attn.q_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.1.self_attn.v_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.10.input_layernorm.weight": "model-00010-of-00062.safetensors",
+    "model.layers.10.mlp.down_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.10.mlp.gate_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.10.mlp.up_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.10.post_attention_layernorm.weight": "model-00010-of-00062.safetensors",
+    "model.layers.10.self_attn.k_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.10.self_attn.o_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.10.self_attn.q_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.10.self_attn.v_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.11.input_layernorm.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.mlp.down_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.mlp.gate_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.mlp.up_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.post_attention_layernorm.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.self_attn.k_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.self_attn.o_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.self_attn.q_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.self_attn.v_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.12.input_layernorm.weight": "model-00011-of-00062.safetensors",
+    "model.layers.12.mlp.down_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.12.mlp.gate_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.12.mlp.up_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.12.post_attention_layernorm.weight": "model-00011-of-00062.safetensors",
+    "model.layers.12.self_attn.k_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.12.self_attn.o_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.12.self_attn.q_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.12.self_attn.v_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.13.input_layernorm.weight": "model-00012-of-00062.safetensors",
+    "model.layers.13.mlp.down_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.13.mlp.gate_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.13.mlp.up_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.13.post_attention_layernorm.weight": "model-00012-of-00062.safetensors",
+    "model.layers.13.self_attn.k_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.13.self_attn.o_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.13.self_attn.q_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.13.self_attn.v_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.14.input_layernorm.weight": "model-00013-of-00062.safetensors",
+    "model.layers.14.mlp.down_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.14.mlp.gate_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.14.mlp.up_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.14.post_attention_layernorm.weight": "model-00013-of-00062.safetensors",
+    "model.layers.14.self_attn.k_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.14.self_attn.o_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.14.self_attn.q_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.14.self_attn.v_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.15.input_layernorm.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.mlp.down_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.mlp.gate_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.mlp.up_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.post_attention_layernorm.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.self_attn.k_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.self_attn.o_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.self_attn.q_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.self_attn.v_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.16.input_layernorm.weight": "model-00014-of-00062.safetensors",
+    "model.layers.16.mlp.down_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.16.mlp.gate_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.16.mlp.up_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.16.post_attention_layernorm.weight": "model-00014-of-00062.safetensors",
+    "model.layers.16.self_attn.k_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.16.self_attn.o_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.16.self_attn.q_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.16.self_attn.v_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.17.input_layernorm.weight": "model-00015-of-00062.safetensors",
+    "model.layers.17.mlp.down_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.17.mlp.gate_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.17.mlp.up_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.17.post_attention_layernorm.weight": "model-00015-of-00062.safetensors",
+    "model.layers.17.self_attn.k_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.17.self_attn.o_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.17.self_attn.q_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.17.self_attn.v_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.18.input_layernorm.weight": "model-00016-of-00062.safetensors",
+    "model.layers.18.mlp.down_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.18.mlp.gate_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.18.mlp.up_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.18.post_attention_layernorm.weight": "model-00016-of-00062.safetensors",
+    "model.layers.18.self_attn.k_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.18.self_attn.o_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.18.self_attn.q_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.18.self_attn.v_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.19.input_layernorm.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.mlp.down_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.mlp.gate_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.mlp.up_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.post_attention_layernorm.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.self_attn.k_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.self_attn.o_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.self_attn.q_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.self_attn.v_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.2.input_layernorm.weight": "model-00004-of-00062.safetensors",
+    "model.layers.2.mlp.down_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.2.mlp.gate_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.2.mlp.up_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.2.post_attention_layernorm.weight": "model-00004-of-00062.safetensors",
+    "model.layers.2.self_attn.k_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.2.self_attn.o_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.2.self_attn.q_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.2.self_attn.v_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.20.input_layernorm.weight": "model-00017-of-00062.safetensors",
+    "model.layers.20.mlp.down_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.20.mlp.gate_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.20.mlp.up_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.20.post_attention_layernorm.weight": "model-00017-of-00062.safetensors",
+    "model.layers.20.self_attn.k_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.20.self_attn.o_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.20.self_attn.q_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.20.self_attn.v_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.21.input_layernorm.weight": "model-00018-of-00062.safetensors",
+    "model.layers.21.mlp.down_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.21.mlp.gate_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.21.mlp.up_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.21.post_attention_layernorm.weight": "model-00018-of-00062.safetensors",
+    "model.layers.21.self_attn.k_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.21.self_attn.o_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.21.self_attn.q_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.21.self_attn.v_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.22.input_layernorm.weight": "model-00019-of-00062.safetensors",
+    "model.layers.22.mlp.down_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.22.mlp.gate_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.22.mlp.up_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.22.post_attention_layernorm.weight": "model-00019-of-00062.safetensors",
+    "model.layers.22.self_attn.k_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.22.self_attn.o_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.22.self_attn.q_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.22.self_attn.v_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.23.input_layernorm.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.mlp.down_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.mlp.gate_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.mlp.up_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.post_attention_layernorm.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.self_attn.k_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.self_attn.o_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.self_attn.q_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.self_attn.v_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.24.input_layernorm.weight": "model-00020-of-00062.safetensors",
+    "model.layers.24.mlp.down_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.24.mlp.gate_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.24.mlp.up_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.24.post_attention_layernorm.weight": "model-00020-of-00062.safetensors",
+    "model.layers.24.self_attn.k_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.24.self_attn.o_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.24.self_attn.q_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.24.self_attn.v_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.25.input_layernorm.weight": "model-00021-of-00062.safetensors",
+    "model.layers.25.mlp.down_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.25.mlp.gate_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.25.mlp.up_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.25.post_attention_layernorm.weight": "model-00021-of-00062.safetensors",
+    "model.layers.25.self_attn.k_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.25.self_attn.o_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.25.self_attn.q_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.25.self_attn.v_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.26.input_layernorm.weight": "model-00022-of-00062.safetensors",
+    "model.layers.26.mlp.down_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.26.mlp.gate_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.26.mlp.up_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.26.post_attention_layernorm.weight": "model-00022-of-00062.safetensors",
+    "model.layers.26.self_attn.k_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.26.self_attn.o_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.26.self_attn.q_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.26.self_attn.v_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.27.input_layernorm.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.mlp.down_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.mlp.gate_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.mlp.up_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.post_attention_layernorm.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.self_attn.k_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.self_attn.o_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.self_attn.q_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.self_attn.v_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.28.input_layernorm.weight": "model-00023-of-00062.safetensors",
+    "model.layers.28.mlp.down_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.28.mlp.gate_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.28.mlp.up_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.28.post_attention_layernorm.weight": "model-00023-of-00062.safetensors",
+    "model.layers.28.self_attn.k_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.28.self_attn.o_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.28.self_attn.q_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.28.self_attn.v_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.29.input_layernorm.weight": "model-00024-of-00062.safetensors",
+    "model.layers.29.mlp.down_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.29.mlp.gate_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.29.mlp.up_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.29.post_attention_layernorm.weight": "model-00024-of-00062.safetensors",
+    "model.layers.29.self_attn.k_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.29.self_attn.o_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.29.self_attn.q_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.29.self_attn.v_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.3.input_layernorm.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.mlp.down_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.mlp.gate_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.mlp.up_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.post_attention_layernorm.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.self_attn.k_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.self_attn.o_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.self_attn.q_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.self_attn.v_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.30.input_layernorm.weight": "model-00025-of-00062.safetensors",
+    "model.layers.30.mlp.down_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.30.mlp.gate_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.30.mlp.up_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.30.post_attention_layernorm.weight": "model-00025-of-00062.safetensors",
+    "model.layers.30.self_attn.k_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.30.self_attn.o_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.30.self_attn.q_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.30.self_attn.v_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.31.input_layernorm.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.mlp.down_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.mlp.gate_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.mlp.up_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.post_attention_layernorm.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.self_attn.k_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.self_attn.o_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.self_attn.q_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.self_attn.v_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.32.input_layernorm.weight": "model-00026-of-00062.safetensors",
+    "model.layers.32.mlp.down_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.32.mlp.gate_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.32.mlp.up_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.32.post_attention_layernorm.weight": "model-00026-of-00062.safetensors",
+    "model.layers.32.self_attn.k_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.32.self_attn.o_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.32.self_attn.q_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.32.self_attn.v_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.33.input_layernorm.weight": "model-00027-of-00062.safetensors",
+    "model.layers.33.mlp.down_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.33.mlp.gate_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.33.mlp.up_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.33.post_attention_layernorm.weight": "model-00027-of-00062.safetensors",
+    "model.layers.33.self_attn.k_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.33.self_attn.o_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.33.self_attn.q_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.33.self_attn.v_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.34.input_layernorm.weight": "model-00028-of-00062.safetensors",
+    "model.layers.34.mlp.down_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.34.mlp.gate_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.34.mlp.up_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.34.post_attention_layernorm.weight": "model-00028-of-00062.safetensors",
+    "model.layers.34.self_attn.k_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.34.self_attn.o_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.34.self_attn.q_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.34.self_attn.v_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.35.input_layernorm.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.mlp.down_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.mlp.gate_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.mlp.up_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.post_attention_layernorm.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.self_attn.k_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.self_attn.o_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.self_attn.q_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.self_attn.v_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.36.input_layernorm.weight": "model-00029-of-00062.safetensors",
+    "model.layers.36.mlp.down_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.36.mlp.gate_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.36.mlp.up_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.36.post_attention_layernorm.weight": "model-00029-of-00062.safetensors",
+    "model.layers.36.self_attn.k_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.36.self_attn.o_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.36.self_attn.q_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.36.self_attn.v_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.37.input_layernorm.weight": "model-00030-of-00062.safetensors",
+    "model.layers.37.mlp.down_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.37.mlp.gate_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.37.mlp.up_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.37.post_attention_layernorm.weight": "model-00030-of-00062.safetensors",
+    "model.layers.37.self_attn.k_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.37.self_attn.o_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.37.self_attn.q_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.37.self_attn.v_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.38.input_layernorm.weight": "model-00031-of-00062.safetensors",
+    "model.layers.38.mlp.down_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.38.mlp.gate_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.38.mlp.up_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.38.post_attention_layernorm.weight": "model-00031-of-00062.safetensors",
+    "model.layers.38.self_attn.k_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.38.self_attn.o_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.38.self_attn.q_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.38.self_attn.v_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.39.input_layernorm.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.mlp.down_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.mlp.gate_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.mlp.up_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.post_attention_layernorm.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.self_attn.k_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.self_attn.o_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.self_attn.q_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.self_attn.v_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.4.input_layernorm.weight": "model-00005-of-00062.safetensors",
+    "model.layers.4.mlp.down_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.4.mlp.gate_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.4.mlp.up_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.4.post_attention_layernorm.weight": "model-00005-of-00062.safetensors",
+    "model.layers.4.self_attn.k_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.4.self_attn.o_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.4.self_attn.q_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.4.self_attn.v_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.40.input_layernorm.weight": "model-00032-of-00062.safetensors",
+    "model.layers.40.mlp.down_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.40.mlp.gate_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.40.mlp.up_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.40.post_attention_layernorm.weight": "model-00032-of-00062.safetensors",
+    "model.layers.40.self_attn.k_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.40.self_attn.o_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.40.self_attn.q_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.40.self_attn.v_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.41.input_layernorm.weight": "model-00033-of-00062.safetensors",
+    "model.layers.41.mlp.down_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.41.mlp.gate_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.41.mlp.up_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.41.post_attention_layernorm.weight": "model-00033-of-00062.safetensors",
+    "model.layers.41.self_attn.k_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.41.self_attn.o_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.41.self_attn.q_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.41.self_attn.v_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.42.input_layernorm.weight": "model-00034-of-00062.safetensors",
+    "model.layers.42.mlp.down_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.42.mlp.gate_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.42.mlp.up_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.42.post_attention_layernorm.weight": "model-00034-of-00062.safetensors",
+    "model.layers.42.self_attn.k_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.42.self_attn.o_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.42.self_attn.q_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.42.self_attn.v_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.43.input_layernorm.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.mlp.down_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.mlp.gate_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.mlp.up_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.post_attention_layernorm.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.self_attn.k_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.self_attn.o_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.self_attn.q_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.self_attn.v_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.44.input_layernorm.weight": "model-00035-of-00062.safetensors",
+    "model.layers.44.mlp.down_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.44.mlp.gate_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.44.mlp.up_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.44.post_attention_layernorm.weight": "model-00035-of-00062.safetensors",
+    "model.layers.44.self_attn.k_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.44.self_attn.o_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.44.self_attn.q_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.44.self_attn.v_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.45.input_layernorm.weight": "model-00036-of-00062.safetensors",
+    "model.layers.45.mlp.down_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.45.mlp.gate_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.45.mlp.up_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.45.post_attention_layernorm.weight": "model-00036-of-00062.safetensors",
+    "model.layers.45.self_attn.k_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.45.self_attn.o_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.45.self_attn.q_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.45.self_attn.v_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.46.input_layernorm.weight": "model-00037-of-00062.safetensors",
+    "model.layers.46.mlp.down_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.46.mlp.gate_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.46.mlp.up_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.46.post_attention_layernorm.weight": "model-00037-of-00062.safetensors",
+    "model.layers.46.self_attn.k_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.46.self_attn.o_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.46.self_attn.q_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.46.self_attn.v_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.47.input_layernorm.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.mlp.down_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.mlp.gate_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.mlp.up_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.post_attention_layernorm.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.self_attn.k_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.self_attn.o_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.self_attn.q_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.self_attn.v_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.48.input_layernorm.weight": "model-00038-of-00062.safetensors",
+    "model.layers.48.mlp.down_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.48.mlp.gate_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.48.mlp.up_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.48.post_attention_layernorm.weight": "model-00038-of-00062.safetensors",
+    "model.layers.48.self_attn.k_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.48.self_attn.o_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.48.self_attn.q_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.48.self_attn.v_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.49.input_layernorm.weight": "model-00039-of-00062.safetensors",
+    "model.layers.49.mlp.down_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.49.mlp.gate_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.49.mlp.up_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.49.post_attention_layernorm.weight": "model-00039-of-00062.safetensors",
+    "model.layers.49.self_attn.k_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.49.self_attn.o_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.49.self_attn.q_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.49.self_attn.v_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.5.input_layernorm.weight": "model-00006-of-00062.safetensors",
+    "model.layers.5.mlp.down_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.5.mlp.gate_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.5.mlp.up_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.5.post_attention_layernorm.weight": "model-00006-of-00062.safetensors",
+    "model.layers.5.self_attn.k_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.5.self_attn.o_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.5.self_attn.q_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.5.self_attn.v_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.50.input_layernorm.weight": "model-00040-of-00062.safetensors",
+    "model.layers.50.mlp.down_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.50.mlp.gate_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.50.mlp.up_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.50.post_attention_layernorm.weight": "model-00040-of-00062.safetensors",
+    "model.layers.50.self_attn.k_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.50.self_attn.o_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.50.self_attn.q_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.50.self_attn.v_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.51.input_layernorm.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.mlp.down_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.mlp.gate_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.mlp.up_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.post_attention_layernorm.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.self_attn.k_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.self_attn.o_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.self_attn.q_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.self_attn.v_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.52.input_layernorm.weight": "model-00041-of-00062.safetensors",
+    "model.layers.52.mlp.down_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.52.mlp.gate_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.52.mlp.up_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.52.post_attention_layernorm.weight": "model-00041-of-00062.safetensors",
+    "model.layers.52.self_attn.k_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.52.self_attn.o_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.52.self_attn.q_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.52.self_attn.v_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.53.input_layernorm.weight": "model-00042-of-00062.safetensors",
+    "model.layers.53.mlp.down_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.53.mlp.gate_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.53.mlp.up_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.53.post_attention_layernorm.weight": "model-00042-of-00062.safetensors",
+    "model.layers.53.self_attn.k_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.53.self_attn.o_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.53.self_attn.q_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.53.self_attn.v_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.54.input_layernorm.weight": "model-00043-of-00062.safetensors",
+    "model.layers.54.mlp.down_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.54.mlp.gate_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.54.mlp.up_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.54.post_attention_layernorm.weight": "model-00043-of-00062.safetensors",
+    "model.layers.54.self_attn.k_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.54.self_attn.o_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.54.self_attn.q_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.54.self_attn.v_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.55.input_layernorm.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.mlp.down_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.mlp.gate_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.mlp.up_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.post_attention_layernorm.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.self_attn.k_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.self_attn.o_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.self_attn.q_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.self_attn.v_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.56.input_layernorm.weight": "model-00044-of-00062.safetensors",
+    "model.layers.56.mlp.down_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.56.mlp.gate_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.56.mlp.up_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.56.post_attention_layernorm.weight": "model-00044-of-00062.safetensors",
+    "model.layers.56.self_attn.k_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.56.self_attn.o_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.56.self_attn.q_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.56.self_attn.v_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.57.input_layernorm.weight": "model-00045-of-00062.safetensors",
+    "model.layers.57.mlp.down_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.57.mlp.gate_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.57.mlp.up_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.57.post_attention_layernorm.weight": "model-00045-of-00062.safetensors",
+    "model.layers.57.self_attn.k_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.57.self_attn.o_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.57.self_attn.q_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.57.self_attn.v_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.58.input_layernorm.weight": "model-00046-of-00062.safetensors",
+    "model.layers.58.mlp.down_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.58.mlp.gate_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.58.mlp.up_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.58.post_attention_layernorm.weight": "model-00046-of-00062.safetensors",
+    "model.layers.58.self_attn.k_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.58.self_attn.o_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.58.self_attn.q_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.58.self_attn.v_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.59.input_layernorm.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.mlp.down_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.mlp.gate_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.mlp.up_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.post_attention_layernorm.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.self_attn.k_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.self_attn.o_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.self_attn.q_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.self_attn.v_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.6.input_layernorm.weight": "model-00007-of-00062.safetensors",
+    "model.layers.6.mlp.down_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.6.mlp.gate_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.6.mlp.up_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.6.post_attention_layernorm.weight": "model-00007-of-00062.safetensors",
+    "model.layers.6.self_attn.k_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.6.self_attn.o_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.6.self_attn.q_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.6.self_attn.v_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.60.input_layernorm.weight": "model-00047-of-00062.safetensors",
+    "model.layers.60.mlp.down_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.60.mlp.gate_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.60.mlp.up_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.60.post_attention_layernorm.weight": "model-00047-of-00062.safetensors",
+    "model.layers.60.self_attn.k_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.60.self_attn.o_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.60.self_attn.q_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.60.self_attn.v_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.61.input_layernorm.weight": "model-00048-of-00062.safetensors",
+    "model.layers.61.mlp.down_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.61.mlp.gate_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.61.mlp.up_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.61.post_attention_layernorm.weight": "model-00048-of-00062.safetensors",
+    "model.layers.61.self_attn.k_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.61.self_attn.o_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.61.self_attn.q_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.61.self_attn.v_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.62.input_layernorm.weight": "model-00049-of-00062.safetensors",
+    "model.layers.62.mlp.down_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.62.mlp.gate_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.62.mlp.up_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.62.post_attention_layernorm.weight": "model-00049-of-00062.safetensors",
+    "model.layers.62.self_attn.k_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.62.self_attn.o_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.62.self_attn.q_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.62.self_attn.v_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.63.input_layernorm.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.mlp.down_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.mlp.gate_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.mlp.up_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.post_attention_layernorm.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.self_attn.k_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.self_attn.o_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.self_attn.q_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.self_attn.v_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.64.input_layernorm.weight": "model-00050-of-00062.safetensors",
+    "model.layers.64.mlp.down_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.64.mlp.gate_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.64.mlp.up_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.64.post_attention_layernorm.weight": "model-00050-of-00062.safetensors",
+    "model.layers.64.self_attn.k_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.64.self_attn.o_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.64.self_attn.q_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.64.self_attn.v_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.65.input_layernorm.weight": "model-00051-of-00062.safetensors",
+    "model.layers.65.mlp.down_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.65.mlp.gate_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.65.mlp.up_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.65.post_attention_layernorm.weight": "model-00051-of-00062.safetensors",
+    "model.layers.65.self_attn.k_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.65.self_attn.o_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.65.self_attn.q_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.65.self_attn.v_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.66.input_layernorm.weight": "model-00052-of-00062.safetensors",
+    "model.layers.66.mlp.down_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.66.mlp.gate_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.66.mlp.up_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.66.post_attention_layernorm.weight": "model-00052-of-00062.safetensors",
+    "model.layers.66.self_attn.k_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.66.self_attn.o_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.66.self_attn.q_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.66.self_attn.v_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.67.input_layernorm.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.mlp.down_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.mlp.gate_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.mlp.up_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.post_attention_layernorm.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.self_attn.k_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.self_attn.o_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.self_attn.q_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.self_attn.v_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.68.input_layernorm.weight": "model-00053-of-00062.safetensors",
+    "model.layers.68.mlp.down_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.68.mlp.gate_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.68.mlp.up_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.68.post_attention_layernorm.weight": "model-00053-of-00062.safetensors",
+    "model.layers.68.self_attn.k_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.68.self_attn.o_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.68.self_attn.q_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.68.self_attn.v_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.69.input_layernorm.weight": "model-00054-of-00062.safetensors",
+    "model.layers.69.mlp.down_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.69.mlp.gate_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.69.mlp.up_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.69.post_attention_layernorm.weight": "model-00054-of-00062.safetensors",
+    "model.layers.69.self_attn.k_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.69.self_attn.o_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.69.self_attn.q_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.69.self_attn.v_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.7.input_layernorm.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.mlp.down_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.mlp.gate_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.mlp.up_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.post_attention_layernorm.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.self_attn.k_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.self_attn.o_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.self_attn.q_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.self_attn.v_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.70.input_layernorm.weight": "model-00055-of-00062.safetensors",
+    "model.layers.70.mlp.down_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.70.mlp.gate_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.70.mlp.up_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.70.post_attention_layernorm.weight": "model-00055-of-00062.safetensors",
+    "model.layers.70.self_attn.k_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.70.self_attn.o_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.70.self_attn.q_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.70.self_attn.v_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.71.input_layernorm.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.mlp.down_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.mlp.gate_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.mlp.up_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.post_attention_layernorm.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.self_attn.k_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.self_attn.o_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.self_attn.q_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.self_attn.v_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.72.input_layernorm.weight": "model-00056-of-00062.safetensors",
+    "model.layers.72.mlp.down_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.72.mlp.gate_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.72.mlp.up_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.72.post_attention_layernorm.weight": "model-00056-of-00062.safetensors",
+    "model.layers.72.self_attn.k_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.72.self_attn.o_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.72.self_attn.q_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.72.self_attn.v_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.73.input_layernorm.weight": "model-00057-of-00062.safetensors",
+    "model.layers.73.mlp.down_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.73.mlp.gate_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.73.mlp.up_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.73.post_attention_layernorm.weight": "model-00057-of-00062.safetensors",
+    "model.layers.73.self_attn.k_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.73.self_attn.o_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.73.self_attn.q_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.73.self_attn.v_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.74.input_layernorm.weight": "model-00058-of-00062.safetensors",
+    "model.layers.74.mlp.down_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.74.mlp.gate_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.74.mlp.up_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.74.post_attention_layernorm.weight": "model-00058-of-00062.safetensors",
+    "model.layers.74.self_attn.k_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.74.self_attn.o_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.74.self_attn.q_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.74.self_attn.v_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.75.input_layernorm.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.mlp.down_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.mlp.gate_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.mlp.up_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.post_attention_layernorm.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.self_attn.k_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.self_attn.o_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.self_attn.q_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.self_attn.v_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.76.input_layernorm.weight": "model-00059-of-00062.safetensors",
+    "model.layers.76.mlp.down_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.76.mlp.gate_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.76.mlp.up_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.76.post_attention_layernorm.weight": "model-00059-of-00062.safetensors",
+    "model.layers.76.self_attn.k_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.76.self_attn.o_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.76.self_attn.q_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.76.self_attn.v_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.77.input_layernorm.weight": "model-00060-of-00062.safetensors",
+    "model.layers.77.mlp.down_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.77.mlp.gate_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.77.mlp.up_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.77.post_attention_layernorm.weight": "model-00060-of-00062.safetensors",
+    "model.layers.77.self_attn.k_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.77.self_attn.o_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.77.self_attn.q_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.77.self_attn.v_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.78.input_layernorm.weight": "model-00061-of-00062.safetensors",
+    "model.layers.78.mlp.down_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.78.mlp.gate_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.78.mlp.up_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.78.post_attention_layernorm.weight": "model-00061-of-00062.safetensors",
+    "model.layers.78.self_attn.k_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.78.self_attn.o_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.78.self_attn.q_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.78.self_attn.v_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.79.input_layernorm.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.mlp.down_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.mlp.gate_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.mlp.up_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.post_attention_layernorm.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.self_attn.k_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.self_attn.o_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.self_attn.q_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.self_attn.v_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.8.input_layernorm.weight": "model-00008-of-00062.safetensors",
+    "model.layers.8.mlp.down_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.8.mlp.gate_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.8.mlp.up_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.8.post_attention_layernorm.weight": "model-00008-of-00062.safetensors",
+    "model.layers.8.self_attn.k_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.8.self_attn.o_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.8.self_attn.q_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.8.self_attn.v_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.9.input_layernorm.weight": "model-00009-of-00062.safetensors",
+    "model.layers.9.mlp.down_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.9.mlp.gate_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.9.mlp.up_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.9.post_attention_layernorm.weight": "model-00009-of-00062.safetensors",
+    "model.layers.9.self_attn.k_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.9.self_attn.o_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.9.self_attn.q_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.9.self_attn.v_proj.weight": "model-00008-of-00062.safetensors",
+    "model.norm.weight": "model-00061-of-00062.safetensors"
+  }
+}