Add new SentenceTransformer model

README.md

@@ -6,65 +6,67 @@ tags:
 - generated_from_trainer
 - dataset_size:4893
 - loss:TripletLoss
-base_model: microsoft/deberta-base
+base_model: distilbert/distilroberta-base
 widget:
-- source_sentence: Perfect working condition. Then what you say leads obviously to
-    one alternative. The source of radiation is not from our universe. Nor in our
-    universe, Captain. It came from outside. Outside? Yes, that would explain a lot.
-    Another universe, perhaps in another dimension, occupying the same space at the
-    same time. The possible existence of a parallel universe has been scientifically
-    conceded, Captain.[SEP]All right. What would happen if another universe, say a
-    minus universe, came into contact with a positive universe such as ours?
+- source_sentence: Indeed. Allow me to rephrase. Will you join me for dinner? I am
+    honoured, Commander. Are the guards also invited? Mister Spock. That corridor
+    is forbidden to all but loyal Romulans. Of course. I shall obey your restrictions.[SEP]I
+    hope that one day there will be no need for you to observe any restrictions.
   sentences:
-  - ' How''s your leg? You seem to be favoring your left side.'
-  - Unquestionably a warp. A distortion of physical laws on an immense scale.
-  - Queen to queen's level three.
-- source_sentence: The transporter refuses to function, even at maximum power. But
-    all the circuits test out. It appears to be the same energy block that's jamming
-    our communications. I cannot pinpoint a source. Captain, there's something over
-    there in the trees. Metal alloy like the planetary shell. It might tell us something.
-    There's an inscription, several languages.[SEP]The Keeper's dead.
+  - ' EKG showed arrhythmia, pRobably just a mild heart attack.'
+  - It would be illogical to assume that all conditions remain stable.
+  - Your very presence will destroy the people you seek. Surely you know that.
+- source_sentence: Mudd. And he has Christine. She's in danger. My love. He's going
+    planet side. No. Not with my Christine. Relax, darling. I'll set you down somewhere
+    safe and then I'll be off discreetly. We must go after them, Captain. I'll lead
+    a landing party.[SEP]Spock, you're obviously not yourself. Maybe some rest.
   sentences:
-  - ' How much heat are you taking from the parents?'
-  - This vault was constructed about a half a million years ago. About the same time
-    the planet surface was destroyed, if our sensor readings are accurate.
-  - An astute medical observation, Doctor, if we can believe this information. Tricorder
-    readings indicate there is a body interred here.
-- source_sentence: Welcome home, Jim. I had a whole universe to myself after the Defiant
-    was thrown out. There was absolutely no one else in it. I must say I prefer a
-    crowded universe much better. How did you two get along without me? Oh, we managed.
-    Mister Spock gave the orders, and I found the answers. Good. No problems between
-    you? None worth reporting, Captain.[SEP]Try me.
+  - ' If it''s meningococcus, half the passengers on this plane could get infected
+    and die before we reach New York.'
+  - Tactically well planned. When the Federation investigates, we'll be recorded as
+    just another mysterious starship disappearance.
+  - Captain, I insist upon going. Christine. I can't stand the thought of any danger
+    to her, to the woman I love.
+- source_sentence: That is precisely why we should not fight. My ship is at stake.
+    I will not harm others, Captain. His convictions are most profound in this matter,
+    Captain. So are mine, Spock. If I believed that there was a peaceful way out of
+    this[SEP]The risk will be mine alone. If I fail, you lose nothing. After all,
+    I'm no warrior.
   sentences:
-  - Only such minor disturbances as are inevitable when humans are involved.
-  - ' Harder than the right?'
-  - Good. Report to Sickbay, Mister Sulu.
-- source_sentence: Too bad, Captain. Maybe I can't go home, but neither can you. You're
-    as much a prisoner in time as I am. Recommendation for his disposition, dear?
-    Maintenance note. My recording computer has a serious malfunction. Recommend it
-    either be corrected or scrapped. Compute. Computed. Bridge to Captain Kirk.[SEP]Kirk
-    here.
+  - The captain knows that I have fought at his side before and will do so now, if
+    need be. However, I too, am a Vulcan, bred to peace. Let him attempt it.
+  - ' A torch test could "�'
+  - I have retained more strength than any of you. My internal structure is different,
+    Captain, my life span longer. It is wiser if I go to the temple to try and find
+    the communicators and contact the ship.
+- source_sentence: So now it has virtually unlimited power. Captain, what'll we do?
+    Spock, Scotty, come with me. Report, Spock. The multitronic unit is drawing more
+    and more power directly from the warp engines. The computer now controls all helm,
+    navigation, and engineering functions. And communications and fire control.[SEP]We'll
+    reach the rendezvous point for the war games within an hour. We must regain control
+    of the ship by then.
   sentences:
-  - Have some new information regarding Captain Christopher. Important I see you both
-    immediately.
-  - Several times, Captain. I do not wish to surrender hope, but the facts remain
-    unchangeable.
-  - ' [almost imitating an orgasm] Ohhh, yes! Get a head CT, draw a blood culture,
-    run a chem panel and get a complete blood count.'
-- source_sentence: That's paradise? We have no need or want, Captain. It's a true
-    Eden, Jim. There's belonging and love. No wants. No needs. We weren't meant for
-    that. None of us. Man stagnates if he has no ambition, no desire to be more than
-    he is. We have what we need.[SEP]Except a challenge.
+  - There is one possibility. The automatic helm navigation circuit relays might be
+    disrupted from engineering level three.
+  - Nothing there.
+  - ' Wow, you remember where our first date was? I didn''t think you were paying
+    attention.'
+- source_sentence: I want facts, not poetry. I have given you the facts, Captain.
+    The entire magnetic field in this solar system simply blinked. The planet below,
+    the mass of which we're measuring, attained zero gravity. That's impossible. What
+    you're describing Is non-existence. Standard General Alert signal from Starfleet
+    Command, Captain.[SEP]All stations to immediate alert status. Stand by.
   sentences:
-  - Sir?
-  - ' Happy Valentine''s Day.'
-  - You don't understand, Jim, but you'll come around sooner or later. Join us. Please.
+  - As you may recall from your histories, this conflict was fought,
+  - ' Mm hmm. [Quick wink to the parents.] Okay, lean forwards. Now hold very still,
+    okay? [He picks at Clancy''s neck with some tweezers.] Got it!'
+  - Captain, scanners now report a life object on the planet surface below.
 pipeline_tag: sentence-similarity
 library_name: sentence-transformers
 metrics:
 - cosine_accuracy
 model-index:
-- name: SentenceTransformer based on microsoft/deberta-base
+- name: SentenceTransformer based on distilbert/distilroberta-base
   results:
   - task:
       type: triplet
@@ -74,7 +76,7 @@ model-index:
       type: evaluator_enc
     metrics:
     - type: cosine_accuracy
-      value: 0.9991825222969055
+      value: 0.9995912313461304
       name: Cosine Accuracy
   - task:
       type: triplet
@@ -84,19 +86,19 @@ model-index:
       type: evaluator_val
     metrics:
     - type: cosine_accuracy
-      value: 0.9814814925193787
+      value: 0.9861111044883728
       name: Cosine Accuracy
 ---
 
-# SentenceTransformer based on microsoft/deberta-base
+# SentenceTransformer based on distilbert/distilroberta-base
 
-This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [microsoft/deberta-base](https://huggingface.co/microsoft/deberta-base). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [distilbert/distilroberta-base](https://huggingface.co/distilbert/distilroberta-base). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
 
 ## Model Details
 
 ### Model Description
 - **Model Type:** Sentence Transformer
-- **Base model:** [microsoft/deberta-base](https://huggingface.co/microsoft/deberta-base) <!-- at revision 0d1b43ccf21b5acd9f4e5f7b077fa698f05cf195 -->
+- **Base model:** [distilbert/distilroberta-base](https://huggingface.co/distilbert/distilroberta-base) <!-- at revision fb53ab8802853c8e4fbdbcd0529f21fc6f459b2b -->
 - **Maximum Sequence Length:** 128 tokens
 - **Output Dimensionality:** 768 dimensions
 - **Similarity Function:** Cosine Similarity
@@ -114,7 +116,7 @@ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [m
 
 ```
 SentenceTransformer(
-  (0): Transformer({'max_seq_length': 128, 'do_lower_case': False}) with Transformer model: DebertaModel 
+  (0): Transformer({'max_seq_length': 128, 'do_lower_case': False}) with Transformer model: RobertaModel 
   (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
 )
 ```
@@ -137,9 +139,9 @@ from sentence_transformers import SentenceTransformer
 model = SentenceTransformer("greatakela/gnlp_hw1_encoder")
 # Run inference
 sentences = [
-    "That's paradise? We have no need or want, Captain. It's a true Eden, Jim. There's belonging and love. No wants. No needs. We weren't meant for that. None of us. Man stagnates if he has no ambition, no desire to be more than he is. We have what we need.[SEP]Except a challenge.",
-    "You don't understand, Jim, but you'll come around sooner or later. Join us. Please.",
-    " Happy Valentine's Day.",
+    "I want facts, not poetry. I have given you the facts, Captain. The entire magnetic field in this solar system simply blinked. The planet below, the mass of which we're measuring, attained zero gravity. That's impossible. What you're describing Is non-existence. Standard General Alert signal from Starfleet Command, Captain.[SEP]All stations to immediate alert status. Stand by.",
+    'Captain, scanners now report a life object on the planet surface below.',
+    " Mm hmm. [Quick wink to the parents.] Okay, lean forwards. Now hold very still, okay? [He picks at Clancy's neck with some tweezers.] Got it!",
 ]
 embeddings = model.encode(sentences)
 print(embeddings.shape)
@@ -186,7 +188,7 @@ You can finetune this model on your own dataset.
 
 | Metric              | evaluator_enc | evaluator_val |
 |:--------------------|:--------------|:--------------|
-| **cosine_accuracy** | **0.9992**    | **0.9815**    |
+| **cosine_accuracy** | **0.9996**    | **0.9861**    |
 
 <!--
 ## Bias, Risks and Limitations
@@ -212,13 +214,13 @@ You can finetune this model on your own dataset.
   |         | sentence_0                                                                         | sentence_1                                                                         | sentence_2                                                                         |
   |:--------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|
   | type    | string                                                                             | string                                                                             | string                                                                             |
-  | details | <ul><li>min: 2 tokens</li><li>mean: 83.32 tokens</li><li>max: 128 tokens</li></ul> | <ul><li>min: 4 tokens</li><li>mean: 18.63 tokens</li><li>max: 128 tokens</li></ul> | <ul><li>min: 4 tokens</li><li>mean: 18.98 tokens</li><li>max: 128 tokens</li></ul> |
+  | details | <ul><li>min: 2 tokens</li><li>mean: 83.72 tokens</li><li>max: 128 tokens</li></ul> | <ul><li>min: 4 tokens</li><li>mean: 19.05 tokens</li><li>max: 128 tokens</li></ul> | <ul><li>min: 4 tokens</li><li>mean: 19.47 tokens</li><li>max: 128 tokens</li></ul> |
 * Samples:
-  | sentence_0                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          | sentence_1                                                                                                               | sentence_2                                                                                                                                                                                                                                                                          |
-  |:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
-  | <code>Don't know yet. Engineering. No casualties, Captain, but trouble aplenty with the engines. Every dilithium crystal connection's smashed in the warp engine circuitry. We're trying to bypass them now. What about main circuits? Well, you have to see it to believe it, sir. Those big crystals in there have come apart. Each of them unpeeling like the rind of an orange. Analysis, Spock.[SEP]Our only hope now is rewiring impulse. But there are a thousand broken connections.</code> | <code>Captain, this is quite unprecedented. Notice the fracturing is spiro-form, similar to long chain molecules.</code> | <code> No signs of drug use or acetaminophen poisoning in his tox screen. Maybe the water was contaminated.</code>                                                                                                                                                                  |
-  | <code>Behold. That is most significant. An instinct new to the essence of her being is generating. Compassion for another is becoming part of her functioning life system. She is afraid. She's saving herself. She does not yet have the instinct to save her people. We have failed?[SEP]No. No, not yet.</code>                                                                                                                                                                                  | <code>Captain, Dr. McCoy's life is not solely dependent on Gem. The Vians too must be capable of saving his life.</code> | <code> Not right now. She's already on a respirator. The maParkne is breathing for her. I can do whatEver I want to her lungs. If you're playing catch in the living room and you break your mother's vase you might as well keep playing catch. The vase is already broken.</code> |
-  | <code>He was aware of what might happen when he went. I should never have let him go. You had no choice, Captain. You could not have stopped him. How can you ignore that? A Vulcan would not cry out so.[SEP]Whether he's a Vulcan or not, he's in agony.</code>                                                                                                                                                                                                                                   | <code>I am not insensitive to it, Captain.</code>                                                                        | <code> What about something vascular, polyarteritis nodosa.</code>                                                                                                                                                                                                                  |
+  | sentence_0                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | sentence_1                                                                                                  | sentence_2                                                                                                                        |
+  |:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------|
+  | <code>I'm not a plebe. This is today, fifteen years later. What are you doing here? I'm being exactly what you expect me to be, Jimmy boy. Did you enjoy it, Captain? Yes, I enjoyed it. After all these years.  I did enjoy it. The one thing I wanted to do after all these years was to beat the tar out of Finnegan. Which supports a theory I've been formulating.[SEP]That we're all meeting people and things that we happen to be thinking about at the moment.</code> | <code>Yes. Somehow our thoughts are read, these things are quickly manufactured and provided for us.</code> | <code> You did not suddenly fall in love with me. You were looking for something, and I happened to be st "�</code>               |
+  | <code>McCoy here. Received and understood. But we still have some doubts up here, Captain. Can you tell us any more? Not really. When do you plan to beam back up, Captain? I think we'll spend the night here, Mister Spock.[SEP]No! No, no, no.</code>                                                                                                                                                                                                                       | <code>And you will continue to check in every four hours?</code>                                            | <code> Is Everything ok?</code>                                                                                                   |
+  | <code>Do you think it would cause a complete breakdown of discipline if a lowly lieutenant kissed a Starship Captain on the bridge of his ship? Let's try.  See? No change. Discipline goes on. And so must the Enterprise. Goodbye, Jim. Goodbye, Areel. Better luck next time. I had pretty good luck this time. I lost, didn't l?[SEP]She's a very good lawyer.</code>                                                                                                      | <code>Obviously.</code>                                                                                     | <code> [over PA system, somberly] Ladies and gentlemen, we have a passenger with a confirmed case of bacterial meningitis.</code> |
 * Loss: [<code>TripletLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#tripletloss) with these parameters:
   ```json
   {
@@ -357,25 +359,25 @@ You can finetune this model on your own dataset.
 ### Training Logs
 | Epoch  | Step | Training Loss | evaluator_enc_cosine_accuracy | evaluator_val_cosine_accuracy |
 |:------:|:----:|:-------------:|:-----------------------------:|:-----------------------------:|
-| -1     | -1   | -             | 0.6203                        | -                             |
-| 0.4902 | 300  | -             | 0.9789                        | -                             |
-| 0.8170 | 500  | 0.8516        | -                             | -                             |
-| 0.9804 | 600  | -             | 0.9931                        | -                             |
-| 1.0    | 612  | -             | 0.9937                        | -                             |
-| 1.4706 | 900  | -             | 0.9955                        | -                             |
-| 1.6340 | 1000 | 0.1586        | -                             | -                             |
-| 1.9608 | 1200 | -             | 0.9982                        | -                             |
-| 2.0    | 1224 | -             | 0.9992                        | -                             |
-| 2.4510 | 1500 | 0.0644        | 0.9992                        | -                             |
-| 2.9412 | 1800 | -             | 0.9992                        | -                             |
-| 3.0    | 1836 | -             | 0.9992                        | -                             |
-| -1     | -1   | -             | -                             | 0.9815                        |
+| -1     | -1   | -             | 0.5931                        | -                             |
+| 0.4902 | 300  | -             | 0.9832                        | -                             |
+| 0.8170 | 500  | 1.0694        | -                             | -                             |
+| 0.9804 | 600  | -             | 0.9926                        | -                             |
+| 1.0    | 612  | -             | 0.9939                        | -                             |
+| 1.4706 | 900  | -             | 0.9965                        | -                             |
+| 1.6340 | 1000 | 0.1834        | -                             | -                             |
+| 1.9608 | 1200 | -             | 0.9988                        | -                             |
+| 2.0    | 1224 | -             | 0.9988                        | -                             |
+| 2.4510 | 1500 | 0.0539        | 0.9992                        | -                             |
+| 2.9412 | 1800 | -             | 0.9996                        | -                             |
+| 3.0    | 1836 | -             | 0.9996                        | -                             |
+| -1     | -1   | -             | -                             | 0.9861                        |
 
 
 ### Framework Versions
 - Python: 3.11.11
 - Sentence Transformers: 3.4.1
-- Transformers: 4.48.3
+- Transformers: 4.49.0
 - PyTorch: 2.5.1+cu124
 - Accelerate: 1.3.0
 - Datasets: 3.3.2

config.json

@@ -1,33 +1,27 @@
 {
-  "_name_or_path": "microsoft/deberta-base",
+  "_name_or_path": "distilroberta-base",
   "architectures": [
-    "DebertaModel"
+    "RobertaModel"
   ],
   "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": 0,
+  "classifier_dropout": null,
+  "eos_token_id": 2,
   "hidden_act": "gelu",
   "hidden_dropout_prob": 0.1,
   "hidden_size": 768,
   "initializer_range": 0.02,
   "intermediate_size": 3072,
-  "layer_norm_eps": 1e-07,
-  "legacy": true,
-  "max_position_embeddings": 512,
-  "max_relative_positions": -1,
-  "model_type": "deberta",
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 514,
+  "model_type": "roberta",
   "num_attention_heads": 12,
-  "num_hidden_layers": 12,
-  "pad_token_id": 0,
-  "pooler_dropout": 0,
-  "pooler_hidden_act": "gelu",
-  "pooler_hidden_size": 768,
-  "pos_att_type": [
-    "c2p",
-    "p2c"
-  ],
-  "position_biased_input": false,
-  "relative_attention": true,
+  "num_hidden_layers": 6,
+  "pad_token_id": 1,
+  "position_embedding_type": "absolute",
   "torch_dtype": "float32",
-  "transformers_version": "4.48.3",
-  "type_vocab_size": 0,
+  "transformers_version": "4.49.0",
+  "type_vocab_size": 1,
+  "use_cache": true,
   "vocab_size": 50265
 }

config_sentence_transformers.json

@@ -1,7 +1,7 @@
 {
   "__version__": {
     "sentence_transformers": "3.4.1",
-    "transformers": "4.48.3",
+    "transformers": "4.49.0",
     "pytorch": "2.5.1+cu124"
   },
   "prompts": {},

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8183b3fd54c073e9a380efb364c4500297686d41cb95e8c2146e9caabd2f3385
-size 554429144
+oid sha256:f0502135f9f964ae538e564593524e73ba2fbe10f4e311f1ba3be445c87d2844
+size 328485128

special_tokens_map.json

@@ -1,51 +1,15 @@
 {
-  "bos_token": {
-    "content": "[CLS]",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "cls_token": {
-    "content": "[CLS]",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "eos_token": {
-    "content": "[SEP]",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
+  "bos_token": "<s>",
+  "cls_token": "<s>",
+  "eos_token": "</s>",
   "mask_token": {
-    "content": "[MASK]",
+    "content": "<mask>",
     "lstrip": true,
-    "normalized": true,
-    "rstrip": false,
-    "single_word": false
-  },
-  "pad_token": {
-    "content": "[PAD]",
-    "lstrip": false,
     "normalized": false,
     "rstrip": false,
     "single_word": false
   },
-  "sep_token": {
-    "content": "[SEP]",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "unk_token": {
-    "content": "[UNK]",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  }
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "unk_token": "<unk>"
 }

tokenizer.json

@@ -10,54 +10,54 @@
     "strategy": "BatchLongest",
     "direction": "Right",
     "pad_to_multiple_of": null,
-    "pad_id": 0,
+    "pad_id": 1,
     "pad_type_id": 0,
-    "pad_token": "[PAD]"
+    "pad_token": "<pad>"
   },
   "added_tokens": [
     {
       "id": 0,
-      "content": "[PAD]",
+      "content": "<s>",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
-      "normalized": false,
+      "normalized": true,
       "special": true
     },
     {
       "id": 1,
-      "content": "[CLS]",
+      "content": "<pad>",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
-      "normalized": false,
+      "normalized": true,
       "special": true
     },
     {
       "id": 2,
-      "content": "[SEP]",
+      "content": "</s>",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
-      "normalized": false,
+      "normalized": true,
       "special": true
     },
     {
       "id": 3,
-      "content": "[UNK]",
+      "content": "<unk>",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
-      "normalized": false,
+      "normalized": true,
       "special": true
     },
     {
       "id": 50264,
-      "content": "[MASK]",
+      "content": "<mask>",
       "single_word": false,
       "lstrip": true,
       "rstrip": false,
-      "normalized": true,
+      "normalized": false,
       "special": true
     }
   ],
@@ -69,79 +69,17 @@
     "use_regex": true
   },
   "post_processor": {
-    "type": "TemplateProcessing",
-    "single": [
-      {
-        "SpecialToken": {
-          "id": "[CLS]",
-          "type_id": 0
-        }
-      },
-      {
-        "Sequence": {
-          "id": "A",
-          "type_id": 0
-        }
-      },
-      {
-        "SpecialToken": {
-          "id": "[SEP]",
-          "type_id": 0
-        }
-      }
+    "type": "RobertaProcessing",
+    "sep": [
+      "</s>",
+      2
     ],
-    "pair": [
-      {
-        "SpecialToken": {
-          "id": "[CLS]",
-          "type_id": 0
-        }
-      },
-      {
-        "Sequence": {
-          "id": "A",
-          "type_id": 0
-        }
-      },
-      {
-        "SpecialToken": {
-          "id": "[SEP]",
-          "type_id": 0
-        }
-      },
-      {
-        "Sequence": {
-          "id": "B",
-          "type_id": 1
-        }
-      },
-      {
-        "SpecialToken": {
-          "id": "[SEP]",
-          "type_id": 1
-        }
-      }
+    "cls": [
+      "<s>",
+      0
     ],
-    "special_tokens": {
-      "[CLS]": {
-        "id": "[CLS]",
-        "ids": [
-          1
-        ],
-        "tokens": [
-          "[CLS]"
-        ]
-      },
-      "[SEP]": {
-        "id": "[SEP]",
-        "ids": [
-          2
-        ],
-        "tokens": [
-          "[SEP]"
-        ]
-      }
-    }
+    "trim_offsets": true,
+    "add_prefix_space": false
   },
   "decoder": {
     "type": "ByteLevel",
@@ -159,10 +97,10 @@
     "byte_fallback": false,
     "ignore_merges": false,
     "vocab": {
-      "[PAD]": 0,
-      "[CLS]": 1,
-      "[SEP]": 2,
-      "[UNK]": 3,
+      "<s>": 0,
+      "<pad>": 1,
+      "</s>": 2,
+      "<unk>": 3,
       ".": 4,
       "Ġthe": 5,
       ",": 6,
@@ -50423,7 +50361,7 @@
       "madeupword0000": 50261,
       "madeupword0001": 50262,
       "madeupword0002": 50263,
-      "[MASK]": 50264
+      "<mask>": 50264
     },
     "merges": [
       [

tokenizer_config.json

@@ -1,60 +1,58 @@
 {
-  "add_bos_token": false,
   "add_prefix_space": false,
   "added_tokens_decoder": {
     "0": {
-      "content": "[PAD]",
+      "content": "<s>",
       "lstrip": false,
-      "normalized": false,
+      "normalized": true,
       "rstrip": false,
       "single_word": false,
       "special": true
     },
     "1": {
-      "content": "[CLS]",
+      "content": "<pad>",
       "lstrip": false,
-      "normalized": false,
+      "normalized": true,
       "rstrip": false,
       "single_word": false,
       "special": true
     },
     "2": {
-      "content": "[SEP]",
+      "content": "</s>",
       "lstrip": false,
-      "normalized": false,
+      "normalized": true,
       "rstrip": false,
       "single_word": false,
       "special": true
     },
     "3": {
-      "content": "[UNK]",
+      "content": "<unk>",
       "lstrip": false,
-      "normalized": false,
+      "normalized": true,
       "rstrip": false,
       "single_word": false,
       "special": true
     },
     "50264": {
-      "content": "[MASK]",
+      "content": "<mask>",
       "lstrip": true,
-      "normalized": true,
+      "normalized": false,
       "rstrip": false,
       "single_word": false,
       "special": true
     }
   },
-  "bos_token": "[CLS]",
+  "bos_token": "<s>",
   "clean_up_tokenization_spaces": false,
-  "cls_token": "[CLS]",
-  "do_lower_case": false,
-  "eos_token": "[SEP]",
+  "cls_token": "<s>",
+  "eos_token": "</s>",
   "errors": "replace",
   "extra_special_tokens": {},
-  "mask_token": "[MASK]",
+  "mask_token": "<mask>",
   "model_max_length": 128,
-  "pad_token": "[PAD]",
-  "sep_token": "[SEP]",
-  "tokenizer_class": "DebertaTokenizer",
-  "unk_token": "[UNK]",
-  "vocab_type": "gpt2"
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "tokenizer_class": "RobertaTokenizer",
+  "trim_offsets": true,
+  "unk_token": "<unk>"
 }