Update README.md
Browse files
README.md
CHANGED
@@ -93,10 +93,6 @@ More information needed
|
|
93 |
# Model Examination
|
94 |
|
95 |
The model craters note in the [associated paper](https://arxiv.org/pdf/2104.08821.pdf):
|
96 |
-
|
97 |
-
> **Uniformity and alignment.**
|
98 |
-
We also observe that (1) though pre-trained embeddings have good alignment, their uniformity is poor (i.e., the embeddings are highly anisotropic); (2) post-processing methods like BERT-flow and BERT-whitening greatly improve uniformity but also suffer a degeneration in alignment; (3) unsupervised SimCSE effectively improves uniformity of pre-trained embeddings whereas keeping a good alignment;(4) incorporating supervised data in SimCSE further amends alignment.
|
99 |
-
|
100 |
|
101 |
|
102 |
# Technical Specifications [optional]
|
|
|
93 |
# Model Examination
|
94 |
|
95 |
The model craters note in the [associated paper](https://arxiv.org/pdf/2104.08821.pdf):
|
|
|
|
|
|
|
|
|
96 |
|
97 |
|
98 |
# Technical Specifications [optional]
|