Updated `hidden_act` to `silu` (#4)

- Updated `hidden_act` to `silu` (a62d2df6198a112d3d344e19d1434fe8ee74c400)


Co-authored-by: Sergio Paniego <sergiopaniego@users.noreply.huggingface.co>

config.json

@@ -30,7 +30,7 @@
   "vision_config": {
     "attention_dropout": 0.0,
     "head_dim": 64,
-    "hidden_act": "gelu",
+    "hidden_act": "silu",
     "hidden_size": 1024,
     "image_size": 1540,
     "initializer_range": 0.02,