Add SetFit model

README.md

@@ -15,37 +15,35 @@ metrics:
 - F1-Score
 - accuracy
 widget:
-- text: Violence from intimate partners and male family members can escalate during
-    emergencies. This tends to increase as the crisis worsens, and men have lost their
-    jobs and status – particularly in communities with traditional gender roles, and
-    where family violence is normalised
-- text: Expand livelihood protection policies that assist vulnerable, low-income individuals
-    to recover from damages associated with extreme weather events; provide support
-    and protection for internally displaced persons, persons displaced across borders
-    and host communities;. By 2026, draw up disaster recovery plans for all 22 municipalities
-    with resource inventories, first response measures and actions (including on logistics)
-    concerning humanitarian post-disaster needs.
-- text: recurrent droughts, (decrease in amount of rainfall from 550 to 400mm in the
-    highlands), changes in seasonality that had resulted frequent crop failure, massive
-    death of livestock, genetic erosion, extinction of endemic species, degradation
-    of habitats and disequilibria in the ecosystem structure and function. The impact
-    of climate change is manifested in recurrent droughts, desertification, sea level
-    rise and increase in sea water temperature, depletion of ground water, widespread
-    land degradation, and emergence of climate sensitive diseases.
-- text: They live in geographical regions and ecosystems that are the most vulnerable
-    to climate change. These include polar regions, humid tropical forests, high mountains,
-    small islands, coastal regions, and arid and semi-arid lands, among others. The
-    impacts of climate change in such regions have strong implications for the ecosystem-based
-    livelihoods on which many indigenous peoples depend. Moreover, in some regions
-    such as the Pacific, the very existence of many indigenous territories is under
-    threat from rising sea levels that not only pose a grave threat to indigenous
-    peoples’ livelihoods but also to their cultures and ways of life.
-- text: Overcoming Poverty. Colombia, as a developing country, faces major socioeconomic
-    challenges. According to the official figures of DANE, by 2014, the percentage
-    of people in multidimensional poverty situation was 21.9% (this figure rises to
-    44.1% if we take into account only the rural population). For the same year, 28.5%
-    of the population was found in a situation of monetary poverty (41.4% of the population
-    in the case of the villages and rural centers scattered).
+- text: Amended proposal for a Regulation of the European Parliament and of the Council
+    on establishing the framework for achieving climate neutrality and amending Regulation
+    (EU) 2018/1999 (European Climate Law). COM(2020) 563 (currently undergoing the
+    EU internal legislative process)↩︎. Council conclusions of 7 March 2011 on European
+    Pact for Gender Equality (2011-2020)↩︎. Council conclusions of 9 April 2019, Towards
+    an ever more sustainable Union by 2030↩︎. Council conclusions of 15 May 2017 on
+    Indigenous Peoples↩︎. Regulation (EU) 2018/1999↩︎.
+- text: 'Development of 15,000 ha of shallows and irrigated areas and their exploitation
+    for the intensive rice cultivation system. Agriculture, water. 705. 28. Development
+    of research on health and climate change: total of three activities. Health. 690.
+    29. Audit of plans to develop all classified or protected forests for updating
+    purposes. Forests-land use. 685. 30. Strengthening of capabilities to forecast
+    and respond to phenomena associated with climate change: creation of an MT health
+    care monitoring centre. Health. 680. 31. Participative development of sustainable
+    land.'
+- text: The Ministry of Health notes that any adaptation work should prioritise vulnerable
+    populations. It also considers that more work is needed in health system planning,
+    to accommodate a potential increase in migrants and refugees
+- text: 'The overall outcome is to ensure that projects and programmes are gender
+    responsive: meaning that it aims to go beyond gender sensitivity to actively promote
+    gender equality and women’s empowerment. The country is committed to achieving
+    SDG 5: Gender equality by promoting low carbon development where men and women
+    contributions to climate change mitigation and adaptation are recognized and valued,
+    existing gender inequalities are reduced and opportunities for effective empowerment
+    for women are promoted.'
+- text: Cities depend heavily on other cities and regions to provide them with indispensable
+    services such as food, water and energy and the infrastructure to deliver them.
+    Ecosystem services from surrounding regions provide fresh air, store or drain
+    flood water as well as drinking water
 pipeline_tag: text-classification
 inference: false
 base_model: sentence-transformers/all-mpnet-base-v2
@@ -61,28 +59,28 @@ model-index:
       split: test
     metrics:
     - type: Precision_micro
-      value: 0.7972027972027972
+      value: 0.7692307692307693
       name: Precision_Micro
     - type: Precision_weighted
-      value: 0.8053038510784989
+      value: 0.7748199704721445
       name: Precision_Weighted
     - type: Precision_samples
-      value: 0.7972027972027972
+      value: 0.7692307692307693
       name: Precision_Samples
     - type: Recall_micro
-      value: 0.7972027972027972
+      value: 0.7692307692307693
       name: Recall_Micro
     - type: Recall_weighted
-      value: 0.7972027972027972
+      value: 0.7692307692307693
       name: Recall_Weighted
     - type: Recall_samples
-      value: 0.7972027972027972
+      value: 0.7692307692307693
       name: Recall_Samples
     - type: F1-Score
-      value: 0.7972027972027972
+      value: 0.7692307692307693
       name: F1-Score
     - type: accuracy
-      value: 0.7972027972027972
+      value: 0.7692307692307693
       name: Accuracy
 ---
 
@@ -118,7 +116,7 @@ The model has been trained using an efficient few-shot learning technique that i
 ### Metrics
 | Label   | Precision_Micro | Precision_Weighted | Precision_Samples | Recall_Micro | Recall_Weighted | Recall_Samples | F1-Score | Accuracy |
 |:--------|:----------------|:-------------------|:------------------|:-------------|:----------------|:---------------|:---------|:---------|
-| **all** | 0.7972          | 0.8053             | 0.7972            | 0.7972       | 0.7972          | 0.7972         | 0.7972   | 0.7972   |
+| **all** | 0.7692          | 0.7748             | 0.7692            | 0.7692       | 0.7692          | 0.7692         | 0.7692   | 0.7692   |
 
 ## Uses
 
@@ -138,7 +136,7 @@ from setfit import SetFitModel
 # Download from the 🤗 Hub
 model = SetFitModel.from_pretrained("leavoigt/vulnerability_target")
 # Run inference
-preds = model("Violence from intimate partners and male family members can escalate during emergencies. This tends to increase as the crisis worsens, and men have lost their jobs and status – particularly in communities with traditional gender roles, and where family violence is normalised")
+preds = model("The Ministry of Health notes that any adaptation work should prioritise vulnerable populations. It also considers that more work is needed in health system planning, to accommodate a potential increase in migrants and refugees")
 ```
 
 <!--
@@ -170,7 +168,7 @@ preds = model("Violence from intimate partners and male family members can escal
 ### Training Set Metrics
 | Training set | Min | Median  | Max |
 |:-------------|:----|:--------|:----|
-| Word count   | 15  | 71.9518 | 238 |
+| Word count   | 15  | 72.4819 | 238 |
 
 ### Training Hyperparameters
 - batch_size: (16, 16)
@@ -193,23 +191,23 @@ preds = model("Violence from intimate partners and male family members can escal
 ### Training Results
 | Epoch  | Step | Training Loss | Validation Loss |
 |:------:|:----:|:-------------:|:---------------:|
-| 0.0012 | 1    | 0.2559        | -               |
-| 0.0602 | 50   | 0.2509        | -               |
-| 0.1205 | 100  | 0.2595        | -               |
-| 0.1807 | 150  | 0.0868        | -               |
-| 0.2410 | 200  | 0.0302        | -               |
-| 0.3012 | 250  | 0.0024        | -               |
-| 0.3614 | 300  | 0.0225        | -               |
-| 0.4217 | 350  | 0.0007        | -               |
-| 0.4819 | 400  | 0.0004        | -               |
-| 0.5422 | 450  | 0.0003        | -               |
+| 0.0012 | 1    | 0.2938        | -               |
+| 0.0602 | 50   | 0.2188        | -               |
+| 0.1205 | 100  | 0.1733        | -               |
+| 0.1807 | 150  | 0.1578        | -               |
+| 0.2410 | 200  | 0.02          | -               |
+| 0.3012 | 250  | 0.0028        | -               |
+| 0.3614 | 300  | 0.0004        | -               |
+| 0.4217 | 350  | 0.0011        | -               |
+| 0.4819 | 400  | 0.0008        | -               |
+| 0.5422 | 450  | 0.0005        | -               |
 | 0.6024 | 500  | 0.0002        | -               |
-| 0.6627 | 550  | 0.0005        | -               |
-| 0.7229 | 600  | 0.0319        | -               |
-| 0.7831 | 650  | 0.0001        | -               |
-| 0.8434 | 700  | 0.0104        | -               |
+| 0.6627 | 550  | 0.0002        | -               |
+| 0.7229 | 600  | 0.0004        | -               |
+| 0.7831 | 650  | 0.0332        | -               |
+| 0.8434 | 700  | 0.0003        | -               |
 | 0.9036 | 750  | 0.0003        | -               |
-| 0.9639 | 800  | 0.0009        | -               |
+| 0.9639 | 800  | 0.0004        | -               |
 
 ### Framework Versions
 - Python: 3.10.12

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:21a68d4e0e07be270d3269ec0649d0450f5c2f5aacb912bb4381821794f08f6c
+oid sha256:f50c1c8ee41837d2379a3431c1409a50a06470ea8c55aaefdf0b1eaa898a57cb
 size 13956

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c76b3427c76aa76bb48187a1b4a7f125229943b9887e4c2bae30dbed7753011e
+oid sha256:dc684736afdcca8e895c8635f3fe38976632dbfbe0f4ac1768927805f93f234c
 size 438016938