model update

README.md

@@ -0,0 +1,146 @@
+
+---
+license: cc-by-4.0
+metrics:
+- bleu4
+- meteor
+- rouge-l
+- bertscore
+- moverscore
+language: en
+datasets:
+- lmqg/qg_tweetqa
+pipeline_tag: text2text-generation
+tags:
+- question answering
+widget:
+- text: "question: What is a person called is practicing heresy?, context: Heresy is any provocative belief or theory that is strongly at variance with established beliefs or customs. A heretic is a proponent of such claims or beliefs. Heresy is distinct from both apostasy, which is the explicit renunciation of one's religion, principles or cause, and blasphemy, which is an impious utterance or action concerning God or sacred things."
+  example_title: "Question Answering Example 1" 
+- text: "question: who created the post as we know it today?, context: 'So much of The Post is Ben,' Mrs. Graham said in 1994, three years after Bradlee retired as editor. 'He created it as we know it today.'— Ed O'Keefe (@edatpost) October 21, 2014"
+  example_title: "Question Answering Example 2" 
+model-index:
+- name: lmqg/t5-base-tweetqa-question-answering
+  results:
+  - task:
+      name: Text2text Generation
+      type: text2text-generation
+    dataset:
+      name: lmqg/qg_tweetqa
+      type: default
+      args: default
+    metrics:
+    - name: BLEU4
+      type: bleu4
+      value: 0.33315782056958804
+    - name: ROUGE-L
+      type: rouge-l
+      value: 0.6223954899626488
+    - name: METEOR
+      type: meteor
+      value: 0.35426819977024687
+    - name: BERTScore
+      type: bertscore
+      value: 0.9458259980280204
+    - name: MoverScore
+      type: moverscore
+      value: 0.8006984647429997
+    - name: AnswerF1Score (Question Answering)
+      type: answer_f1_score_question_answering
+      value: 69.3966081647612
+    - name: AnswerExactMatch (Question Answering)
+      type: answer_exact_match_question_answering
+      value: 52.28595178719867
+---
+
+# Model Card of `lmqg/t5-base-tweetqa-question-answering`
+This model is fine-tuned version of [t5-base](https://huggingface.co/t5-base) for question answering task on the [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) (dataset_name: default) via [`lmqg`](https://github.com/asahi417/lm-question-generation).
+
+
+### Overview
+- **Language model:** [t5-base](https://huggingface.co/t5-base)   
+- **Language:** en  
+- **Training data:** [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) (default)
+- **Online Demo:** [https://autoqg.net/](https://autoqg.net/)
+- **Repository:** [https://github.com/asahi417/lm-question-generation](https://github.com/asahi417/lm-question-generation)
+- **Paper:** [https://arxiv.org/abs/2210.03992](https://arxiv.org/abs/2210.03992)
+
+### Usage
+- With [`lmqg`](https://github.com/asahi417/lm-question-generation#lmqg-language-model-for-question-generation-)
+```python
+
+from lmqg import TransformersQG
+
+# initialize model
+model = TransformersQG(language='en', model='lmqg/t5-base-tweetqa-question-answering')
+
+# model prediction
+answers = model.answer_q(list_question="What is a person called is practicing heresy?", list_context=" Heresy is any provocative belief or theory that is strongly at variance with established beliefs or customs. A heretic is a proponent of such claims or beliefs. Heresy is distinct from both apostasy, which is the explicit renunciation of one's religion, principles or cause, and blasphemy, which is an impious utterance or action concerning God or sacred things.")
+
+```
+
+- With `transformers`
+```python
+
+from transformers import pipeline
+
+pipe = pipeline("text2text-generation", 'lmqg/t5-base-tweetqa-question-answering')
+output = pipe('question: What is a person called is practicing heresy?, context: Heresy is any provocative belief or theory that is strongly at variance with established beliefs or customs. A heretic is a proponent of such claims or beliefs. Heresy is distinct from both apostasy, which is the explicit renunciation of one's religion, principles or cause, and blasphemy, which is an impious utterance or action concerning God or sacred things.')
+
+```
+
+## Evaluation Metrics
+
+
+### Metric (Question Answering)
+
+|                  |     Score | Type    | Dataset                                                            | Link                                                                                                                                                    |
+|:-----------------|----------:|:--------|:-------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------|
+| AnswerExactMatch | 52.286    | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) | https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json |
+| AnswerF1Score    | 69.3966   | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) | https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json |
+| BERTScore        |  0.945826 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) | https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json |
+| Bleu_1           |  0.570705 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) | https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json |
+| Bleu_2           |  0.481677 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) | https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json |
+| Bleu_3           |  0.397816 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) | https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json |
+| Bleu_4           |  0.333158 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) | https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json |
+| METEOR           |  0.354268 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) | https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json |
+| MoverScore       |  0.800698 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) | https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json |
+| ROUGE_L          |  0.622395 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) | https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json |
+
+
+## Training hyperparameters
+
+The following hyperparameters were used during fine-tuning:
+ - dataset_path: lmqg/qg_tweetqa
+ - dataset_name: default
+ - input_types: ['paragraph_question']
+ - output_types: ['answer']
+ - prefix_types: None
+ - model: t5-base
+ - max_length: 512
+ - max_length_output: 32
+ - epoch: 10
+ - batch: 32
+ - lr: 0.0001
+ - fp16: False
+ - random_seed: 1
+ - gradient_accumulation_steps: 2
+ - label_smoothing: 0.15
+
+The full configuration can be found at [fine-tuning config file](https://huggingface.co/lmqg/t5-base-tweetqa-question-answering/raw/main/trainer_config.json).
+
+## Citation
+```
+
+@inproceedings{ushio-etal-2022-generative,
+    title = "{G}enerative {L}anguage {M}odels for {P}aragraph-{L}evel {Q}uestion {G}eneration",
+    author = "Ushio, Asahi  and
+        Alva-Manchego, Fernando  and
+        Camacho-Collados, Jose",
+    booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing",
+    month = dec,
+    year = "2022",
+    address = "Abu Dhabi, U.A.E.",
+    publisher = "Association for Computational Linguistics",
+}
+
+```

config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "lmqg_output/t5-base-tweetqa-question-answering/best_model",
+  "_name_or_path": "lmqg_output/t5-base-tweetqa-question-answering/model_eszyci/epoch_9",
   "add_prefix": false,
   "architectures": [
     "T5ForConditionalGeneration"

eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json

@@ -0,0 +1 @@
+{"validation": {"Bleu_1": 0.6006749156353204, "Bleu_2": 0.5067889780685119, "Bleu_3": 0.41355045314602085, "Bleu_4": 0.33109963248204377, "METEOR": 0.3663658174199703, "ROUGE_L": 0.6397146219955299, "BERTScore": 0.9446793037773715, "MoverScore": 0.805677897707128, "AnswerF1Score": 71.20458552088378, "AnswerExactMatch": 55.34069981583794}, "test": {"Bleu_1": 0.570705472951417, "Bleu_2": 0.4816773321774158, "Bleu_3": 0.3978157578330595, "Bleu_4": 0.33315782056958804, "METEOR": 0.35426819977024687, "ROUGE_L": 0.6223954899626488, "BERTScore": 0.9458259980280204, "MoverScore": 0.8006984647429997, "AnswerF1Score": 69.3966081647612, "AnswerExactMatch": 52.28595178719867}}

eval/samples.test.hyp.paragraph_question.answer.lmqg_qg_tweetqa.default.txt

@@ -0,0 +1,1203 @@
+http://www.amazon.com
+5
+5
+5 years in 5 seconds
+southwest airlines
+a select number of aircraft have been removed from service for maintenance checks
+crying
+real teARS
+blank space
+taylor
+tomorrow
+37500
+zach lowe
+a straight face
+ebola
+before and after the flight
+5%
+25%
+uccs
+ Portland
+the washington post
+poll numbers
+jeff gordon
+sideburns, a mullet & a taxi cab
+tweet is not visible
+tweet is not visible
+snl
+donald trump
+south carolina
+picking cotton
+china
+the winner's room
+the top of a staircase
+saunders
+ticket refunds
+Entertainment Weekly
+16
+an adult day care center
+the white house
+migrants and refugees
+serbia-croatia
+lauren hill
+st. louis county pd
+expression of regret
+not being able to do something
+the dumb media
+dumb
+consistency
+atletico
+durbanites
+immigrants
+scotland
+panmure golf club
+willow seeds
+snow
+west boca
+u.s. marshals
+going to the white house
+white house
+one year
+her girls
+chris rock
+the oscars
+burt Lauten
+steelers
+put her face on a shirt
+paul walker and mary j. blige
+he died
+talent
+it was a tragic one.
+he was a beautiful person.
+if they know people are praying every day
+that they make the right choices in their stressful jobs
+a sandwich
+a broomstick
+megyn kelly
+@italy2320
+robert rees
+actor, dear friend and colleague
+it will happen here
+the internet
+kkk jokes
+khloe kardashian
+kellyanne conway
+britney ever after
+stop
+@kanyewest
+donald trump
+russian
+pm
+the duke and duchess of cambridge
+it is disgusting
+ny times
+#askacop
+2 hands
+potus
+led and served our country
+she is trending
+eric the actor
+eric the actor
+the democrats
+that so many obama democrats voted for him
+years
+michigan, ohio, penn and a second term
+the daily show
+UEFA
+group b
+6:20 pm
+group b
+another Spider-Man movie reboot
+amber leeann secrest and josh peck
+josh peck got married
+philly
+1,000
+jacob lescenskii
+he is a fan of jacob lescenskii.
+beyonce
+beyonce's slurpee up
+0
+90 percent
+fighting in mosul
+kurdistan
+haradh hospital
+15
+every moment I exist is agony
+katy
+her son
+presents
+presents
+new owners and a new management team
+here
+caterham
+he is questioning himself about himself.
+john Heilemann
+yvette d. Clarke
+@repjohnlewis
+potus
+for statement on north korea nukes
+spend less time voting
+to spend less time voting
+they said what so many of us want to say
+the khan's
+presidential bling
+campus
+steve bannon
+in my drafts
+sacramento kings
+marcus Cousins
+iran
+the nuclear deal
+counts
+switzerland
+Honduras
+two
+two more
+wilmariel and jason
+orlando
+the family
+r.i.p.
+proper eyewear
+the solar eclipse
+make it rich again
+inauguration
+cleveland
+tara the hero cat and family
+BOGO offer
+lebron james
+colombia game
+2018
+democrats
+a muslim
+in mosques
+anyone
+this for perspective
+3 feet
+the fcc
+a loss
+senzo meyiwa
+jamesgunn
+guardians of the galaxy
+the city
+donald trump
+and then what?
+good
+iowa
+winter
+miss cleo
+my mom
+domino
+deadpool
+a toy story
+a toy story
+michelle obama
+to get a diplomatic resolution
+sanctions
+beyonce
+solar
+climate action
+COP22
+paris agreement and climate action
+iraqi command
+work to reclaim their territory from iSIL.
+kanye
+kanye and staff
+super bowl
+beyonce falls on beat
+basic human decency
+RATINGS
+basic human decency
+work harder
+four
+the red state gathering
+ben bradlee
+jennifer aniston
+justin theroux
+beyonce
+emmys
+nytimes critic
+shonda rhimes
+it's a tweet
+charlotte
+a flower
+because he really do feel that we are all one
+ijesse williams
+@jonathanbennett
+all of you
+tomorrow morning
+being honored in the kenny center
+the pioniers
+2015
+boston
+hillary clinton
+philly
+david burtka
+italy
+getting married
+italy
+reds to braves
+$14m
+arkansas
+august 4, 2014
+4
+the real camelot
+obama
+she's a fan of cmoore.
+youtube
+night
+crickets
+democrat congresswoman
+zachary hammond
+in the light
+having the opportunity to meet him
+gordie howe
+peas in guac
+the nyt
+her country
+bed
+this morning
+bexley rd
+uk
+mcdonald's uk
+uk
+7:21 pm
+the secret menu at mcdonald's
+the secret menu
+mcdonald's had a secret menu.
+the culture
+tucker carlson and steve hiltonx
+blue
+nicoles pag
+true blood
+museum modern art
+big bird and baby bear
+mayor mark
+her face
+gwen stefani
+lesean mccoy
+restaurant receipt
+fidel  Castro
+at 3 minutes to midnight
+executive director and publisher of the bulletin
+20 week abortion bans
+unpopular and unconstitutional
+kept it
+divine right to live
+justin kirkland
+dolores
+cheese dust
+michelle obama
+comparing and reminding are the same
+oranges
+pistons
+reggie jackson
+millions march
+union square
+be silenced
+to take nisa home to palembang
+home to palembang
+creeped out
+faceID
+atlanta
+errol cnn and google africa
+atlanta
+a stair master in hell
+hell
+a stair master
+backup qbs
+ap nfl patriots
+black protester
+4
+parents
+many years
+a significant milestone
+the bEAM program
+andre iguodala
+kurt helin
+facebook and twitter
+russell crowe
+prime minister nawaz sharif
+emotional things
+never showed up
+mariah carey
+brazil
+brazil
+the golf course
+Jimmy Fallon
+donald trump
+hillary clinton
+hillary clinton
+text dunham to 47246
+dem convention
+a farmer
+loading this beast
+emma watson
+marchers
+scared
+tweet does not exist
+tweet does not exist
+natural gas
+if we could see natural gas leaks
+an elephant
+me
+a nap
+a pillow and blanket
+julia louis-dreyfus
+julia louis-dreyfus
+he witnessed the most unimaginable event tonight.
+everyone
+bloody republican lefties
+on their money
+eng
+his organization
+league apology
+ballon d'or
+two
+syria
+syria
+rest in peace
+porto alegre
+they were in a full house.
+slanderous
+pOWs
+kobani
+beseiged fortress
+cops
+luck
+luck
+cops
+nazis
+swastika
+uninvited guests
+restaurants there to serve us
+dr pepper
+for u right now
+coke
+immigrants
+sitting with her family
+month year decade century
+ur show
+was too busy pulling out pages on evolution in my kids' biology textbooks
+autographed it
+his stick
+a young canucks fan
+so he could be in front of nato group
+montenegro pm
+vote for romney
+one
+romney
+romney
+romney
+romney
+something back
+luis Figo
+tony awards
+patti luPone
+mourning
+that we welcome the best and brightest in the world
+the president
+prince
+prince
+the patriots
+the nfl
+rachel nichols
+an apology
+wind gusts
+kenting
+israel
+ivanka trump and israel
+the wall
+continue working on outstanding issues
+thanksgiving
+a father
+two
+start his holiday
+a certain cat is out of a certain bag
+very happy
+andrew garfield
+Asian
+a warm wind
+42 degrees celsius
+yorktown
+hamilton
+daniel granger and josh mcroberts
+lebron james
+google glass is being retooled.
+it's a transparent glass.
+cesare prandelli
+american horror story
+kill me
+trying to kill him
+lfc
+saturday
+anfield
+lfc
+saturday
+shoreham
+shoreham
+liberty island
+civilians
+solange
+upload the audio
+fergie's
+milif money
+john glenn and annie
+john glenn
+ariannahuff
+because she is a dog
+there's been tremendous pressure within Durant's inner-circle
+make dramatic move, to ride endorsement wave of change
+it is being accused of deleting its own tweets promoting an ad.
+shameful
+tweets promoting an ad
+tHC
+2.71 inches
+almost 3 inches
+as soon as tuesday
+vegas
+2 hours
+Trafalgar Square bookstore
+mars
+a man with no legs
+legs
+pac
+she loves him
+he came out as gay.
+lukas Podolski
+mlb
+too soon
+the mlb
+he has a tattoo.
+the trailer
+a big screen
+$125
+their family's initials
+a veterinarian
+germany
+barf bag
+kim kardashian
+the og crew
+some
+in honor of leonard nimoy
+generations of scientists and engineers
+his first nhl contract
+the flapanthers
+one's heart
+mixed
+it's hot.
+snow
+evacuated passengers
+travelers beach hotel
+travelers beach hotel
+the evacuated passengers
+unpredictable
+being unpredictable
+anaconda
+choreo and vid of the year
+to express support
+they appreciate it
+jeb bush
+special interest money
+us embassy in france
+je suis charlie
+cpd
+970
+hillary clinton's gold and white logo
+april 12, 2015
+mtv
+2015
+mtv
+you never monkey with the truth
+ben bradlee
+the truth
+ben bradlee
+misunderstood
+a tweet
+74
+muhammad ali
+lesdoggg
+he died
+@sonypictures
+steve israel
+a new type enter a us fleet
+the 787
+bachelor finale
+bachelor finale
+amazon and icloud
+fans
+beyonce
+twins
+20
+the notorious b.i.g.
+always
+she's still gonna be pretty private
+democrats
+shutdown
+at a time we need it most
+day
+#homesweethome
+bullying
+laverne cox
+jeff flake
+stan freberg
+stan freberg
+269
+fc barcelona
+kris jenner
+kris jenner
+apple
+make the biggest, coolest, sexiest, funnest movie ever
+gwen stefani
+whoever did your face
+they lost contact of mh17.
+over ukraine airspace
+us presidents
+three
+go black and never go back
+dean
+posting extra hard on instagram
+posting extra hard on instagram
+shooting
+charlotte
+oprah
+cars
+they can't afford a day off
+their privilege
+barbie
+buy her daughter a barbie
+@katgraham and @dshippjr
+code
+STEM
+like a king
+justin bieber
+checked the forecast
+ky
+rakim kendrick
+all the people that have inspired him
+the buzzfeed team
+the buzzfeed team
+Buzzfeed
+an amazing November
+delusion
+ted cruz
+passive aggressiveness
+her daughter
+vegas
+dwyane wade
+VFWMane event
+vfmane event
+before
+#VFWManevent
+disappointed
+rickie fowler
+cannot conclude bc you saw a gun at residence
+she saw a gun at residence.
+the tony awards press room
+thanking people
+twice as good
+half as much
+with tears in her eyes
+george
+super bowl
+47
+acoustic
+lady gaga
+its core mission
+today
+sEC championship game
+jim mcelwain
+washington wizards
+the bulls
+bulls fans
+st louis blues camp
+a st. louis cup
+he passed away.
+jack gcassidy
+to win the arc
+yuichi fukunaga
+yuichi fukunaga
+kuzma
+vote their conscience
+your conscience
+amped up
+a pep talk from the hanson brothers
+the hanson brothers
+johnstown, pa
+tsarnaev
+rolling stone
+nepal
+reach out to those affected
+marcus morris
+aaron gordon
+kaley cuoco
+long ago
+president of ukraine noc
+scenes in kiev
+bringing a son into this world
+about bringing a son into this world
+pink
+hulk
+bill murray's victory
+x's victory
+x
+bill murray
+trump's jock
+mccain's or kasich's socks
+chiraq
+sexualizing and making a comedy out of chicago's gun violence
+leslie jones
+he needs to be arrested and prosecuted
+all of us
+a young man's death
+40 pounds
+207
+chris martin
+getting divorced
+insufferable similarities
+10 minutes
+the Bachelorette Finale
+tuesday
+midnight
+president
+russia
+russia
+#raiseyourpencilforfreedom
+andrew lesnie
+humor and love
+coaches in major college or pro sports
+geno auriemma
+dunkin donuts
+starbucks
+hassan rouhani
+second
+@evalongoria
+a cheese baby
+pregnancy
+ia
+a van
+the heat
+model
+california
+change
+it would benefit the wealthy over the middle-class
+hawaii
+the law will take effect in hawaii.
+by reporting them
+rape
+best designer
+best designer
+4-3-3
+4-3-3
+j klinsmann
+j klinsmann
+his district
+john lewis
+mike munchak
+5 hours
+copper breaks
+grasshoppers and beetles
+justin kirkland
+raven gates
+subway rides to bowling alley
+ebola patient's footseps
+ideologies of march
+in the upcoming weeks
+a sniper
+7k miles
+in homage
+super bowl
+william and harry
+his father
+the prince of wales
+william and harry
+police "don't ask if you're black or white. They just come to save you"
+they came to save you.
+himself and obama
+racial animus
+it was a squawk.
+ethiopian airlines flight 702
+a legend
+ron howard
+luis garcia abad
+lunch time
+the skin of the person who killed me
+under my fingernails
+crying
+tear gas and water canons
+nazem kadri
+cross-check
+hungarian
+tom and jerry
+charlottesville
+unite the country
+good sex
+she was sorry
+everything works out in the end
+pittsburg
+new york s Slough
+goalless
+fc bayern
+on the phone
+july
+not
+dACA
+wall
+hov has been pregnant with beyonce.
+sweetie
+movie going experience
+amc
+as much as poss.
+meaningful things
+emotional
+raising them
+hectoring and yelling
+syrian envoy to the unsc
+fallujah, iraq
+iraqi pmu
+fallujah, iraq
+ibekwe
+in a movie
+paid
+paid maternity leave
+mama june
+introducing the new me
+raise your hand
+academia
+i do
+the sands hotel in vegas
+they could use a little more compassion.
+3 republicans and 48 democrats
+joe biden
+paul ryan's
+adidas
+#photooftheday
+1.5m
+obese
+addicts to drugs and alcohol
+the Beatles
+the premiere
+the intro
+janet mock
+grace lee whitney
+grace lee whitney
+the new george michael single
+george michael
+after the fantasy draft
+honda
+he smiled
+the hollywood bowl
+the browns
+colin kaepernick
+ruby rose
+social media
+new york rangers
+tbay on st louis
+a gym
+motion
+senator john mccain
+senator john mccain
+@gabyamarantos @tottustu
+@gabyamarantos and @tottustu
+ciara
+baby future
+loss of life
+attack this morning on @un in #garowe.
+zordon
+power rangers
+justin
+for his and many others safety
+nigerians and people around the world
+#bringbackourgirls
+tweeting
+tweets
+fake news
+assad
+great
+in a beautiful picture
+mohammed bin zayed
+ministers
+with a spirit of change and progress
+the new ministers
+lakers
+2018 free agency
+la
+basketball
+pacers and clippers
+lorde
+snl
+an awesome compliment
+alan rickman
+funny and engaging
+dana harper
+season 11
+greg schiano
+3
+death row records
+beats by dre
+beats by dre
+michael jackson
+idris
+this is where the trump budget belongs.
+the house of representatives
+66-57
+flint
+political statements and finger pointing from political candidates
+long shirts
+find her
+mama
+tapping
+tapping
+aaron schwarzenegger
+swamped
+6 months
+legalize dACA
+beyonce
+usc
+black
+american
+how to sit like a lady
+miss america
+south Korean president moon jae-in
+#pyeongchang2018
+emma
+bring a flask to the emma
+sad
+exclamation points
+strongly
+twitter
+in heaven
+little james dickens
+picking and grinnin
+in heaven
+unqualified
+coal country
+oliver sacks
+beautiful minerals
+bearcam
+bearcam
+exploreorg
+music
+the voice
+cavs
+hidden fences
+hidden fences
+fort made public affairs
+donald trump
+confidence
+sorry beliebers and onedirectionallday
+van gaal
+united
+arsene wenger
+this summer
+VOTER FRAUD
+VOTER FRAUD
+incredible progress
+nbcsnl
+google maps
+pacman
+cnn
+who is or was your bestie on tour
+her/him
+5 minutes
+soccer
+soccer
+5 minutes
+ed sheeran
+game of thrones
+the shark
+ed sheeran
+hats
+pharrell's hat
+alex gavan
+victims
+he was golden.
+rippaulwalker
+being so effortlessly golden
+effortlessly golden
+rippaul walker
+golden
+florida gators
+niece and nephew
+measured and inclusive
+michael chertoff
+measured and inclusive
+michael chertoff
+2:30am edt
+jfk
+every article I've read
+8:45 pm
+being shocked he won
+every article he's read about it said it was surprising.
+a hundred and fifty people liked it.
+under a boulder
+philae
+chris bennington's passing
+chester bennington
+cousins
+4 boys, cousins ages ranging from 9 to 11, killed in israeli strike
+aza beach
+she loves the pictures
+si_ swimsuit
+messian
+messian
+an interview and a major photo shoot
+chapter 2
+bruce jenner
+luis Figo
+fifa president
+joseph fiennes
+justin bieber
+selena gomez
+lavar ball
+charles barkley
+religion
+@yayatoure
+eric garner died
+selling cigs by the single
+rsd julienblanc
+julienblanc
+scenes out of the book
+50 shades
+earthquake
+october 30th
+rockefeller center is pacworld.
+pacman
+on the highway
+the hwy btwn  Bonnieville and etown
+he started to run for potus.
+cruz
+section 5 public order act
+Brighton magistrates court
+colin  Kazim-Richards
+section 5 public order act
+#Marcherepublicaine #jesuischarlie #jesuisfrancaise
+marche republicaine
+houston
+$500,000
+the brain
+human rights issues
+p!nk's face during christina aguilera's whitney houston tribute
+christina aguilera
+will smith
+new orleans
+pesky products on high shelves
+bouncy isles
+superior ct 121 elm st.
+for removing pane of slaves picking cotton
+germany and ghana
+rand paul
+for the good of the party
+tens of thousands of people.
+2022
+2022
+late-november/late-december
+late-november/late-december
+2022
+97
+"you don't drink do you?"
+the cops
+the cops
+fabricating
+his humor, his talent, and his capacity to love
+a brother
+listens to the concerns of the people
+the annulment process
+francis
+made his own
+it's okay
+in a bowling alley
+what angle she is taking
+mel tillis
+good luck with this guys
+cantor
+the knicks
+center
+germany
+underpants
+iggy's hair looks like a blonde.
+university of washington
+anakocovic
+people
+weather
+they are throwing a pizza party.
+anti-racist with humour
+Mario
+ethnic and religious
+true detective is a tv show.
+she had an abortion.
+being openly heterosexual
+matt damon
+pence
+it isn't actually feasible
+pin
+james franklin
+making a mistake
+he thinks it's classy.
+#RupertsFault
+christian
+10pm
+fake news
+press the wrong button
+man
+january 15, 2015
+mike porcaro
+it's OK
+power
+meryl
+take her seat
+anyone's spouse or kids
+ted cruz
+it's not acceptable to attack anyone's spouse or anyone's kids
+since 2007
+letterman
+the dial
+take over
+the twizzler challenge
+2 black holes merging into 1
+a cybersec challenge took place.
+orange
+white supremacists
+the president
+before they die
+ass reporters
+memes
+lady gaga's oscars look
+my children
+venomous and vicious
+fia16
+a380
+do exactly what they say
+terrorists
+irefox
+the finale
+stay safe and warm
+tomorrow
+everybody
+he would have to consciously think of it.
+mcilroyrory Rory
+mcconnell
+7yrs
+@cindymannings
+ Rahman suspects
+facebook
+facebook down
+a healthcare plan
+a great healthcare plan
+worry
+the toffs
+transparency
+there is not a tweet here
+nypd
+officer brian moore
+nearly 200
+act on climate
+leonard
+millions
+lebron james
+chris broussard
+english and spanish
+sophie cruz
+a dog
+betty willis
+las vegas' visual fabric
+promoting
+media attention
+jessica lange
+caitlyn jenner
+across the globe
+laughter
+get out and vote
+he learned that jon ossoff doesn't even live in the district.
+facebook
+#facebookdown
+sorority
+she is amazed at how affordable it is.
+ted cruz
+donald trump
+worrying about the controllers strike
+the airport
+netanyahu's
+for his speech to congress
+they started baking.
+grilled vegetables.
+they are baking bread.
+saturday
+nine matches
+four months
+beta awards
+during the jay z and beyonce clip
+pakistan
+navy SEALS
+15 years
+the united states
+kellan lutz and anna kendrick
+ship them
+sam Tageson
+what you have
+his loved ones
+messages of support, love and encouragement
+justin kroll
+spielberg
+a partisan
+a grand slam
+nfl
+how to get away with murder
+dallas
+obama
+katie holmes' golden pants
+katie holmes
+Corey menafee
+Corey menafee
+the us chamber
+better and stronger trade deals
+flint
+flint
+january
+a shark
+the bachelor producers
+dem
+a jackass
+my rapist
+hollywood/media
+tomi lahren
+obamacare
+a woman
+female
+why we have cup holders in movie theater seats
+movie theater and airplane
+impeachment of donald trump
+plays racist calls
+ Murray
+dimitrov
+paul walker fdn
+paul walker fdn
+ebola
+wilson bsl4 lab
+kampala serena
+it is solar.
+khayoola serena
+@patsajak
+the wheel of fortune
+another plane
+vanished
+it's crazy.
+people
+a hard but liberating day
+watch the evening news
+south africa
+every praise
+michael brown
+movement house
+farmers
+plowing up dirt
+not to eat them.
+kim kardashian pierced her daughters ears
+kim kardashian
+justin bieber
+myspace
+margot
+@hitchbot is doing this.
+the national weather service map
+serving something more important than himself
+john mccain
+a bit player in the story of america

eval/samples.validation.hyp.paragraph_question.answer.lmqg_qg_tweetqa.default.txt

@@ -0,0 +1,1086 @@
+megyn kelly
+her hidden agenda
+a lot of people
+coachella
+a very good role model
+very good
+natalie portman
+saturday night live
+himself
+trump's
+full of spice
+in the shower
+saturday night live
+3-years
+who he is
+trump
+news for kanye west
+freedom
+5 years
+the bachelor
+nets
+we win
+thoughtful, committed
+small
+to love
+hate
+ryan
+jazz
+"stay in your seat, kanye"
+revisiting watson's world in 2015
+dad
+his first Celtics jersey
+the children
+heteronormative
+barack obama
+obama day
+the candle
+a peach candle
+neil portnow
+women
+abuse of power
+baton rouge
+black panther
+memorable
+'hidden figures'
+michael keaton
+$1
+smosh
+spidermable
+black cat
+nate
+14
+elton john's words appear sarcastic.
+sunset strip
+keegan allen won't tell his mom
+verizon
+boston
+martin luther king
+it's a play about a child.
+excited
+two
+bodega
+a no-move clause
+three
+magazine
+his shirt
+election
+apology
+zero
+cnn
+pizza
+classy move
+classy move
+panel
+every poll of the debate
+jacoby ellsbury
+1st
+michelle obama
+women in film
+mr drew scott
+vote
+simone biles
+bar routine
+alessiacara
+crowd
+@dove
+#outofthisworld
+#outofthisworld
+egypt
+abuse
+a copy
+donald trump
+lisa kudrow
+smelly cat
+it takes a village
+2018
+the Arena
+in vancouver
+what akers saw in the sky.
+akers reaction
+61 years
+europe
+the word.
+in the movie
+david levitz
+stick together
+@ellingyelling
+stunts
+until we are old enough
+mayor mark
+white house
+@nscpress
+more than 6,000
+black
+chicago
+hispanics
+2
+2 b
+to protect the american people
+helping economy and bringing back jobs
+congress
+a great start
+a massive expansion of retraining and counseling provided nationally to our police force
+police force
+@usatopinion @usatoday
+he wasn't surprised
+cellphones
+patrols
+chrisrock
+chrisrock
+iroquois high school
+grace aroune
+discovery
+kevloria
+chris hemsworth
+a sweet viennese waltz
+the golden ticket
+james comey
+the press
+serena williams
+to see you
+kerry washington
+RED
+a jury
+he was murdered.
+MAN OF STEEL
+a prequel
+paul george
+tmobile
+golden globes
+Cathy lanier
+10 years
+paris
+u2
+buckingham palace
+royal air force
+the fbi
+amazing
+2017
+9
+tinder
+to meet people and have dates
+president
+down the road
+the economy and ahca
+worse
+the media
+dc comics
+they've been out for 12 months.
+anthony mackie
+a bright, brilliant talent und
+he died
+nton yelchin
+charlie bartlett and house of d
+10,000
+buffalo sabres
+president
+1000s
+his home rink
+top selling car
+apple
+the dunkirk
+are u going to die in the dunkirk?
+@sengillibrand
+sen gillibrand
+a sad story
+arie
+17 hours
+power
+oprah
+juggle it all with two hands
+7
+mayor of london
+wmu football
+bb
+a thousand notes
+breaking bad and the fire
+2008-13
+the mcnugga
+mcnugga
+five
+coldplay
+a secret
+getting better and better
+32 miles
+helicopter pilot
+best day of our lives
+their kind words
+purple
+katie gosselin
+rock the casbah
+bill murray
+impassioned
+players at the texans
+billboard
+break free
+everybody must vote
+alabama
+build the wall
+summer
+wonder-babe zendaya
+mrs. michael
+pink ring
+more shootings and more death
+they want them to stop.
+swiss army man
+switzerland
+thinkpieces
+fryre festival
+gov. jay nixon
+to visit north stl county
+steve bannon
+darkening  Zoe Saldana's skin
+zoe saldana
+gold
+charlie coyle
+charlie coyle
+during the 1st intermission
+the new addition to thePEEPS
+donald trump
+pizza rat
+bylsma
+malkin and crosby
+when does beyonce get here?
+lagalaxy
+lagalaxy
+dershowitz
+cassell
+he is living his best Super Bowl EVER
+dancing
+martin luther king jr
+darkness
+planned Parenthood and ocare
+in d.c.
+4th of july
+taylor swift
+muslim
+trump supporters
+sam bee
+conan obrien
+bb-8
+starwars cast
+obamas
+the nicest family on earth
+trying to undermine democracies
+s Sherlock Holmes
+doris roberts
+death
+london
+no frauds
+lebron
+Carlton
+hotline bling
+657
+with "k."
+westgate
+westgate
+the duchess of cambridge
+love it
+ed sheeran
+the riverlands
+ed sheeran
+game of thrones
+anxiety
+she is trying to come to terms with it and her faith.
+1903
+1883
+isaac h_wright
+isaac h_wright
+the best
+being his number one cheerleader
+a tickle
+manilla
+biden
+everything she wants to say
+everything
+brangelina
+iowa flag
+midfield
+sen rand paul
+4/25
+two
+sharks
+the national anthem
+houston
+excitement
+in bio
+y'all
+corinne foxx
+miss golden globes 2016
+a meme
+driving students around for surewalk
+around
+michael phelps
+kdtrey5 and deandre jordan6
+james harden
+the browns win or the end of the season
+for clarification
+nail polish
+the shoe
+they are wrapped in a circle of paranoia.
+former ice cream store, now a cafe
+local
+rogers
+pat Quinn Way &  Griffiths Way
+tick "white british"
+when applying for a job
+ciara and russ
+kids
+the 15th
+174 yards
+god morning rupaul's drag race
+gaga
+floored
+flats
+gal gadot
+martin
+goals
+jsyk
+1032am
+obama
+how good they had it
+michael eRUZIONE
+gordon hayward
+l.a.
+@preacherlawson
+tyrabanks
+@gregcosell and @gregcosell
+football
+sacramento
+the radio station
+drama
+justin party
+he is risen
+a candy egg delivering plushy bunny
+tuesday
+undercover robots
+he has a daughter.
+liam payne
+artists
+hate speech
+king hall
+van canucks
+pat Quinn
+mlk
+mlk day
+hard times in my life
+tn
+the  Maks
+maksim
+section 104
+hemsworth
+ruffalo
+he is an auctioneer at hilarity for charity.
+halloween
+harden
+two
+gal gadot
+@chrishemsworth
+nick kroll and stephen at home
+david letterman
+fred armisen
+difficult people
+160 characters
+over 200
+@jimmykimmel
+for the effort
+grace van der Waal
+made her famous
+mr. alcohol
+emilia  Clarke
+eyes
+a dream
+police man
+right now
+hurricane harvey
+mike nichols
+comedy albums
+two scarves and a jacket
+june
+shia labeouf
+how they can be manipulated and orchestrated
+louise
+hopeful
+kermit the frog
+a song to release on christmas
+violence
+the short skirt
+christine teigen
+it is a song by kim kardashian
+dolores oriordan
+island records and a love for music
+dylan
+rumors
+paul mccartney
+a career
+contempt
+billionaire class
+donald glover
+han solo
+ed sheeran
+ask sheev
+the olympics
+the olympics
+in nola
+joel Embiid
+the covfefe of strangers
+covfefe
+ann coulter
+right now
+dave mustaine
+star trek
+in the middle of the night
+alabama
+everyone
+you all
+a bow
+you're an independent person
+low
+honor two more legends of our sport.
+sport
+george r.r. martin
+a heart attack
+larry
+make this about larreh
+trump
+mr burns
+megyn kelly
+lightweight reporter
+to speak in vague but bombastic generalities
+vague but bombastic
+patrick arquette
+half
+ceelo
+an mk purse
+sdcc 2
+starwars
+eagles fans
+over 80
+everything they could grab from ivy park
+ivy park
+Logic301@thegreatkhalid and @alessiacara
+blakelively
+wish she looked like @blakelively
+christine teigen
+150
+henry cavall's mustache
+henry camill
+trevor story
+the rockies
+donna the elephant
+nervous
+luke donald
+wine
+she feels she can't f'ing wait
+writing raps
+la
+john will film his reaction.
+an airport
+listen to beyonce
+larry
+harry
+tweet did not show
+tweet did not show
+punch  Chandler
+@matthewperry
+a year and a half
+making a record
+warren and faye
+warren and faye
+beauty and the beast
+gay
+space jam
+kentucky
+the upper hand
+the beyhive
+paramount and Warners execs
+screaming at each other
+luke skywalker
+the character work
+1997
+HIV/AIDS
+nhl management
+'st. tom','santa Claus' and 'cheese Pasta'
+custom-painted aircraft
+Disney's frozen
+do ya think i'm sexy
+@republicrecords
+@fxnleisure
+@fxnleisure
+donald trump
+2
+istanbul
+turkey and greece
+sanders
+94 crime bill
+halftime show
+lady gaga
+south Carolina, south Dakota and utah
+idaho
+marie mcfly
+all-female
+alice oswalt
+in the universe
+timberlake
+country
+hbo is done with the nhl
+24/7 Series
+in a wheelchair
+james harrison
+16
+vegas
+jeff sessions
+who’s been naughty or nice
+jeff varner
+head of habitat int'l
+joe biden
+john
+christine teigen
+jonathan drouin
+he will play on the trip.
+joss whedon
+batgirl
+bryzgalov
+nhll star
+the words
+their future VPOTUS
+john legend
+because of john legend.
+ariana
+gay men
+we haven't used aim in years
+amanda berry
+cleveland
+ann coulter
+delta
+johnny depp's
+an outfit he found in Johnny Depp's goodwill donation bag
+kellyanne conway
+the warriors
+james buss
+kobe  Bryant
+john williams
+come swim
+kristen stewart
+mdsg
+lacey holsworth and her family
+cavs
+lebron james
+lebron james
+lebron james and michael jordan
+lebron
+sad
+to spend more time with his pets
+left wing
+culture of violence
+beyonce
+lemonade
+leslie jones
+2 weeks
+introduce you to harry,  Ginny and albus
+harry,  Ginny and albus potter
+houston and brown
+tom hiddleston
+seven minutes
+the penguins locker room
+live look in
+mouths
+prayers and hymns
+hanzal
+boedker
+louis
+katie bentuan
+ming xi
+leslie odom, Jr.
+liberation station
+wiggins
+106-106
+106-106
+kemba
+macedonian
+for taking this photo
+madonna
+malia obama
+malia obama
+malkin
+MRI
+facebook
+u.s.
+marc jacobs
+hillary
+mary j blige
+@rianjohnson
+matilda and gyffindor
+gryffindor and ravenclaw
+madbluetooth
+rihanna has a tattoo.
+the harlots
+romphim
+ Raven
+donald gets things done
+melania trump
+the canadian anthem
+held the "all lives Matter" card up
+anyone a winner
+you're messing with me
+michael dal colle
+sonny Milano
+trump
+possession of controlled substance
+canada
+$250k
+nashville
+taylor
+white
+because of race
+kukkatori
+kukkatori print
+Residente's verse on immigrants
+his Wrote my way out verse
+david Cassidy
+proud and honored
+maya angelou
+a caged bird
+less than one year old
+slow it down
+sweden
+FoxNews
+gilmore girls
+gilmore girls
+she refuses
+everyday heroes
+strong and full of everyday heroes
+the internet
+net neutrality
+kanye west
+2015
+new york
+devastating
+cops
+they harassed him.
+she got beat up
+outside
+say anything negative about curry.
+Shutup and enjoy the show
+golden globes
+black
+abc making arie the next bachelor
+arie
+justin bieber
+whip
+jeff gorton
+11
+the final five
+the floor
+office workers
+san bernardino
+r-word
+paper towns
+a waterbottle
+downton abbey
+paul walker
+an accident
+@criticalschoice#deaththreats
+9460 wilshire blvd
+screenshot this
+the bachelor
+olivia
+steal people's boyfriends
+she ruined it.
+a blister
+kotex
+his family
+he spent yesterday with his family
+casino boat
+50 people
+troops
+proudly
+her ass is 2 inches.
+kim kardashian's
+lions
+paul, noma and cherrelle
+harry potter play
+hugh jackman
+gap toothed
+escape
+they cut a hole in the wall.
+every word said
+in the pro-am
+tim tebow
+empathy
+everyone
+his PR team
+zayn
+pm trudeau
+canada
+jules
+a friend
+rally4peace
+those who lost loved ones
+selena and abel
+release music together
+lebron james tattoo
+lebron james
+ Chester bennington
+linkinpark
+eastern michigan university
+racist graffiti
+california
+sad
+texans
+moving out of the 1st pick
+colors
+usc Trojans
+rain and storms
+central and eastern
+benetton
+haley
+a kia
+8 straight
+straight spags
+rihanna fans
+john lewis
+what martin luther king Jr. would have done
+russian officials
+negative
+this is what the truth feels like
+dates and RSVP
+elliegoulding
+3/15
+justin bieber is here
+justin bieber's set
+this nonsense
+dallas
+kim kardashian
+gq magazine
+purple
+a black panther
+IGGY AZALEA
+enjoying the holiday season
+call me and say "son I miss my husband and children"
+in heaven
+an official statement
+shocked and heartbroken
+show your best office mugshot
+a sweet coffee prize pack
+donald trump
+on a great speech
+alabama
+20
+beauty and the Beast
+emma watson
+friends
+with a black cast
+malcolm young
+ac/dc
+kane
+he played in the piranhas3dpuck game.
+tom hanks
+2017
+anne hathaway
+anne hathaway
+women at the march syncing periods
+beat him to it
+rant over
+violence
+jeremy
+3 pm
+lester and lackey
+lester and lackey
+kentucky
+wallstar
+speeches like this
+an american
+line with chara
+2014
+in the unlikely event
+2009
+emergency room nurse demographic
+steph curry and under armour
+steph
+god
+stephen a.
+after shoot-around
+four
+the last
+a conservative
+the russians
+right
+black Panther
+a wealthy nation
+august
+into august
+ronald wilson
+mark rodgers
+tCU's punter
+shawn oakman
+team usa
+team usa lockerroom
+rihanna
+the met Gala
+vp biden and mariska
+that beautiful scene
+mrs. who
+mrs. who
+colon cancer
+a hundred and fifty-seven.
+warm thoughts and well wishes
+getting back to work
+jsu bus
+nrj awards
+a great time
+to be in the rock hall
+votes, posts, and videos
+kissed.
+a 10
+@money23green
+3
+disney
+time of beastiliaty
+it
+#endangeredriver
+3
+2:19
+your grandmother
+twenty dollars
+the duchess of cambridge
+kensington palace
+the duchess
+flight simulator
+the mayor of san jose
+democrats
+for his resignation
+the nbc
+mike green
+mike green
+emotions
+like you have multiple offers
+regina george
+election day
+colonel sanders
+a timesup rose
+free and open to all
+net neutrality
+grease
+on her scalp
+the area
+black
+president's motorcade
+to be a las vegas girl
+portia and ellen
+ellentube
+run to each other
+the way they run to each other
+hero
+a movie that delivers
+make running up to ppl's homes a thing
+it's dangerous
+a free pair of limited-edition @GeorgeHW Bush socks
+george hw bush
+her id
+the white house
+hamburg
+hurt
+gilmore girls
+given her new life
+russian
+james harbaugh
+the national anthem
+w nj
+this forecast
+black
+work
+dl champlin
+after everything I've done for you
+donald trump
+reprehensible, prejudiced and divisive
+it's the right decision.
+the right coach
+the giant herd of starwars concert attendees
+making their way to show
+hockey
+his gordie howe hat trick
+police
+mjolnir
+steve
+protect their homes.
+the family of seth thomas
+seth thomas
+Gig Harbor
+narrows airport in Gig Harbor
+tina fey
+ Felicity jones
+december 7, 2017
+prince of Wales
+@usher, @jimmyfallon, and @hamiltonmusical cast
+nypd hats
+officer more
+tom hiddleston
+red
+gold
+katieledecky
+tsonga
+his first match in the davis cup final.
+greece
+turkish
+hit by a pitch
+birmingham
+birmingham
+hailey baldwin
+v magazine
+half-time
+ar
+the tig
+very sad
+he was such a character
+skydance
+diane keaton
+nyc
+tom hiddleston
+to personalize shopping
+@cher
+the hospital
+ethan
+global
+the grandchildren
+christmas
+america
+amber waves of grain
+to report incidents of bias
+because this state celebrates our differences
+ariana grandde
+the uk
+antarctica
+penguin
+a photo of drake
+3 legs
+oprah
+terling krown
+proud
+the indians
+22
+don graham's farewell party
+an honor
+donald trump
+donald trump would get very mad about it
+jjwatt
+a gift
+@stephencurry30
+when they grow up
+his neighbor/genius quiara
+sia weaponizes vowels
+breezy
+surewalk
+elizabeth
+the bachelor
+thugs
+white
+jennifer aniston
+with this faith
+mountain of despair
+she gets headache a block from school
+oscar nom
+#mets
+get my #mets tattoo
+knight_mtv
+because of the connection she shared
+a trophy
+saturday
+the light
+the light has sold out.
+chris stapleton
+chris stapleton
+a bill
+martin heinrich
+cattie
+bathroom counter
+oscars
+1am
+leaked nudes
+leaked
+17's
+yogi ferrell
+the cauldron
+wayne's world
+the juggalo march
+america
+anti-lgbtq+ presidential ticket
+they mean nothing
+lee
+if he ever thought, "wow, you look familiar."
+zazie
+domino
+the beach
+aim
+the app
+the glory of the Lord
+all flesh
+sjp's
+sarah jennifer Parker and george malkemus
+kanye
+dark
+kyle chandler
+comey
+zac efron
+on the cheek
+nudes
+@bettemidler
+kanye
+50 mins
+slaughter the competition
+metagala
+that america is trash
+20
+new isles
+fast
+champagne
+autotune
+sounds like autotune
+a free pass to laugh
+someone's horrible misfortune
+kissed her
+2016
+security guy
+lose it
+they want to brunch
+the means of production
+dua lipa
+the third
+@thecampaignbook
+singapore
+hope
+someone gives her hope.
+kim kardashian
+cashing her 80 million video game check
+spotify
+releasing her album
+benedict cumberbatch and a nice chap who plays tennis
+plays tennis
+alarming
+texted
+@dunderswiftlin
+yepls
+michelle rodriguez
+matt bomer
+b marshall
+it's negative.
+a podium
+melissa mccarthy/sean spicer
+lowkey
+"boogieman"
+alexander pettyton
+opening this convo
+beautiful
+alabama
+black women
+the day we become silent about things that matter
+mlk
+red cross
+the people
+restaurant menu print business
+restaurant menu print business
+the airwaves
+write a book or start a podcast
+young pope
+night

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:507ff75c34f5ca9b2a3ab171d05d7c573afdc8dbecfb71a3d48280b1940579cf
-size 891614207
+oid sha256:3d9af18f30d344085a0c0eb5fce63dbe9354c80444d241743054f9bc72089d2f
+size 891617855

tokenizer_config.json

@@ -104,7 +104,7 @@
   "eos_token": "</s>",
   "extra_ids": 100,
   "model_max_length": 512,
-  "name_or_path": "lmqg_output/t5-base-tweetqa-question-answering/best_model",
+  "name_or_path": "lmqg_output/t5-base-tweetqa-question-answering/model_eszyci/epoch_9",
   "pad_token": "<pad>",
   "special_tokens_map_file": null,
   "tokenizer_class": "T5Tokenizer",

trainer_config.json

@@ -0,0 +1 @@
+{"dataset_path": "lmqg/qg_tweetqa", "dataset_name": "default", "input_types": ["paragraph_question"], "output_types": ["answer"], "prefix_types": null, "model": "t5-base", "max_length": 512, "max_length_output": 32, "epoch": 10, "batch": 32, "lr": 0.0001, "fp16": false, "random_seed": 1, "gradient_accumulation_steps": 2, "label_smoothing": 0.15}