ELMo-BiDAF
Implemented By:
-
Dirk Groeneveld
-
Akshita Bhagia
-
Pete Walsh
Description:
This is an implementation of the BiDAF model with ELMo embeddings. The basic layout is pretty simple: encode words as a combination of word embeddings and a character-level encoder, pass the word representations through a bi-LSTM/GRU, use a matrix of attentions to put question information into the passage word representations (this is the only part that is at all non-standard), pass this through another few layers of bi-LSTMs/GRUs, and do a softmax over span start and span end.
This model is maintained by the AllenNLP team and its contributors on the AllenNLP models repository at https://github.com/allenai/allennlp-models.
It achieves 80% F1 and 71% exact match on the SQuAD 1.1 validation set.