KR 2019 homework part 1: overall task: erinevus redaktsioonide vahel
Mine navigeerimisribale
Mine otsikasti
Uus lehekülg: ' == Task == The task of the first lab is to build and demonstrate a system which can * tokenize the text (input and question) * run a [https://en.wikipedia.org/wiki/Named-entity...' |
|||
| 4. rida: | 4. rida: | ||
The task of the first lab is to build and demonstrate a system which can | The task of the first lab is to build and demonstrate a system which can | ||
* tokenize the text (input and question) | * tokenize the text (input and question) | ||
* run a [https://en.wikipedia.org/wiki/Named-entity_recognition NER tool] on the text giving wikipedia url-s as output. See [https://gate.d5.mpi-inf.mpg.de/webaida/ webaida]. Notice that | * run a [https://en.wikipedia.org/wiki/Named-entity_recognition NER tool] on the text giving wikipedia url-s as output. See [https://gate.d5.mpi-inf.mpg.de/webaida/ webaida]. Notice that: | ||
** some NER-s do not give wiki URL-s, but just types. This is also useful. | ** some NER-s do not give wiki URL-s, but just types. This is also useful. | ||
** for the second overall scenario (like wikidata) we do need wiki urls, though. | ** for the second overall scenario (like wikidata) we do need wiki urls, though. | ||
Redaktsioon: 6. veebruar 2019, kell 10:44
Task
The task of the first lab is to build and demonstrate a system which can
- tokenize the text (input and question)
- run a NER tool on the text giving wikipedia url-s as output. See webaida. Notice that:
- some NER-s do not give wiki URL-s, but just types. This is also useful.
- for the second overall scenario (like wikidata) we do need wiki urls, though.
- run a parser tool on the text. There are several ways to parse, some more useful for our purposes than others. We will come back to that.
Technology and tools
You are free to use any programming language, but Python is recommended.
You are free to use NLP tools and API-s and datasets, but your program should drive them from the beginning to end (ie your program takes input files, calls tools, modifies and prints output). It is better to use the tools than not to use them!