Evaluation Framework for Benchmarking NER Systems

This is an Evaluation Framework developed to support benchmarking of NER systems. The developed framework can be used to evaluate NER systems (also known as Wikifiers) which provide links to Wikipedia articles describing recognized entities, and classify those entities with types from the DBpedia Ontology.

The framework provides all required materials for evaluation of a NER system

• Two benchmark datasets: News and Tweets.
• Two GATE plugins for loading the benchmark datasets into GATE.
• Alignment GATE plugin which aligns the types of the recognized entities by a NER system with the DBpedia Ontology.
• Reference implementation of a GATE plugin for a NER system (Wikifier).