Cookie Name	Cookie Description	When not logged in	When logged in
prima_cookies	Remembers whether you have already closed this message.	Yes	Yes
prima_notice	Remembers if you have alreaded viewed any notice/warning message(s). Such a message is used to inform users of potential downtime or issues that might affect the normal operation of the website. It is set to expire after the date when such notice is obsolete (eg after an expected downtime/error is fixed).	Yes	Yes
PHPSESSID	The ID of your session.	Yes	Yes
__utma	This is set by Google Analytics. It stores each user's amount of visits, and the time of the first visit, the previous visit, and the current visit.	Yes	Yes
__utmb, __utmc	These are set by Google Analytics. They are used to check approximately how long you stay on a site (when a visit starts, and approximately ends).	Yes	Yes
__utmz	This is set by Google Analytics. It stores where a visitor came from (search engine, search keyword, link).	Yes	Yes

REID2019 Resources

Overview

Provided to participants:

Example images with ground truth (in PAGE XML format)
Software libraries and tools to create/view PAGE and to run OCR
Support

To be delivered by participants:

Page segmentation, region classification, and OCR results in valid PAGE XML (see examples below)
Access the candidate methods (executable, Docker, web service or similar
A short description of the method

Ground Truth Format

The ground truth for each image is provided in the PAGE (Page Analysis and Ground truth Elements) format. For a description of the relevant parts (for this competition) of the XML file structure please see the section "Page analysis and recognition results" below.

PAGE has been developed on a long working experience in creating, managing and using datasets, including the PRImA Layout Analysis Dataset and the large and significant historical document dataset of the EU-funded IMPACT project.

More details on the PAGE format can be found in the following paper:

S. Pletschacher, A. Antonacopoulos, "The PAGE (Page Analysis and Ground-Truth Elements) Format Framework", Proceedings of the 20th International Conference on Pattern Recognition (ICPR2010), Istanbul, Turkey, August 23-26, 2010, IEEE-CS Press, pp. 257-260. [further details]

The GitHub page and the XML schema can be found here:

PAGE-XML on github.com

schema.primaresearch.org/PAGE/gts/pagecontent/2018-07-15/pagecontent.xsd

The format provides for the representation of several different region types, which may be subject to different processing in recognition systems. The most important types of region for challenge 1 are table, nested table cells, and text paragraphs. For challenge 2, the most important types of region are text, image, footnotes, and marginal handwritten text. For both challenges, the highest-level textual regions correspond to paragraphs (a conscious choice as a paragraph is also a complete logical entity, as opposed to columns of text for instance).

For each region there is a description of its outline in the form of a closely fitting polygon. Such a representation enables a very accurate and efficient geometric description, especially for complex-shaped regions. Text regions may also contain Unicode text content.

A simple example XML is described in this document

Submission requirements

Authors of methods should submit the following by e-mail to the organisers:

Page analysis and recognition results in PAGE format (see below)
Access to the executables/systems of the candidate methods
A short description (one page) of the methods (principles of operation and steps). Cite and attach any relevant publications, if available.

Page analysis and recognition results

The results must be stored in the PAGE format (same format as the ground-truth provided). Evaluation will be based on detected regions (location, type and subtype) and detected text. Further metadata can be provided (such as column level element descriptions for the tables in challenge 1) but is not mandatory.

Open source tools for exporting in the PAGE format are available from the PRImA Tools website.

Alternatively you can produce PAGE files using your own XML library, following the PAGE Schema.

Aletheia, a PAGE viewer and editor is also available for download so you can preview your results and check for validity of your produced XML files.

Filenames of submitted PAGE files should match the name of the original image.

Text Recognition - Main Challenge: Recognition of Bengali books

Text recognition results should be added to the corresponding text regions as Unicode text content in the PAGE XML file.
Text is only required for the main text body (not for the marginal handwritten text).
OCR accuracy will be evaluated as a significant part of the overall score of a submitted method. Including OCR will therefore greatly improve the chance to win the competition.

Table Regions (Bonus Challenge)

All of the Quarterly Lists will contain tables of text (see screenshot). Tables should be recognised in the XML. Cells of text should be recognised as nested regions within the table and described as child XML objects in the surrounding parent table region. Pages containing text cells arranged in a table format but without table grid lines should also be classed as tables.

Text Recognition - Bonus Challenge: Recognition of multi-lingual tabular data (English, Bengali)

Text recognition results should be added to the corresponding text regions as Unicode text content in the PAGE XML file.
Text is only required for the main text body and for nested regions.
OCR accuracy will be evaluated as a small part of the overall score of a submitted method. Including OCR will therefore slightly improve the chance to win the competition.

Example dataset

The following are examples of representative images from the variety of situations existing within the evaluation dataset.

Evaluation dataset

The evaluation set is now available (email on 15/04/2019, please contact us if you have not received it).