Thinking beyond event extraction is at the heart of the research being carried out at NewsReader. To assess and advance the state of the art in ordering events, we are organising a SemEval shared task around creating TimeLines. Specifically, SemEval-2015 Task 4: TimeLine: Cross-Document Event Ordering (pilot task).

We have made available a set of annotated documents with associated events and timelines for participants to develop a temporal event ordering system on. During the SemEval evaluation period (5 – 20 December 2014), we will made available an additional set of documents with a list of entities, for which participants are to create timelines. Participants can choose to do the full task (starting from raw text), or use the pre-annotated events.

For more information on the data, evaluation methodology and how to participate see http://alt.qcri.org/semeval2015/task4/