Evaluation Tasks

The Twentieth China National Conference on Computational Linguistics (CCL 2021)

Call for technical evaluation tasks

August 13th to August 15th, 2021, Hohhot

Conference website: http://cips-cl.org/CCL2021

"The Twentieth China National Conference on Computational Linguistics" will be held on August 13th to August 15th at Hohhot, Inner Mongolia Autonomous Region, China. The organizer of the conference is the Professional Committee of Computational Linguistics of the Chinese Information Society of China, and the organizer is Inner Mongolia University。CCL is the flagship conference of the Chinese Information Processing Society (CIPS),the largest NLP scholar and expert community in China.After nearly 30 years’ development, CCL has been widely recognized as the most authoritative, influential and largest NLP conference in China.With a major emphasis on computer processing of the languages in China, CCL is a premier nation-wide forum for disseminating new scholarly and technological work in computational linguistics.

The CCL conference began to organize technical evaluations in 2017 to provide Chinese language processing researchers with a platform to test related technologies, algorithms and systems. 14 evaluation tasks have been organized, involving morphology, syntax, semantics, pragmatics, modern Chinese and ancient Chinese and other multi-level Chinese language processing basic technologies and their applications in e-commerce, communications, justice and other fields, and open multiple public data There are thousands of participating teams.

This year the conference will continue to organize technical evaluations, and now sincerely solicit evaluation mission plans from scholars, research institutions and enterprises in related fields. The plan should describe in detail the task content, evaluation criteria, the preparation of the evaluation data and the general schedule, and send it to wsong@cnu.edu.cn by email.

  • Deadline for task collection:
    2021.03.10
  • Overall evaluation time (planned): 2021.04.01—2021.07.31
  • CCL 2021 Evaluation Seminar: 2021.08.13—2021.08.15

Evaluation tasks can include but are not limited to the following topics:

  • Basic tasks of natural language processing
    • Lexical and syntactic analysis
    • Semantic Analysis
    • Text and pragmatic analysis
    • Cross-language, small language natural language processing
  • Natural language processing applications
    • Knowledge Graph
    • Question answering and dialogue system
    • Reading comprehension
    • Text generation
    • Information retrieval, recommendation system and social media computing
    • Combined application of natural language processing and medical, education, humanities, justice and other fields

Evaluation Chairs:

Hongfei Lin, Dalian University of Technology

Wei Song, Capital Normal University

2021.01.13