Evaluation Tasks


The Twenty-first China National Conference on Computational Linguistics (CCL 2022)

Call for technical evaluation tasks

October 14th to October 16th, Nanchang

Conference website: http://cips-cl.org/static/CCL2022/en/index.html

"The Twenty-first China National Conference on Computational Linguistics" will be held on October 14th to October 16th at Nanchang, Jiangxi Province, China. The organizer of the conference is the Professional Committee of Computational Linguistics of the Chinese Information Society of China. CCL is the flagship conference of the Chinese Information Processing Society (CIPS),the largest NLP scholar and expert community in China.After 30 years’ development, CCL has been widely recognized as the most authoritative, influential and largest NLP conference in China.With a major emphasis on computer processing of the languages in China, CCL is a premier nation-wide forum for disseminating new scholarly and technological work in computational linguistics.

The CCL conference began to organize technical evaluations in 2017 to provide Chinese language processing researchers with a platform to test related technologies, algorithms and systems. 19 evaluation tasks have been organized, involving morphology, syntax, semantics, pragmatics, modern Chinese and ancient Chinese and other multi-level Chinese language processing basic technologies and their applications in e-commerce, communications, justice and other fields, and open multiple public data There are thousands of participating teams.

This year the conference will continue to organize technical evaluations, and now sincerely solicit evaluation mission plans from scholars, research institutions and enterprises in related fields. The plan should describe in detail the task content, evaluation criteria, the preparation of the evaluation data and the general schedule, and send it to zhli13@suda.edu.cn by email. (Please refer to the evaluation task application template below)

Download CCL2022 Evaluation Task Application Template

  • Deadline for task collection:
    2022.05.10
  • Overall evaluation time (planned): 2022.06.01—2022.09.31
  • CCL 2022 Evaluation Seminar: 2022.10.14—2022.10.16

Evaluation tasks can include but are not limited to the following topics:

  • Basic tasks of natural language processing
    • Lexical and syntactic analysis
    • Semantic Analysis
    • Text and pragmatic analysis
    • Cross-language, small language natural language processing
  • Natural language processing applications
    • Knowledge Graph
    • Question answering and dialogue system
    • Reading comprehension
    • Text generation
    • Information retrieval, recommendation system and social media computing
    • Combined application of natural language processing and medical, education, humanities, justice and other fields

Evaluation Chairs:

Hongfei Lin, Dalian University of Technology

Zhenghua Li, Soochow University

2022.03.05