Linguistic Data Consortium

Linguistic Data Consortium
Founded1992; 34 years ago (1992)
Headquarters
Philadelphia, Pennsylvania
,
United States
Websitewww.ldc.upenn.edu

The Linguistic Data Consortium is an open consortium of universities, companies and government research laboratories. It creates, collects and distributes speech and text databases, lexicons, and other resources for linguistics research and development purposes. The University of Pennsylvania is the LDC's host institution. The LDC was founded in 1992 with a grant from the US Defense Advanced Research Projects Agency (DARPA), and is partly supported by grant IRI-9528587 from the Information and Intelligent Systems division of the National Science Foundation.[1][2] The director of LDC is Mark Liberman.[3] It subsumed the previous ACL Data Collection Initiative.

Part of the motivation was to support the benchmark-oriented methodology of DARPA's Human Language Technology program. Previously, John R. Pierce directed the committee that produced the ALPAC report (1966), which caused a severe decrease in funding for linguistic AI for about 10 years. Later, Charles Wayne restarted funding in speech and language in the mid-1980s. In order to avoid the criticisms from the ALPAC report, they needed a way to demonstrate objective progress, which led to the benchmark-oriented methodology. DARPA would propose specific quantifiable and testable score targets on benchmarks, and teams being funded would attempt to reach the score targets.[4][5]

It was noted that by 1993, the data needed for training and benchmarking the models was big enough that "Not even the largest companies can easily afford enough of [the needed] data... Researchers at smaller companies and in universities risk being frozen out of the process almost entirely."[6] The LDC provided a central location for creating and dispensing such data. There is a membership fee that has been increased once since its founding.[4]

See also

References

  1. ^ "About LDC". Linguistic Data Consortium. Retrieved June 18, 2024.
  2. ^ "NSF Award Search: Award # 9528587 - HLR: Improved Speech and Text Data Resources". www.nsf.gov. Retrieved 2025-03-27.
  3. ^ "Staff". Linguistic Data Consortium. Retrieved June 18, 2024.
  4. ^ a b Cieri, Christopher; Liberman, Mark; Cho, Sunghye; Strassel, Stephanie; Fiumara, James; Wright, Jonathan (June 2022). Calzolari, Nicoletta; Béchet, Frédéric; Blache, Philippe; Choukri, Khalid; Cieri, Christopher; Declerck, Thierry; Goggi, Sara; Isahara, Hitoshi; Maegaard, Bente (eds.). "Reflections on 30 Years of Language Resource Development and Sharing". Proceedings of the Thirteenth Language Resources and Evaluation Conference. Marseille, France: European Language Resources Association: 543–550.
  5. ^ Liberman, Mark; Wayne, Charles (June 2020). "Human Language Technology". AI Magazine. 41 (2): 22–35. doi:10.1609/aimag.v41i2.5297. ISSN 0738-4602.
  6. ^ Liberman, M. and Godfrey, J. (1993). The Linguistic Data Consortium. In Chen, Keh-Jiann, Chu-Ren Huang, Proc. ROCLing Computational Linguistics Conference VI, Nantou, Taiwan, September. Association for Computational Linguistics and Chinese Language Processing (ACLCLP).

Content Disclaimer

Informasi ini disarikan dari Wikipedia dan disajikan kembali untuk tujuan edukasi. Konten tersedia di bawah lisensi CC BY-SA 3.0. Kami tidak bertanggung jawab atas ketidakakuratan data yang bersumber dari kontribusi publik tersebut.

  1. The information displayed on this website is sourced in part or in whole from Wikipedia and has been adapted for the purpose of restating it. We strive to provide accurate and relevant information, however:
  2. There is no guarantee of absolute accuracy. Wikipedia is an open, collaborative project that can be edited by anyone, so information is subject to change.
  3. It is not intended to constitute professional advice. The content displayed is for informational and educational purposes only. For important decisions (e.g., medical, legal, or financial), please consult a professional.
  4. Content copyright. Wikipedia is licensed under the Creative Commons Attribution-ShareAlike License (CC BY-SA). This means that content may be reused with appropriate attribution and shared under a similar license.
  5. Responsible use. Any risk arising from the use of information from this website is entirely the responsibility of the user.