Issue #6 | July 2023
Content
- Language Resources
- Legal Issues
- ELRA/ELDA Projects
- Evaluation Campaigns
- Dissemination
Language Resources
LRs @ELRA
LRs in the ELRA Catalogue this month
Since April 2023, 1 new written corpus, 66 new monolingual lexicons and 1 new speech corpus are now available in our catalogue. Moreover, 4 speech resources are now available at reduced fees.
1. New Language Resources
Written Corpus
Archives of "El Mundo" Newspaper – Years 2020-2022
ISLRN: 124-545-396-179-3
This corpus consists of 45,658 articles in Spanish from electronic archives of "El Mundo" Newspaper between 2020 and 2022. A few articles also come from publications from other related media: El Mundo Alicante, El Mundo Andalucía, El Mundo Baleares, El Mundo Catalunya, El Mundo Valéncia et Expansión. The number of articles available per year is as follows:
Total: 45,658 articles
All articles are provided in text format, including HTML tags. This data is released thanks to Unidad Editorial Información General, S.L.U., Spain.
This corpus may be also obtained as separate years as follows:
Monolingual Lexicons
Bitext Lexical Datasets
The series of Bitext Lexical Datasets for the generic vocabulary includes Lemmas, POS tagging, Frequency, Named Entities and Offensive features. Depending on the dataset and language, other syntactic and morphological features are also provided. The following 15 languages are available.
As a complement to the datasets mentioned above, 11 datasets of Language Variants can also be obtained:
Bitext Synthetic Data
The Bitext Synthetic Data consist of pre-built training data for intent detection and are provided for 20 verticals for English and Spanish languages. They cover the most common intents for each vertical and include a large number of example utterances for each intent, with optional entity/slot annotations for each utterance. Data is distributed as models or open text files.
For each language, the following verticals are available:
Speech Corpus
Persian Kids’ Speech Corpus
ISLRN: 822-550-731-416-7
The Persian Kids’ Speech Corpus consists of speech signals recorded by 286 children (141 girls, 145 boys), from 6 to 9 years old, through an Andreas Mic Anti-Noise microphone and a Premium Speechmike headphone. This recorded data was manually checked and labeled. Finally, a corpus containing 162,395 samples with a duration of 33 hours and 44 minutes was created. The samples are distributed as follows:
The prepared speech corpus comprehensively contains all the 29 Persian phonemes, 118 syllables, 56 sub-words, and 711 words and is particularly applicable to speech recognition and linguistics studies.
2. Reduced fees for the following speech resources
ISLRN submissions
The International Standard Language Resource Number (ISLRN) provides Language Resources (LRs) with unique identifiers using a standardised nomenclature. This aims to ensure that LRs are correctly identified, and consequently, recognised with proper references for their usage in applications in R&D projects, products evaluation and benchmark as well as in documents and scientific papers.
Latest figures
The latest LRs for which an ISLRN number was requested and accepted are as follows:
More about ISLRN.
Legal Issues
ELRA Legal Issues Publications
The Committee version of the AI Act has been approved by the European Parliament
On May 11, 2023, the European Parliament’s Internal Market and Civil Liberties Committees voted to approve a new version of the upcoming AI Act which will now enter in its trilogue phase with the European Commission and European Council.
In this amended version, Members of the European Parliament included new transparency requirements for foundation models such as GPT to enhance guarantees on fundamental rights.
The press release is available on the website of the European Parliament and the voted text is available here.
US Secretary of Commerce claims United States' compliance with the EU-US Data Privacy Framework
On July 3, 2023, the Secretary of Commerce issued a statement claiming that the United States fulfilled its commitment for the implementation of the EU-US Data Privacy Framework that was negotiated following the Schrems II landmark case ruled by the Court of Justice of the European Union (CJEU).
This comes in addition with the designation made by the Attorney General to designate the European Union and countries of the European Economic Area as ‘qualifying states’ for the implementation of the redress mechanism established in the EU-US Data Privacy framework.
The full statement is available here.
The European Commission adopts the EU-US Data Privacy Framework
On July 10, 2023, the European Commission announced that it had adopted the new EU-US Data Privacy Framework. Following the ruling by the Court of Justice of the European Union who repealed the former Privacy Shield this framework aims to regulate data transfers from the European Union to the United States.
By this decision, the European Commission approves the changes made by the US administrations to ensure an adequate level of protection for data of European citizens.
The press release is available here and the full adequation decision is available here.
Meta fails to reject claims of GDPR compliance brought by Competition authorities
On July 4, 2023, the Court of Justice of the European Union (CJEU) found that a Competition authority, here the German competition authority could take into consideration claims of infringement of the GDPR while examining a claim of abuse of dominant position.
In this case, the Court found that the competition authority lawfully examined this infringement only as it allowed to establish an abuse of dominant position and that while doing so they must cooperate with national supervisory authorities.
Full text of the decision available here and press release following the decision here.
Stanford Researchers’ Review of Foundation Models with the Draft AI Act
Stanford researchers published a review on the compliance of the different foundation model providers, such as ChatGPT, with the proposed AI Act.
Their study presents a graduation assessment of the conduct of the AI models providers with respect to the current legal requirements.
A summary of their research and graduation assessment is available here.
Event Reviews
DG Connect University on LLMs
On June 6, 2023, the DG CONNECT of the European Commission and the Language Data Space initiative jointly organised a University course and workshop on the subject of Large Language Models (LLMs). The workshop was entitled Large Language Models: Overview, Limitations and Opportunities.
This event featured several talks on various topics linked to LLMs: technical and legal aspects, ethical aspects and biases, challenges. The LLMs capacity, limitations and evaluation were also addressed.
The list of presentations and slides are available here and a recording of the event is also available on YouTube.
AI, Regulation and Decision Making Workshop
On June 27, 2023, PRAIRIE (Paris Artificial Intelligence Research Institute) held a workshop on Artificial Intelligence, Regulation and Decision Making.
This workshop featured 3 different presentations on the topic.
The first one was given by Dr. Anita Burgun and focused on the use of Artificial intelligence applications in the medical field and the potential harmful consequences. She gave out examples such as a chatbot used for nutrition advice that was unable to detect eating disorders, or the use of MRI images to detect suicidal ideation.
To face such progress, she proposed a framework where the medical doctors and medical professionals would stay in the loop to help in the development of the applications. She also presented the notion of “Augmented Intelligence” where the use of an application based on artificial intelligence would only assist to help the doctors make their decisions.
The second talk was given by Franziska Poszler on the impact of decision support systems in human ethical decision making. In her talk, she presented a literature review of the different decision support systems and showed such taxonomy of those decision support systems. She also presented the challenges of how human ethical decision making can be influenced by relying too much on decision support systems.
The final talk by Thierry Poibeau provided some insights on the notion of bias and representation in artificial intelligence. He gave out some proposals to address this issue such as providing data statements to document the gaps in data and clearly identify the population not represented in the data. Other proposals included providing statements to define the target use of the applications and debiasing the data.
JSALT 2023 - Workshop on data collection and annotation
On June 29, 2023, ELDA participated in the workshop organised by the University of Le Mans in the course of the JSALT Summer School. During this event, two presentations were given by ELDA. The workshop was entitled “Special Day on Data Collection and Annotation”.
The first one, given by Dr Victoria Arranz, described the activities led by ELDA in the production and annotation of datasets as well as its participation in European data sharing infrastructures.
The second one, given by Mickaël Rigault, focused on legal challenges of data production and distribution and touched upon topics of Intellectual property, Protection of personal data and a review of the current legal cases surrounding the use of large language models.
ELRA/ELDA Projects
Information on the on-going projects
Common European Language Data Space (LDS)
The Common European Language Data Space (LDS) project was launched on January 19, 2023. This 3-year project aims at establishing a European platform and marketplace for the collection, creation, sharing and re-use of multilingual and multimodal language data.
The service contract has been established between the European Commission and a consortium with the four following partners who were distributed the tasks as follows:
German Research Center for Artificial intelligence (DFKI), coordinator
Evaluations and Language Resources Distribution Agency (ELDA)
Athena Research and Innovation Center in Information, Communication and Knowledge Technologies (ILSP)
SIA Tilde
In this regard, ELDA has continued the work planned within the different tasks:Development of a Multi-Stakeholder Data and Services Governance Scheme The main objective of this task is to design a governance scheme for the development of a European Multi-Stakeholder Data and Services infrastructure. A collaboration has been established with other Data Spaces as well as with the Data Spaces Support Centre (DSSC) to ensure a large inter-Data Spaces synergy on the identification of governance schemes used by others. ELDA is participating actively in the DSSC's expert group meetings and focusing on the reviewing of the different governance schemes.
Event Organisation and Management
A large number of dedicated workshops and conferences are planned to take place throughout the LDS initiative. Two workshops have already been held:
Data Protection Compliance
This task aims to ensure Data Protection Compliance, with a particular focus on EUDPR and/or GDPR. ELDA has defined a Data Protection Concept (DPC), which is a document describing all personal data processing activities inherent to the Language Data Space (LDS) or enabled by the LDS. It will serve as reference documentation for the project’s compliance with GDPR and EUDPR rules. Version 1.0 of the DPC was submitted to the European Commission on March 31, 2023, and further work has followed towards an updated version of the document This will continue to evolve alongside with the development and deployment of the LDS infrastructure.
For more information you can visit the LDS website here and/or you can also subscribe to the @LangDataSpace Twitter account.
Language Technology Solutions - CNECT/LUX/2022/OP/0030
This call for tenders from the European Commission was published within the Digital Europe programme (DIGITAL). It aims to achieve three specific goals:
ELRA, through its operational body ELDA, is involved in two of the funded projects which are described below.
LOT 1 - Solutions Supporting the Use of Automated Translations on Websites
The European Multilingual Web (EMW) project is entering its second semester of activities (it started on December 12, 2022). Its main goal is to set up a set of ready-to-use open-source websites automated translations solutions.
In this framework, ELDA will be in charge of managing the Helpdesk team that will support users to report issues and ask questions about the solutions. This activity is foreseen to start in October 2023 . In June, ELDA carried out an analysis of the helpdesk technical solution that will need to be implemented to allow the smooth management of the task. This implies the use of a dedicated email address to be managed through a ticketing system. To enable the selection of the appropriate ticketing system, a detailed analysis of pre-selected tools was submitted to the EC, taking in particular GDPR issues into consideration, as well as a number of expected features that will be necessary for an optimal exploitation of the tool.
LOT 2 – Language Technologies Solutions
The project was officially launched on December 13, 2022.
The consortium operating in this project is coordinated by Brno University of Technology (BUT) with the participation of TILDE and ELDA. Three main tasks are being performed with the participation of all members of the consortium, which are:
Task 1: A comprehensive market study of the Automatic Speaker Recognition (ASR) solutions. This includes an overview of the main actors and techniques of the domain as well as the availability of speech and related transcription data for ASR. This task is mainly carried out by ELDA. In March 2023, a first draft of the study was submitted to the European Commission (EC). Since the validation of this study, ELDA and TILDE are collecting interviews with ASR market actors and experts. These interviews represent a new phase of the market study that will result in an updated document to be submitted to the European Commission in December 2023.
Task 2: Creation of an open-source speech recognition prototype solution for three under-represented European languages (Czech, Estonian, and Greek). This task is mainly carried out by BUT and TILDE, with ELDA holding an advisory position. As for Task 1, the European Commission has accepted a document describing the solution’s architecture and key features. An alpha version is undergoing development and test phases are planned using both data from open sources and Task 3.
Task 3: Collection and partial transcription (one third) of speech data for the three above-mentioned European under-resourced languages. A total of 4,500 hours will be packaged per language under the responsibility and coordination of ELDA. The data will be used to train the solution developed in Task 2 as well as to constitute three corpora that will be delivered to the European Commission. In March 2023, a first legal analysis was sent to the EC which has since then provided the expected right assessments to include in the final delivery. Both data collection and negotiation with data providers have started. Following the first data collection, the use of a partially automatic transcription step has been studied, with revision being carried out by native speakers of each language. The objective for this approach is to optimise the full transcription of the first 1,500 hours and make it faster with the testing phase of the solution developed in Task 2.
Evaluation Campaigns
Current campaigns
Dissemination
News from ELRA
LREC-COLING 2024
First Call for Papers
Lingotto Conference Centre in Turin (Italy)
20-25 May, 2024
Two international key players in the area of computational linguistics, the ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL), are joining forces to organize the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) to be held in Torino, Italy on 20-25 May, 2024.
IMPORTANT DATES
(All deadlines are 11:59PM UTC-12:00 (“anywhere on Earth”)
Twitter: @LrecColing2024
Language Resources and Evaluation Journal
Language Resources and Evaluation is the first publication devoted to the acquisition, creation, annotation, and use of language resources, together with methods for evaluation of resources, technologies, and applications.
Volume 57 - Issue 2, June 2023
Regular issue including a number of papers in Open Access (493-944)
News from the community
CNRS Data Management Guide of good practices for research data
The CNRS and the Data Lab are making available a guide of good practices for research data on its website.
These guide aim to facilitate the management and production of research data and elaborates on the challenges of data management in open science contexts throughout the data lifecycle such as:
The guide provides concrete examples and solutions on how to tackle the different challenges of data management in research and provide valuable resources and knowledge for all research projects.
The full book (in French only) is available here.
The Board of ELRA and the ELDA team express their deep sadness at the sudden passing of Thierry Declerck on June 27, 2023 while he was attending the eLex 2023 Conference in Brno. Thierry was a consultant at DFKI and lecturer at the Language Science and Technology Department of Saarland University. He has been involved in numerous European projects and initiatives. He was also taking an active part in several scientific communities and associations including CLARIN, and EURALEX, where many praise his commitment, dedication and generosity.
From 2012 on, Thierry has joined the ELRA Board as a Board member and the LREC Programme committee, and he has held the position of Vice-President from 2016 to 2018.
For all of us, he was a great colleague, bright and witty, for some, he was a long standing friend who will be dearly missed. Our thoughts and condolences go to his family and his friends.