<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>Comparable corpora are the right resources for extracting parallel data due to their abundant availability. It is of great importance where parallel data are scarce. In this study, the focus is placed on building of parallel data for Punjabi and English language pair. The raw data were collected from web contents of “Mann Ki Baat”, which is a collection of textual speeches of Prime Minister of India Mr. Narendra Modi broadcasted every last Sunday of the month. Data were cleaned and pre-processed using a natural language toolkit. An alignment model using BERT was built that aligned two textual files on a sentence level. Furthermore, extraction of noun forms with the help of NLTK library in Python programming was performed. The noun aligned dataset was built for English-Punjabi language pair and made available at Mendeley data repository.</p>
</abstract>

Comparable corpora are the right resources for extracting parallel data due to their abundant availability. It is of great importance where parallel data are scarce. In this study, the focus is placed on building of parallel data for Punjabi and English language pair. The raw data were collected from web contents of “Mann Ki Baat”, which is a collection of textual speeches of Prime Minister of India Mr. Narendra Modi broadcasted every last Sunday of the month. Data were cleaned and pre-processed using a natural language toolkit. An alignment model using BERT was built that aligned two textual files on a sentence level. Furthermore, extraction of noun forms with the help of NLTK library in Python programming was performed. The noun aligned dataset was built for English-Punjabi language pair and made available at Mendeley data repository.

Building English – Punjabi Aligned Parallel Corpora of Nouns from Comparable Corpora

Department of Computer Science and Technology

Applied Computer Systems

This work is licensed under the Creative Commons Attribution 4.0 International License.

Comparable corpora are the right resources for extracting parallel data due to their abundant availability. It is of great importance where parallel data are...

Building English – Punjabi Aligned Parallel Corpora of Nouns from Comparable Corpora

Publié en ligne: 29 janv. 2024

Pages: 245 - 251

DOI: https://doi.org/10.2478/acss-2023-0024

Mots clés
Aligned corpora, comparable corpora, English-Punjabi, parallel corpora

© 2023 Dilshad Kaur et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Building English – Punjabi Aligned Parallel Corpora of Nouns from Comparable Corpora

Publié en ligne: 29 janv. 2024

Pages: 245 - 251

DOI: https://doi.org/10.2478/acss-2023-0024

Mots clésAligned corpora, comparable corpora, English-Punjabi, parallel corpora

© 2023 Dilshad Kaur et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Mots clés
Aligned corpora, comparable corpora, English-Punjabi, parallel corpora