The CAP Babel Machine

Introduction

The CAP BABEL Project uses the Comparative Agendas Project policy codebook’s major topics to identify the policy areas of texts. In the near future, minor topic coding service will be also available.

The codes assigned are unequivocal, mutually exclusive, and cover all potential policy issues. The codebook distinguishes 21 major policy areas: macroeconomics, civil rights, health, agriculture, labour, education, environment, energy, immigration, transportation, law and crime, social welfare, housing, domestic commerce, defence, technology, foreign trade, international affairs, government operations, public lands and culture.

You can upload your datasets here for automated CAP-coding. If you wish to submit multiple datasets one after another, please wait 5-10 minutes between each of your submissions. There are two possibilities for upload: pre-coded datasets or non-coded datasets. The explanation of the form and the dataset requirement is available here.

The upload requires to fill the following form on metadata regarding the dataset. We kindly ask you to upload your dataset, and in case of a pre-coded dataset, if available, please attach the codebook used besides the dataset.

The non-coded datasets should contain an id and a text column. The column names must be in row 1. You are free to add supplementary variables to the dataset beyond the compulsory ones in the columns following them.

Pre-coded datasets must contain the following columns: id, year, major_topic, text. The column names must be in row 1. Uploading a pre-coded sample is optional, but it can help us with calculating performance metrics and fine-tuning the language model behind CAP Babel Machine. The detailed rules of validations are available here. The mandatory data format of major_topic is numeric. All textual CAP categories must be converted to the appropriate numeric code before uploading. Furthermore, records with no policy content should be coded with 999. You are free to add supplementary variables to the dataset beyond the compulsory ones in the columns following them. Automatic processing requires to follow these rules.

If the files you would like to upload are bigger than 100MB, please fill out everything else and send us the files on the following email address: poltextlab@poltextlab.com

Submit a dataset:

Name*

E-mail address*

Institution name*

Dataset name*

Dataset language* -- Please Choose One -- Assamese Azerbaijani Basque Belarusian Bengali Bengali Romanize Bosnian Breton Bulgarian Burmese Burmese zawgyi font Catalan Chinese (Simplified) Chinese (Traditional) Croatian Czech Danish Dutch English Esperanto Estonian Filipino Finnish French Galician Georgian German Greek Gujarati Hausa Hebrew Hindi Hindi Romanize Hungarian Icelandic Indonesian Irish Italian Japanese Javanese Kannada Kazakh Khmer Korean Kurdish (Kurmanji) Kyrgyz Lao Latin Latvian Lithuanian Macedonian Malagasy Malay Malayalam Marathi Mongolian Nepali Norwegian Oriya Oromo Pashto Persian Polish Portuguese Punjabi Romanian Russian Sanskrit Scottish Gaelic Serbian Sindhi Sinhala Slovak Slovenian Somali Spanish Sundanese Swahili Swedish Tamil Tamil Romanize Telugu Telugu Romanize Thai Turkish Ukrainian Urdu Urdu Romanize Uyghur Uzbek Vietnamese Welsh Western Frisian Xhosa Yiddish Other

Please specify:

Please note that the selected language is not supported and the prediction results might be less reliable.

Dataset type* -- Please Choose One -- Bill Law Court decision Parliamentary speech Executive speech Other speech Media Social media Budget Manifesto Other

Unit of observation* -- Please Choose One -- Quasi sentence Sentence Paragraph Full text Budget item

Period (from)*

Period (to)*

Level of dataset* -- Please Choose One -- Supranational/International State Substate

Geographical unit*

Use case* -- Please Choose One -- Research Commercial use Personal use Other

Please specify:

Description

• Dataset:
• Choose file

• Pre-coded dataset:
• Choose file

• Codebook:
• Choose file

I have read the instructions and rules.

By ticking the checkbox I declare that this data does not contain any personal data and I am responsible for the legitimacy of the origin of the data. The uploaded data is suitable for text mining and I voluntarily provided the uploaded file(s) to poltextLAB. I also grant permission to poltextLAB researchers to make the data visualisation of the data I uploaded publicly available. In addition, I agree that the uploaded data may be stored on servers within the European Union and be used for data analysis and training purposes without time limit.

Loading...