Azerbaijani News Summary Dataset Card

Dataset Summary

I present az-news-summary, a comprehensive and diverse dataset comprising 143k (143,448) Azerbaijani news articles extracted using a set of carefully designed heuristics. The dataset covers common topics for news reports include war, government, politics, education, health, the environment, economy, business, fashion, entertainment, and sport, as well as quirky or unusual events.

The dataset is prepared for Abstractive/Extractive summarization tasks. It can also be used in other scopes like Text Generation, Title Generation and etc.

Dataset Structure

One example from the dataset is given below in JSON format.

{'id': 33885080,

 'title': 'İsmayıllı silkələndi - Zəlzələ',

 'summary': 'Avqustun 11-də İsmayıllı rayonu ərazisində zəlzələ baş verib',

 'text': 'Azərbaycan milli elmlər akademiyası nəzdində respublika seysmoloji
          xidmət mərkəzindən  bildirilib ki, ilkin məlumatlara əsasən yeraltı təkanlar
          yerli vaxtla saat 23:03:11-də pirquludan 11 kilometr qərbdə i̇smayıllı ərazisində
          qeydə alınıb.ocağı 9 kilometr dərinlikdə yerləşən zəlzələ episentrdə 4 bal,
          ətraf rayonlarda isə 3 bala qədər hiss olunub.'}

Data Fields

• id: ID of the news.
• title: The title of the news.
• summary: The summary of the news.
• text: The body of the news.

Data Splits

This dataset has 3 splits: train, validation, and test.
Token counts are white space based.

Usage

Usage is easy and takes only a few minutes. Firstly, you need to use install datasets library as follows:

!pip install datasets

To load the dataset from the library, you need to pass the file name on the load_dataset() function. In this case:

from datasets import load_dataset
dataset = load_dataset("nijatzeynalov/azerbaijani-multi-news")

Dataset Curator

This dataset was curated by Nijat Zeynalov

Citation Information

@misc {nijatzeynalov_2023,
	author       = { {NijatZeynalov} },
	title        = { azerbaijani-multi-news (Revision 2afa300) },
	year         = 2023,
	url          = { https://huggingface.co/datasets/nijatzeynalov/azerbaijani-multi-news },
	doi          = { 10.57967/hf/0312 },
	publisher    = { Hugging Face }
}