conmo.datasets.dataset.Dataset

class conmo.datasets.dataset.Dataset(name: str)[source]

Abstract base class for a Dataset.

This class is an abstract class from which other subclasses inherit and must not be instanciated directly.

__init__(name: str) → None[source]

Main constructor of the class.

Parameters

name (str) – The name given to the dataset.

abstract dataset_files() → Iterable[source]

Iterable of files included in the dataset.

abstract fetch(out_dir: str) → None[source]

Fetch data to feed the pipeline.

Parameters

out_dir (str) – Directory where the dataset will be stored.

is_dataset_ready() → bool[source]

Check if dataset has been already loaded/downloaded and parsed to package format.

show_start_message() → None[source]

Show starting step info message.

Methods

`__init__`(name)	Main constructor of the class.
`dataset_files`()	Iterable of files included in the dataset.
`fetch`(out_dir)	Fetch data to feed the pipeline.
`is_dataset_ready`()	Check if dataset has been already loaded/downloaded and parsed to package format.
`show_start_message`()	Show starting step info message.