Skip to content

Data Loading for CSV and Excel files #1

@NilsHMeier

Description

@NilsHMeier

The framework needs to provide a simple to use method, that automatically loads the data from a given path, independantly of the type of file and the encoding. Therefore a function module is needed with the following methods:

  • load_file(path: Union[str, Path], *kwargs) >> Top-Level Method used by the user to load any kind of file
  • load_csv_like_file >> Method to automatically load CSV or TXT files with comma separated fields
  • load_excel_file >> Method to automatically load an EXCEL file

The method to load CSV files needs to be able to use the correct encoding, separator and decimal. If required, all columns need to be casted into the correct data type.

The method to load EXCEL files needs to be able to load files with different engines.

Dependencies
Sample Datasets.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions