@hackage / dataframe-huggingface

Read Parquet datasets from HuggingFace into dataframes.

Latest1.0.0.0

About

Metadata

  • Last updated , by mchav
  • License MIT

  • Maintained by: mschavinda@gmail.com

  • Lottery factor: 1

Links

Installation

Tested Compilers

  1. 9.12.2
  2. 9.10.3
  3. 9.8.4
  4. 9.6.7
  5. 9.4.8

Readme

DataFrame.IO.HuggingFace — resolve and download Parquet files from HuggingFace (hf://) datasets and load them as DataFrames, eagerly or via the lazy/streaming engine. This is the home for the heavier aeson and http-conduit dependencies that network access requires, keeping dataframe-parquet and dataframe-lazy free of them.