file-collection

[![NPM version][npm-image]][npm-url]
[![build status][ci-image]][ci-url]
[![Test coverage][codecov-image]][codecov-url]
[![npm download][download-image]][download-url]

Library to manage large amount of files coming from different sources

Introduction

This library allows to manipulate a large amount of files coming from local or remote sources.

This library allows to have the same code in the browser and in nodejs.

This package allows to create a file-collection than can further be saved as a ium file (zip file containing all the data
and an index.json file).

The structure of the zip file is at follow:

- index.json
- data/
- all the files

Installation

npm i file-collection

Basic usage

$3

``js
import { FileCollection } from 'file-collection';

const fileList; // a fileList resulting from a drag / drop in the browser
const fileCollection = new FileCollection();
await fileCollection.appendFileList(fileList);

// get a zip file that can be reload later
const iumFile = fileCollection.toIum();

// list the content of the fileCollection
for (const file of fileCollection) {
console.log(file.name);
console.log(await file.text());
}
`

$3

`js
import { fromIum } from 'file-collection';

const fileCollection = await fromIum(iumFile);

for (const file of fileCollection) {
console.log(file.name);
console.log(await file.text());
}
`

Using in a react component

A webSource is a URL to data like for example https://image-js.github.io/image-dataset-demo/index.json:

`tsx
{}}>
`

Inside the component we should:

`js
const fileCollection = new FileCollection();
if (webSource) fileCollection.appendWebSource(webSource);
`

If we drag / drop some files we should:

`js
fileCollection.appendFileList(fileList);
`

If we drag / drop a 'ium' file we should replace the full fileCollection

`js
const fileCollection = FileCollection.fromIum(iumArrayBuffer);
const state = fileCollection.get('state');
`

If we want to save as a ium file:

`js
fileCollection.set('state', myCurrentState);
const toSave = fileCollection.toIum();
`

When fileCollection changes we can always retrieve the various files using:

`js
const files = [...fileCollection]; // fileCollection is iterable on its files property
`

Referencing files in the fileCollection

Internals - sources versus files

In an instance of FileCollection we have 2 properties:

- sources: an array containing the different data sources
- files: an array containing all the files contained in the different sources

Some source may contain many files. This is the case of the .iumfiles as well as for the .zip` file.

License

MIT

[npm-image]: https://img.shields.io/npm/v/file-collection.svg
[npm-url]: https://www.npmjs.com/package/file-collection
[ci-image]: https://github.com/cheminfo/file-collection/workflows/Node.js%20CI/badge.svg?branch=main
[ci-url]: https://github.com/cheminfo/file-collection/actions?query=workflow%3A%22Node.js+CI%22
[codecov-image]: https://img.shields.io/codecov/c/github/cheminfo/file-collection.svg
[codecov-url]: https://codecov.io/gh/cheminfo/file-collection
[download-image]: https://img.shields.io/npm/dm/file-collection.svg
[download-url]: https://www.npmjs.com/package/file-collection