- Reorganized files (generated by the _data:reorganize_data_ command) are also available in Tricoteuses / Data / Données brutes de l'Assemblée. They are updated on a regular basis.
- Split & cleaned files (generated by the _data:clean_data_ command) are also available in Tricoteuses / Data / Données nettoyées de l'Assemblée with the _nettoye suffix. They are updated on a regular basis.

$3

Downloading and cleaning all the data is long and takes up a lot of disk space. It is possible to choose the type of data that you want to retrieve to reduce the load.

Examples:

`bash


Only download amendments

- --categories or -k : Filter by dataset categories (Available options : ActeursEtOrganes, Agendas, Amendements, DossiersLegislatifs, Photos, Scrutins, Questions, ComptesRendusSeances)

- --legislature or -l : Specify one or more legislatures to process (e.g., -l 15 -l 16)
- --dataDir (Mandatory): Path to the working directory where all data is stored (required)
- --silent or -s: Disable logging
- --verbose or -v: Enable verbose logging
- --fetch or -f: Force re-download of data even if already present
- --commit or -c: Automatically commit cleaned data
- --pull or -p: Pull repositories before starting
- --clone or -C : Clone Git repositories from a remote group or organization
- --remote or -r : Push commits to specified Git remote(s)
- --keepDir: Keep Dir (Implement before cleaning data)
- --only-recent (number): If files are already present, skip files that are above the specified number of days and skip old legislatures (e.g. -only-recent 30)

If you use such options, use them in all subsequent commands too (_data:regorganize_data_ and _data:clean_data_).

$3

- --dataset or -d : Clean a specific dataset only
- --no-reset-after-commit: Skip Git reset after committing (useful to preserve local changes)
- --no-validate or -V: Skip schema validation during cleaning
- --fetchDocuments : Specify to retrieve documents
- --parseDocuments: Specify to parse documents into cleaned json
- --fetchVideos: Retrieve videos

$3

- --full or -f: Retrieve all documents, even those already downloaded
- --document-type or -T : Restrict to specific document types (e.g., PION)

Download using Docker

A Docker image that downloads and cleans the data all at once is available. Build it locally or run it from the container registry.
Use the environment variables LEGISLATURE and CATEGORIES if needed.

`bash
docker run --pull always --name tricoteuses-assemblee -v ../assemblee-data:/app/assemblee-data -e LEGISLATURE=17 -d git.tricoteuses.fr/logiciels/tricoteuses-assemblee:latest
`

Using the data

Once the data is downloaded and cleaned, you can use loaders to retrieve it.
To use loaders in your project, you can install the _@tricoteuses/assemblee_ package, and import the iterator functions that you need.

`bash
npm install @tricoteuses/assemblee
`

`js
import {
iterLoadAssembleeActeurs,
iterLoadAssembleeOrganes,
iterLoadAssembleeReunions,
iterLoadAssembleeScrutins,
iterLoadAssembleeDocuments,
iterLoadAssembleeDossiersParlementaires,
iterLoadAssembleeAmendements,
iterLoadAssembleeQuestions,
iterLoadAssembleeComptesRendus,
} from "@tricoteuses/assemblee/loaders"

// Pass data directory and legislature as arguments
for (const { acteur } of iterLoadAssembleeActeurs("../assemblee-data", 17)) {
console.log(acteur.uid)
}
``

Generating schemas and documentation (for contributors only)

View instructions here