🔥 Book Metadata Tool ⚒️

Go to file Use this template

Titivillus cecc6b4fd2 Analizer is now a subcommand; fixed make lint; added first test		2023-12-08 21:41:43 +00:00
colligere	Analizer is now a subcommand; fixed make lint; added first test	2023-12-08 21:41:43 +00:00
tests	Analizer is now a subcommand; fixed make lint; added first test	2023-12-08 21:41:43 +00:00
.gitignore	Setupt for Python Packaging	2023-12-06 21:29:40 +00:00
LICENSE	Setupt for Python Packaging	2023-12-06 21:29:40 +00:00
Makefile	Analizer is now a subcommand; fixed make lint; added first test	2023-12-08 21:41:43 +00:00
README.md	Analizer is now a subcommand; fixed make lint; added first test	2023-12-08 21:41:43 +00:00
pyproject.toml	Setupt for Python Packaging	2023-12-06 21:29:40 +00:00
requirements.txt	Setupt for Python Packaging	2023-12-06 21:29:40 +00:00

README.md

🔥 Book Metadata Tool ⚒️

Herramienta para metadatos en JSON Lines

Tool for metadata in JSON Lines

Uso / Usage

Analizer

$ python colligere/analizer.py metadata.jsonl

[0:00:00][0%][6i][57k] Fragmina verborum Titivillus colligit horum
┌────────────────────────────────────────────────────────────┐
│                        ▄▄▄▄▄▄▄▄▄▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀│
│          ▗▞▀▀▀▀▀▀▀▀▀▀▀▀▘                                   │
│         ▗▘                                                 │ 50k
│        ▞▘                                                  │
│      ▗▞                                                    │
│     ▗▘                                                     │ 40k
│    ▞▘                                                      │
│  ▗▞                                                        │
│ ▗▘                                                         │ 30k
│▞▘                                                          │
└────────────────────────────────────────────────────────────┘
1i          2i          3i         4i          5i          6i

$ python colligere/analizer.py -h

usage: Analizer [-h] [-i SAMPLE_LEN] [-k KEY] [-ky KEY] [-d DIR] [--debug] [-q] jsonl

Analize keys and values from JSON lines.

positional arguments:
  jsonl                 JSON lines file

options:
  -h, --help            show this help message and exit
  -i SAMPLE_LEN, --items SAMPLE_LEN
                        random sample items size; 1000 by default
  -k KEY, --key KEY     key value to analize
  -ky KEY, --key-axis KEY
                        like -k, but its values are used for y-axis
  -d DIR, --directory DIR
                        CSV output directory; CWD by default
  --debug               stop on exception for debugging
  -q, --quiet           avoid prints; ignored by --debug

$ python colligere/analizer.py -k metadata.record.catalogingLanguage metadata.jsonl

⏳🍺💃🕺🎉⏳

$ cat res.metadata.record.catalogingLanguage.csv | head
key,len,freq
eng,664,0.35622
und,99,0.05311
fre,90,0.04828
spa,65,0.03487
ger,133,0.07135
ara,10,0.00536
zxx,23,0.01234
heb,6,0.00322
jpn,20,0.01073

Desarrollo / Development

Configuración inicial / Initial setup:

virtualenv .venv
source .venv/bin/activate
pip install -r requirements.txt

Pruebas / Tests:

make test

Análisis y formateador / Lint:

make lint

Empaquetamiento / Packaging:

make package