2023-10-21 09:36:56 -06:00
|
|
|
# π₯ Book Metadata Tool βοΈ
|
|
|
|
|
2023-12-08 15:41:43 -06:00
|
|
|
Herramienta para metadatos en [JSON Lines]
|
2023-10-21 09:36:56 -06:00
|
|
|
|
2023-12-08 15:41:43 -06:00
|
|
|
Tool for metadata in [JSON Lines]
|
2023-10-21 09:36:56 -06:00
|
|
|
|
|
|
|
# Uso / Usage
|
|
|
|
|
2023-12-13 18:12:30 -06:00
|
|
|
## Analiza / Analize
|
2023-10-21 09:36:56 -06:00
|
|
|
|
2023-12-13 18:12:30 -06:00
|
|
|
Analiza llaves y valores de JSON lines.
|
|
|
|
|
|
|
|
Analize keys and values from JSON lines.
|
|
|
|
|
|
|
|
$ colligere analize metadata.jsonl
|
2023-12-08 15:41:43 -06:00
|
|
|
|
|
|
|
[0:00:00][0%][6i][57k] Fragmina verborum Titivillus colligit horum
|
|
|
|
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
|
|
|
β βββββββββββββββββββββββββββββββββββββ
|
|
|
|
β βββββββββββββββ β
|
|
|
|
β ββ β 50k
|
|
|
|
β ββ β
|
|
|
|
β ββ β
|
|
|
|
β ββ β 40k
|
|
|
|
β ββ β
|
|
|
|
β ββ β
|
|
|
|
β ββ β 30k
|
|
|
|
βββ β
|
|
|
|
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
|
|
|
1i 2i 3i 4i 5i 6i
|
|
|
|
|
2023-12-13 18:12:30 -06:00
|
|
|
$ colligere analize -k metadata.record.catalogingLanguage metadata.jsonl
|
2023-12-08 15:41:43 -06:00
|
|
|
|
|
|
|
β³πΊππΊπβ³
|
|
|
|
|
|
|
|
$ cat res.metadata.record.catalogingLanguage.csv | head
|
|
|
|
key,len,freq
|
|
|
|
eng,664,0.35622
|
|
|
|
und,99,0.05311
|
|
|
|
fre,90,0.04828
|
|
|
|
spa,65,0.03487
|
|
|
|
ger,133,0.07135
|
|
|
|
ara,10,0.00536
|
|
|
|
zxx,23,0.01234
|
|
|
|
heb,6,0.00322
|
|
|
|
jpn,20,0.01073
|
2023-12-06 15:29:40 -06:00
|
|
|
|
|
|
|
# Desarrollo / Development
|
|
|
|
|
|
|
|
ConfiguraciΓ³n inicial / Initial setup:
|
|
|
|
|
2023-12-08 15:41:43 -06:00
|
|
|
virtualenv .venv
|
|
|
|
source .venv/bin/activate
|
|
|
|
pip install -r requirements.txt
|
2023-12-06 15:29:40 -06:00
|
|
|
|
|
|
|
Pruebas / Tests:
|
|
|
|
|
2023-12-08 15:41:43 -06:00
|
|
|
make test
|
2023-12-06 15:29:40 -06:00
|
|
|
|
|
|
|
AnΓ‘lisis y formateador / Lint:
|
|
|
|
|
2023-12-08 15:41:43 -06:00
|
|
|
make lint
|
2023-12-06 15:29:40 -06:00
|
|
|
|
|
|
|
Empaquetamiento / Packaging:
|
|
|
|
|
2023-12-08 15:41:43 -06:00
|
|
|
make package
|
2023-12-06 15:29:40 -06:00
|
|
|
|
2023-12-08 15:41:43 -06:00
|
|
|
[JSON Lines]: https://jsonlines.org/
|