local-sandbox/dnd-beyond-scrape

Go to file

bel f878486d80 update to meili for new scrape format

2022-07-03 21:18:20 -06:00

.gitignore

gitinreo

2022-06-26 16:16:02 -06:00

deps.txt

cush

2022-06-26 23:22:24 -06:00

meilisearch.sh

meili scripting

2021-12-15 15:35:30 -07:00

README.md

readme

2022-06-27 19:06:43 -06:00

scrape.sh

rm logs

2022-06-27 19:25:17 -06:00

to_meili.sh

update to meili for new scrape format

2022-07-03 21:18:20 -06:00

url.txt

poc

2021-12-14 21:45:55 -07:00

README.md

dnd beyond scrape

run SEED=123 bash scrape.sh
see cached files, cookie, output in $TMPDIR/scrape.$SEED
may have to replace Cookie: in scrape.sh if expired

Todo

fix tables to pre-formatted
download and localize images (webp!)