local-sandbox/dnd-beyond-scrape
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
26 Commits 1 Branch 1 Tag
7c06268f8e4f9c614d65870bea72f9eee1ef048e
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
bel 7c06268f8e readme
2022-06-27 19:06:43 -06:00
.gitignore
gitinreo
2022-06-26 16:16:02 -06:00
deps.txt
cush
2022-06-26 23:22:24 -06:00
meilisearch.sh
meili scripting
2021-12-15 15:35:30 -07:00
README.md
readme
2022-06-27 19:06:43 -06:00
scrape.sh
readme
2022-06-27 19:06:43 -06:00
to_meili.sh
meili_queue helpful
2021-12-15 16:07:01 -07:00
url.txt
poc
2021-12-14 21:45:55 -07:00

README.md

dnd beyond scrape

  • run SEED=123 bash scrape.sh
  • see cached files, cookie, output in $TMPDIR/scrape.$SEED
  • may have to replace Cookie: in scrape.sh if expired

Todo

  • fix tables to pre-formatted
  • download and localize images (webp!)
Reference in New Issue View Git Blame Copy Permalink
Description
No description provided
Readme 47 KiB
Languages
Shell 100%