Move scraped book details into data folder

This commit is contained in:
SirBlob committed 2026-11-01 22:58:56 -05:00
1 parent 9ce67f7600
commit 1f7e88f117
9 files changed
+190 -252

No files matched your search

+10 -4
View File
@@ -100,7 +100,7 @@ Copy `.env.example` to `.env` and fill in what you need. Every value is optional
## Content
Site content lives in `content/`.
Personal content and config live in `content/`. Data the tools fetch or generate from it (scraped book details and OMDb details) lives in `data/`, and downloaded images go in `static/`. Both are committed so the site never has to call Goodreads or OMDb for saved entries. `data/lastfm` is the exception: the server fills it at runtime and it stays out of git.
### Content editor
@@ -124,11 +124,12 @@ bun run content
| `s` | Move a book to another shelf, set a show or movie to watched, watching or planning, or make a theme the site default |
| `d` | Delete |
| `K` / `J` | Move a song or entry up or down |
| `u` / `U` | Refresh the selected book, or every book, from Goodreads |
| `u` / `U` | Refresh the selected book, or every book, from Goodreads; `u` also refreshes a show or movie from OMDb |
| `C` | Download every missing book cover, or every missing show and movie poster and details |
| `r` | Reload from disk |
| `q` | Quit |
Show and movie titles are looked up on OMDb with `OMDB_API_KEY` from `.env`; fill in the name field to skip the lookup. Books are scraped from Goodreads once when added and saved to `books.json`. To check a Goodreads link on its own, run `python3 tools/content/goodreads.py <url>`.
Show and movie titles are looked up on OMDb with `OMDB_API_KEY` from `.env` once when added. The details go into `data/mediaDetails.json` and the poster into `static/covers/media`, so the site only asks OMDb about titles that have nothing saved; fill in the name field to skip the lookup. Book covers are saved into `static/covers/books`. Books are scraped from Goodreads once when added: your shelf, rating and series go into `content/books.json`, and the scraped details into `data/bookDetails.json`. To check a Goodreads link on its own, run `python3 tools/content/goodreads.py <url>`.
| File | Holds |
| --- | --- |
@@ -137,12 +138,17 @@ Show and movie titles are looked up on OMDb with `OMDB_API_KEY` from `.env`; fil
| `experience.json` / `leadership.json` | Work experience and leadership roles |
| `projects/*.json` | Open source, packages, hackathons, research groups and organizations |
| `music.json` | YouTube links for the music player |
| `books.json` | Books scraped from Goodreads for the about page |
| `books.json` | Your books: Goodreads link, shelf, rating and series |
| `wallpapers.json` | Wallpapers for the picker, written by `bun run wallpapers` |
| `desktop.json` | Workspaces, desktop icons, the startup command and the default theme |
| `themes.json` | Color themes for the site and the content editor |
| `blog/*.md` | Blog posts |
| Generated file in `data/` | Holds |
| --- | --- |
| `bookDetails.json` | Title, authors, cover, description, pages and genres scraped from Goodreads |
| `mediaDetails.json` | Year, genre, runtime, plot and poster path from OMDb |
### Wallpapers
```sh