ben/scrape-giant
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

added data-model

Browse Source
This commit is contained in:
ben
2026-03-16 00:22:24 -04:00
parent 927643955e
commit 42dbae1d2e
2 changed files with 303 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
pm/tasks.org
View File

@@ -16,7 +16,7 @@
- tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python scraper.py --help`; verified `.env` loading via `scraper.load_config()`
- date: 2026-03-14
* [ ] t1.2: define grocery data model and file layout (1-2 commits)
* [X] t1.2: define grocery data model and file layout (1-2 commits)
** acceptance criteria
- decide and document the files/directories for:
- retailer raw exports
@@ -33,8 +33,8 @@
** evidence
- commit:
- tests:
- date:
- tests: reviewed `giant_output/raw/history.json`, one sample raw order json, `giant_output/orders.csv`, `giant_output/items.csv`; documented schemas in `pm/data-model.org`
- date: 2026-03-15
* [ ] t1.3: build giant parser/enricher from raw json (2-4 commits)
** acceptance criteria