ben/scrape-giant
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Record Costco task evidence

Browse Source
This commit is contained in:
ben
2026-03-16 09:18:05 -04:00
parent da00288f10
commit 0d1591a602
2 changed files with 26 additions and 17 deletions
Download Patch File Download Diff File Expand all files Collapse all files

32
pm/tasks.org
View File

@@ -143,7 +143,7 @@
- tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python build_canonical_layer.py`; verified auto-linked `giant_output/products_canonical.csv` and `giant_output/product_links.csv`
- date: 2026-03-16
* [ ] t1.8: support costco raw ingest path (2-5 commits)
* [X] t1.8: support costco raw ingest path (2-5 commits)
** acceptance criteria
- add a costco-specific raw ingest/export path
@@ -158,11 +158,11 @@
- bearer/auth values should come from local env, not source
** evidence
- commit:
- tests:
- date:
- commit: `da00288` on branch `cx`
- tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python scrape_costco.py --help`; verified `costco_output/raw/*.json`, `costco_output/orders.csv`, and `costco_output/items.csv` from the local sample payload
- date: 2026-03-16
* [ ] t1.8.1: support costco parser/enricher path (2-4 commits)
* [X] t1.8.1: support costco parser/enricher path (2-4 commits)
** acceptance criteria
- add a costco-specific enrich step producing `costco_output/items_enriched.csv`
@@ -179,10 +179,10 @@
- expect weaker identifiers than Giant
** evidence
- commit:
- tests:
- date:
* [ ] t1.8.2: validate cross-retailer observed/canonical flow (1-3 commits)
- commit: `da00288` on branch `cx`
- tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python enrich_costco.py`; verified `costco_output/items_enriched.csv`
- date: 2026-03-16
* [X] t1.8.2: validate cross-retailer observed/canonical flow (1-3 commits)
** acceptance criteria
- feed Giant and Costco enriched rows through the same observed/canonical pipeline
@@ -197,10 +197,10 @@
- apples, eggs, bananas, or flour are better than weird prepared foods
** evidence
- commit:
- tests:
- date:
* [ ] t1.8.3: extend shared schema for retailer-native ids and adjustment lines (1-2 commits)
- commit: `da00288` on branch `cx`
- tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python validate_cross_retailer_flow.py`; proof example: Giant `FRESH BANANA` and Costco `BANANAS 3 LB / 1.36 KG` share one canonical in `combined_output/proof_examples.csv`
- date: 2026-03-16
* [X] t1.8.3: extend shared schema for retailer-native ids and adjustment lines (1-2 commits)
** acceptance criteria
- add shared fields needed for non-upc retailers, including:
@@ -215,9 +215,9 @@
- do this once instead of sprinkling exceptions everywhere
** evidence
- commit:
- tests:
- date:
- commit: `9497565` on branch `cx`
- tests: `./venv/bin/python -m unittest discover -s tests`; verified shared enriched fields in `giant_output/items_enriched.csv` and `costco_output/items_enriched.csv`
- date: 2026-03-16
* [ ] t1.9: compute normalized comparison metrics (2-4 commits)
** acceptance criteria