ben/scrape-giant
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Record t1.4 through t1.7 task evidence

Browse Source
This commit is contained in:
ben
2026-03-16 00:45:04 -04:00
parent 385a31c07f
commit 4216daa37c
1 changed files with 16 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files

32
pm/tasks.org
View File

@@ -58,7 +58,7 @@
- tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python enrich_giant.py`; verified `giant_output/items_enriched.csv` on real raw data - tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python enrich_giant.py`; verified `giant_output/items_enriched.csv` on real raw data
- date: 2026-03-16 - date: 2026-03-16
* [ ] t1.4: generate observed-product layer from enriched items (2-3 commits) * [X] t1.4: generate observed-product layer from enriched items (2-3 commits)
** acceptance criteria ** acceptance criteria
- distinct observed products are generated from enriched giant items - distinct observed products are generated from enriched giant items
@@ -76,11 +76,11 @@
- likely key is some combo of retailer + upc + normalized name - likely key is some combo of retailer + upc + normalized name
** evidence ** evidence
- commit: - commit: `dc39214` on branch `cx`
- tests: - tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python build_observed_products.py`; verified `giant_output/products_observed.csv`
- date: - date: 2026-03-16
* [ ] t1.5: build review queue for unresolved or low-confidence products (1-3 commits) * [X] t1.5: build review queue for unresolved or low-confidence products (1-3 commits)
** acceptance criteria ** acceptance criteria
- produce a review file containing observed products needing manual review - produce a review file containing observed products needing manual review
@@ -98,11 +98,11 @@
- optimize for “approve once, remember forever” - optimize for “approve once, remember forever”
** evidence ** evidence
- commit: - commit: `9b13ec3` on branch `cx`
- tests: - tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python build_review_queue.py`; verified `giant_output/review_queue.csv`
- date: - date: 2026-03-16
* [ ] t1.6: create canonical product layer and observed→canonical links (2-4 commits) * [X] t1.6: create canonical product layer and observed→canonical links (2-4 commits)
** acceptance criteria ** acceptance criteria
- define and create `products_canonical.csv` - define and create `products_canonical.csv`
@@ -120,11 +120,11 @@
- do not require llm assistance for v1 - do not require llm assistance for v1
** evidence ** evidence
- commit: - commit: `347cd44` on branch `cx`
- tests: - tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python build_canonical_layer.py`; verified seeded `giant_output/products_canonical.csv` and `giant_output/product_links.csv`
- date: - date: 2026-03-16
* [ ] t1.7: implement auto-link rules for easy matches (2-3 commits) * [X] t1.7: implement auto-link rules for easy matches (2-3 commits)
** acceptance criteria ** acceptance criteria
- auto-link can match observed products to canonical products using deterministic rules - auto-link can match observed products to canonical products using deterministic rules
@@ -139,9 +139,9 @@
- false positives are worse than unresolved items - false positives are worse than unresolved items
** evidence ** evidence
- commit: - commit: `385a31c` on branch `cx`
- tests: - tests: `./venv/bin/python -m unittest discover -s tests`; `./venv/bin/python build_canonical_layer.py`; verified auto-linked `giant_output/products_canonical.csv` and `giant_output/product_links.csv`
- date: - date: 2026-03-16
* [ ] t1.8: support costco raw ingest path (2-5 commits) * [ ] t1.8: support costco raw ingest path (2-5 commits)