ben/scrape-giant
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • 74d17b0b0c minor edit refactor/enrich ben 2026-03-24 17:28:16 -04:00
  • fea5132100 minor edi ben 2026-03-24 17:27:34 -04:00
  • eb3959ae0f Record t1.22.1 task evidence ben 2026-03-24 17:26:00 -04:00
  • 867275c67a Trim requirements to direct runtime deps ben 2026-03-24 17:25:52 -04:00
  • 6336c15da8 Record t1.22 task evidence ben 2026-03-24 17:10:09 -04:00
  • 09829b2b9d Finalize post-refactor layout and remove old pipeline files ben 2026-03-24 17:09:57 -04:00
  • cdb7a15739 Record t1.21 task evidence ben 2026-03-24 16:49:01 -04:00
  • 46a3b2c639 Add purchase analysis summaries ben 2026-03-24 16:48:53 -04:00
  • c35688c87f Record t1.20 task evidence ben 2026-03-24 08:29:31 -04:00
  • 6940f165fb Document visit-level purchase analysis ben 2026-03-24 08:29:26 -04:00
  • de8ff535b8 1.18 cleanup and review ben 2026-03-24 08:27:41 -04:00
  • 02be6f52c0 Record t1.19 task evidence ben 2026-03-23 15:32:48 -04:00
  • 8ccf3ff43b Reconcile review queue against current catalog state ben 2026-03-23 15:32:41 -04:00
  • a93229408b Record t1.18.4 task evidence ben 2026-03-23 15:28:05 -04:00
  • a45522c110 Finalize purchase effective price fields ben 2026-03-23 15:27:58 -04:00
  • d78230f1c6 Record t1.18.3 task evidence ben 2026-03-23 13:56:56 -04:00
  • 73176117fe Fix Costco hash-size weight parsing ben 2026-03-23 13:56:47 -04:00
  • facebced9c Record t1.18.2 task evidence ben 2026-03-23 13:23:03 -04:00
  • 23dfc3de3e Use picked weight for Giant quantity basis ben 2026-03-23 13:22:56 -04:00
  • 3bc76ed243 Record t1.18 and t1.18.1 evidence ben 2026-03-23 12:54:09 -04:00
  • dc0d0614bb Add effective price to purchases ben 2026-03-23 12:53:54 -04:00
  • 605c94498b Add effective price regression tests ben 2026-03-23 12:52:41 -04:00
  • d4f479b0d8 added effective_price and testing to id upstream data ben 2026-03-23 12:35:27 -04:00
  • 38c2c2ea2e Record t1.17 task evidence ben 2026-03-21 21:50:16 -04:00
  • d25448b690 Fix normalized quantity basis ben 2026-03-21 21:50:10 -04:00
  • db761adafc added notes from first review session eulaly 2026-03-21 20:53:22 -04:00
  • e8e11e15b3 added draft scope for review/search loop eulaly 2026-03-21 09:48:34 -04:00
  • afadd0c0d0 Restore skip and move search to find ben 2026-03-20 13:35:07 -04:00
  • 2847d2d59f Record t1.16.1 task evidence ben 2026-03-20 13:32:27 -04:00
  • f93b9aa464 Add catalog search to review flow ben 2026-03-20 13:32:20 -04:00
  • 17158fb9e9 Record t1.16 task evidence ben 2026-03-20 12:45:57 -04:00
  • 975d44bebb Tighten review prompt flow ben 2026-03-20 12:45:38 -04:00
  • f478795b5d added t1.16 to cleanup review process ben 2026-03-20 12:42:23 -04:00
  • 59fb881c0a Record t1.15 task evidence ben 2026-03-20 11:27:56 -04:00
  • 9104781b93 Refactor review pipeline around normalized items ben 2026-03-20 11:27:46 -04:00
  • 607c51038a Record t1.14.3 task evidence ben 2026-03-20 11:09:50 -04:00
  • bcec6b37d3 Clean Costco normalization artifacts ben 2026-03-20 11:09:44 -04:00
  • 848d229f2d Record t1.14.2 task evidence ben 2026-03-20 10:05:08 -04:00
  • d2e6f2afd3 Align refactor paths with data layout ben 2026-03-20 10:04:58 -04:00
  • 424a777dd0 added git note eulaly 2026-03-20 09:58:25 -04:00
  • 2e5d69c75e added 14.2 and 14.3 for refactor prep eulaly 2026-03-20 09:55:46 -04:00
  • 3c2462845b added task-sample ben 2026-03-18 15:47:12 -04:00
  • c0023e8f3a Record t1.14.1 task evidence ben 2026-03-18 15:46:31 -04:00
  • 9064de5f67 Refactor retailer normalization outputs ben 2026-03-18 15:46:20 -04:00
  • ec1f36a140 Record t1.14 task evidence ben 2026-03-18 15:18:54 -04:00
  • 48c6eaf753 Refactor retailer collection entrypoints ben 2026-03-18 15:18:47 -04:00
  • e74253f6fb data-model prep for refactor, removing observed layer ben 2026-03-18 15:15:29 -04:00
  • c13d144418 cleanup ben 2026-03-18 14:02:36 -04:00
  • 10aad05808 data-model refactor and prep scope ben 2026-03-18 13:08:28 -04:00
  • 9122821db1 Fix t1.13 evidence hashes ben 2026-03-17 15:08:09 -04:00
  • 7743421918 Record t1.13 task evidence ben 2026-03-17 15:07:51 -04:00
  • 08e2a86cbd Make canonical auto-linking more conservative ben 2026-03-17 15:07:48 -04:00
  • 56a03bcb1d Attach Costco discounts to purchase rows ben 2026-03-17 15:07:45 -04:00
  • 967e19e561 Add pipeline status accounting ben 2026-03-17 15:07:42 -04:00
  • eddef7de2b updated readme and prep for next phase review cx ben 2026-03-17 13:59:57 -04:00
  • 83bc6c4a7c Update t1.12 task evidence ben 2026-03-17 13:25:21 -04:00
  • d39497c298 Refine product review prompt flow ben 2026-03-17 13:25:12 -04:00
  • 7b8141cd42 Improve product review display workflow ben 2026-03-17 12:25:47 -04:00
  • e494386e64 build_purchases rev1 ben 2026-03-17 12:21:44 -04:00
  • 7527fe37eb added git notes ben 2026-03-17 12:21:24 -04:00
  • a1fafa3885 added t1.12 scope to simplify review process ben 2026-03-17 12:20:48 -04:00
  • 37b2196023 added git notes ben 2026-03-17 09:23:00 -04:00
  • 7f8c3ed8eb updated readme with Review steps ben 2026-03-17 09:14:14 -04:00
  • 91bfd3597e Record t1.11 task evidence ben 2026-03-16 20:45:57 -04:00
  • c7dad5489e Add terminal review resolution workflow ben 2026-03-16 20:45:37 -04:00
  • 34eedff9c5 Record t1.8.7 and t1.9 task evidence ben 2026-03-16 18:01:16 -04:00
  • be1bf6328e Build pivot-ready purchase log ben 2026-03-16 18:01:09 -04:00
  • 6806c0e7ff updated readme ben 2026-03-16 17:40:23 -04:00
  • 861955557a added instructions ben 2026-03-16 17:34:22 -04:00
  • 6e1cde2c83 fix json data pull from /raw ben 2026-03-16 17:34:01 -04:00
  • 23d0c7e5cd fix bug w session.headers.update missing auth_headers ben 2026-03-16 17:19:07 -04:00
  • 9a985bf98d updated to use .env, then pull idToken and clientID ben 2026-03-16 17:17:20 -04:00
  • b0d4044dac updated task 1.8.7 ben 2026-03-16 17:09:13 -04:00
  • d7a0329332 Simplify browser session bootstrap ben 2026-03-16 17:08:44 -04:00
  • e48dd6c4c2 troubleshooting costco header extraction eulaly 2026-03-16 16:59:31 -04:00
  • 1b4c7dde25 Simplify Costco browser header extraction ben 2026-03-16 16:23:38 -04:00
  • 5a331c9af4 fixed sqlite copy permission error eulaly 2026-03-16 16:18:50 -04:00
  • 4fd309251d Record t1.8.6 task evidence ben 2026-03-16 13:54:11 -04:00
  • 7789c2e6ae Add shared browser session bootstrap ben 2026-03-16 13:54:00 -04:00
  • 0f797d0a96 added scope for browser session pull task and cleanup eulaly 2026-03-16 13:46:52 -04:00
  • a48a3c8396 added token and dotenv so costco scrapes successfully 36 mo eulaly 2026-03-16 13:46:22 -04:00
  • de0c276a24 Merge remote-tracking branch 'gitea/cx' into cx eulaly 2026-03-16 12:40:44 -04:00
  • d080a35697 added git issues notes eulaly 2026-03-16 12:33:50 -04:00
  • 2e5109bd11 Record t1.8.5 task evidence ben 2026-03-16 12:28:27 -04:00
  • c0054dc51e Align Costco scraper with browser session flow ben 2026-03-16 12:28:19 -04:00
  • 58d6efb7bb assume local venv available ben 2026-03-16 11:44:10 -04:00
  • 031955ba54 Record t1.8.4 task evidence ben 2026-03-16 11:39:51 -04:00
  • ac82fa64fb Fix Costco receipt enumeration windows ben 2026-03-16 11:39:45 -04:00
  • 0d1591a602 Record Costco task evidence ben 2026-03-16 09:18:05 -04:00
  • da00288f10 Add Costco acquisition and enrich flow ben 2026-03-16 09:17:46 -04:00
  • 9497565978 Extend shared schema for retailer-native ids ben 2026-03-16 09:17:36 -04:00
  • d20a131e04 updated scope to prep for costco scraper ben 2026-03-16 09:04:52 -04:00
  • 4216daa37c Record t1.4 through t1.7 task evidence ben 2026-03-16 00:45:04 -04:00
  • 385a31c07f Auto-link canonical products conservatively ben 2026-03-16 00:44:45 -04:00
  • 347cd44d09 Create canonical product layer scaffold ben 2026-03-16 00:43:21 -04:00
  • 9b13ec3b31 Build observed product review queue ben 2026-03-16 00:43:17 -04:00
  • dc392149b5 Generate Giant observed products ben 2026-03-16 00:43:11 -04:00
  • 8cdc4a1ad3 Record t1.3 task evidence ben 2026-03-16 00:28:37 -04:00
  • 14f2cc2bac Build Giant item enricher ben 2026-03-16 00:28:28 -04:00
  • 42dbae1d2e added data-model ben 2026-03-16 00:22:24 -04:00