eulaly beb5cf461b t1.1: scrape one forum via ViewComments.cfm POST pagination ...

Spider fetches ViewComments.cfm?GdocForumID=N with vPerPage=500,
generates all page requests from page-1 metadata, and parses
each div.Cbox for comment_id, author, date, title, text, reg_title,
reg_desc. Handles span-wrapped comment text. Fixes UTF-8/windows-1251
meta-tag encoding mismatch. 9083 items, 15 empty-text (0.17%).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-05-05 12:28:07 -04:00

..

spiders

t1.1: scrape one forum via ViewComments.cfm POST pagination

2026-05-05 12:28:07 -04:00

__init__.py

initial commit

2026-05-05 11:35:19 -04:00

items.py

t1.1: scrape one forum via ViewComments.cfm POST pagination

2026-05-05 12:28:07 -04:00

middlewares.py

initial commit

2026-05-05 11:35:19 -04:00

pipelines.py

initial commit

2026-05-05 11:35:19 -04:00

settings.py

t1.1: scrape one forum via ViewComments.cfm POST pagination

2026-05-05 12:28:07 -04:00