How do you recognize if the collector has finished? If the site doesn't contain ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		asciimoo on Oct 5, 2017 \| parent \| context \| favorite \| on: Colly: Fast and Elegant Scraping Framework for Gol... How do you recognize if the collector has finished? If the site doesn't contain "a" elements (e.g. because of a network error), this example would block forever.

dward on Oct 5, 2017 [–]

The producer closes the channel. This is differentiable from an open empty channel in a select.

asciimoo on Oct 5, 2017 | [–]

Makes sense, thanks =)

In the above example this would require `nil` checking of the retrieved value every time. I'm not sure if it would make the API cleaner

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact