New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
CSVFeedSpider has a huge memory usage when dealing with a csv file contains huge amount of urls
#5330
opened Nov 24, 2021 by
HaujetZhao
Files expiration does not work well for Google Cloud Storage (GCS)
#5317
opened Nov 14, 2021 by
mnannan
Improve diagnostics when stuck because of SCRAPER_SLOT_MAX_ACTIVE_SIZE
enhancement
#5302
opened Oct 28, 2021 by
wRAR
get_retry_request: allow changing the log level of the gave up message
enhancement
#5297
opened Oct 26, 2021 by
Gallaecio
Schedule a CI job to test unreleased dependencies
discuss
enhancement
#5291
opened Oct 23, 2021 by
Gallaecio
Better error (or support?) when yielding items from start requests
discuss
enhancement
#5289
opened Oct 22, 2021 by
Gallaecio
Implement a decorator to feed start requests into the scheduler
discuss
enhancement
#5282
opened Oct 18, 2021 by
Gallaecio
[Question] Large number of sub-directories in
requests.queue
enhancement
#5275
opened Oct 12, 2021 by
atreyasha
[Documentation] Suggest increasing
ulimit -S -n for broad crawls
docs
enhancement
#5259
opened Oct 4, 2021 by
atreyasha
Mention DOWNLOADER_CLIENT_TLS_METHOD tweaking to avoid some bans
docs
enhancement
#5232
opened Aug 18, 2021 by
Gallaecio
XPath tutorial xpathdemo live widget does not display Result
bug
docs
upstream issue
#5220
opened Aug 1, 2021 by
Marghis
Previous Next
ProTip!
Follow long discussions with comments:>50.

