A system to increase the efficiency of dynamic web-scraping with 'RSelenium' by leveraging parallel processing. You provide a function wrapper for your 'RSelenium' scraping routine with a set of inputs, and 'parsel' runs it in several browser instances. Chunked input processing as well as error catching and logging ensures seamless execution and minimal data loss, even when unforeseen 'RSelenium' errors occur.
Version: | 0.1.1 |
Imports: | parallel (≥ 3.6.2), RSelenium, lubridate (≥ 1.7.9), utils (≥ 2.10.1), methods (≥ 3.3.1), purrr (≥ 0.3.4) |
Suggests: | rmarkdown, knitr, testthat (≥ 3.0.0), covr (≥ 3.5.1) |
Published: | 2022-03-17 |
Author: | Till Tietz [cre, aut] |
Maintainer: | Till Tietz <ttietz2014 at gmail.com> |
BugReports: | https://github.com/till-tietz/parsel/issues |
License: | MIT + file LICENSE |
URL: | https://github.com/till-tietz/parsel |
NeedsCompilation: | no |
Materials: | README NEWS |
CRAN checks: | parsel results |
Reference manual: | parsel.pdf |
Package source: | parsel_0.1.1.tar.gz |
Windows binaries: | r-devel: parsel_0.1.1.zip, r-release: parsel_0.1.1.zip, r-oldrel: parsel_0.1.1.zip |
macOS binaries: | r-release (arm64): parsel_0.1.1.tgz, r-oldrel (arm64): parsel_0.1.1.tgz, r-release (x86_64): parsel_0.1.1.tgz, r-oldrel (x86_64): parsel_0.1.1.tgz |
Please use the canonical form https://CRAN.R-project.org/package=parsel to link to this page.