Discover and read the best of Twitter Threads about #rvest
Most recents (1)
Inspired by @PaoloCrosetto's blog on #MDPI, this weekend I've been on a side-quest exploring their journals publications using R and web scraping package #rvest. A thread 🧵1/11 👇
#Rstats
#Rstats
Basically, I use two loops to download public editorial information. My example code is for "Plants #MDPI" but is easy to adapt to other journals. Takes about 2 hours to run (>8000 papers to explore).
The first loop, extracts identity urls from MDPI's search website.
2/11
The first loop, extracts identity urls from MDPI's search website.
2/11
Sys.sleep(1) is there to slow down the extraction and avoid being kicked out by the search server. Can be probably speed up reducing the value. 3/11
