Data scraping: Difference between revisions
Appearance
No edit summary |
No edit summary |
||
| (8 intermediate revisions by the same user not shown) | |||
| Line 6: | Line 6: | ||
# To execute the code, you need to have R installed and an editor (e.g. R Studio or Notepad++). | # To execute the code, you need to have R installed and an editor (e.g. R Studio or Notepad++). | ||
# | # INSTRUCTIONS | ||
# 1. Copy | # 1. Copy the lines below from # SCRIPT START to # SCRIPT END and paste them into your editor. | ||
# 2. In the | # 2. In the last line, replace "path_to_save" with the folder path name where you want to store the scraped data (use only '/' or '\\' as folder separator). For example, replace path_to_save with "D:/users/my_docs/APESATLAS/" | ||
path_to_save | |||
# 3. Run | # 3. Run the lines in R. | ||
# | # Note: Windows may open during the installation of the packages. Confirm all with ‘OK’. | ||
# | # It will take about 30 seconds for the tables to be scraped and saved into the folder specified in path_to_save . | ||
| Line 21: | Line 21: | ||
install.packages("plyr") | install.packages("plyr") | ||
install.packages("writexl") | install.packages("writexl") | ||
install.packages(" | install.packages("data.table") | ||
install.packages("httr2") | install.packages("httr2") | ||
library(httr2) | library(httr2) | ||
library( | library(data.table) | ||
library(writexl) | library(writexl) | ||
library(plyr) | library(plyr) | ||
| Line 31: | Line 31: | ||
#---------------------------------------------------------------------------------- | #---------------------------------------------------------------------------------- | ||
source("https://github.com/lakik/apesatlas_scraping/raw/refs/heads/main/script") | source("https://github.com/lakik/apesatlas_scraping/raw/refs/heads/main/script") | ||
#---------------------------------------------------------------------------------- | #---------------------------------------------------------------------------------- | ||
# Run scraper function | # Run scraper function | ||
#---------------------------------------------------------------------------------- | #---------------------------------------------------------------------------------- | ||
scrape_apesatlas(path_to_save) | scrape_apesatlas(path_to_save) | ||
#---------------------------------------------------------------------------------- | #---------------------------------------------------------------------------------- | ||
# SCRIPT END | # SCRIPT END | ||
Latest revision as of 20:00, 21 January 2026
################# APES Atlas Web Scraper #################
# The following R code extracts data from the standardized APES Atlas tables.
# To execute the code, you need to have R installed and an editor (e.g. R Studio or Notepad++).
# INSTRUCTIONS
# 1. Copy the lines below from # SCRIPT START to # SCRIPT END and paste them into your editor.
# 2. In the last line, replace "path_to_save" with the folder path name where you want to store the scraped data (use only '/' or '\\' as folder separator). For example, replace path_to_save with "D:/users/my_docs/APESATLAS/"
# 3. Run the lines in R.
# Note: Windows may open during the installation of the packages. Confirm all with ‘OK’.
# It will take about 30 seconds for the tables to be scraped and saved into the folder specified in path_to_save .
# SCRIPT START
#----------------------------------------------------------------------------------
# Install & load packages
#----------------------------------------------------------------------------------
install.packages("plyr")
install.packages("writexl")
install.packages("data.table")
install.packages("httr2")
library(httr2)
library(data.table)
library(writexl)
library(plyr)
#----------------------------------------------------------------------------------
# Load functions from Github
#----------------------------------------------------------------------------------
source("https://github.com/lakik/apesatlas_scraping/raw/refs/heads/main/script")
#----------------------------------------------------------------------------------
# Run scraper function
#----------------------------------------------------------------------------------
scrape_apesatlas(path_to_save)
#----------------------------------------------------------------------------------
# SCRIPT END