I'm currently encountering some challenges when trying to scrape a website that utilizes react for certain parts of its content, and I'm unsure about the reason behind my inability to extract the data.
Below is the HTML structure of the website: view image
My goal is to retrieve the text of the button with
data-test="shipItButton"However, upon running my code, I encounter the following error:
(node:23294) UnhandledPromiseRejectionWarning: NoSuchElementError: no such element: Unable to locate element: {"method":"css selector","selector":"[data-test=shipItButton]"}
Here is the code snippet I am currently using:
const webdriver = require("selenium-webdriver");
const By = webdriver.By;
const until = webdriver.until;
const driver = new webdriver.Builder()
.forBrowser("chrome")
.build();
let getData = async(url) => {
await driver.get(url);
let element = await driver.findElement(By.css('[data-test=shipItButton]'));
await driver.wait(until.elementIsVisible(element), 15000)
.then(element => getText())
.then(text => console.log("Extracted text: ", text))
.catch(err => console.log("Failed to retrieve: ", err));
}
getData("https://www.target.com/p/animal-crossing-new-horizons-8211-nintendo-switch/-/A-76780148")
Any suggestions on resolving this issue?