Exploring ways to interact with Span elements using Selenium in Python

Question

Exploring ways to interact with Span elements using Selenium in Python

Greetings! I am currently attempting to access a specific element called span. My goal is to retrieve this element in a manner that allows me to append it to a list. Each span contains an attribute wordnr="1" or a different number. The objective is to extract each wordnr value and store it in a list.

The source code of the website appears as follows:

<div id="row1" style="top: 1px;"><span wordnr="0" class="highlight">who</span> <span wordnr="1" class="">other</span> ...<span wordnr="45" class="">place</span>

Below is the code that I have written, but unfortunately, it does not seem to be working properly as I am struggling with accessing and locating the desired elements. Kindly note that I am utilizing Repl.it for this task:

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.chrome.options import Options

list=[]

chrome_options = Options()
chrome_options.add_argument('--no-sandbox')
chrome_options.add_argument('--disable-dev-shm-usage')

driver = webdriver.Chrome(options=chrome_options)

driver.get("https://10fastfingers.com/typing-test/english")

words = driver.find_element_by_xpath("//span[@class='wordnr'/span[0]]").text

python selenium selenium-webdriver web-scraping selenium-chromedriver

Answer 1

Answer №1

1 Make sure to click the "Accept cookies" button first in order to access the text.

2 Use item.get_attribute("innerHTML") to retrieve the text. If item.text is not working, you may need to investigate further why that is so intriguing.

3 Utilize Selenium to generate a list with

my_list = driver.find_elements_by_css_selector("#row1>span[wordnr]")

. Avoid creating unnecessary lists as it could result in nested lists in your case.

4 Opt for appropriate explicit waits. Using

visibility_of_all_elements_located

might not be effective if the text is only partially visible.

5 Refrain from using generic identifiers such as list for better code readability. Explore alternative list naming conventions in this engaging discussion on Better Python list Naming Other than "list". My resolution

Customized selenium script goes here ...
(printed 385 words)

Sample end result

385
keep
country
been
their
food
do
...

Displays the complete list consisting of 385 words.

Answer 2

1 Make sure to click the "Accept cookies" button first in order to access the text.

2 Use item.get_attribute("innerHTML") to retrieve the text. If item.text is not working, you may need to investigate further why that is so intriguing.

3 Utilize Selenium to generate a list with

my_list = driver.find_elements_by_css_selector("#row1>span[wordnr]")

. Avoid creating unnecessary lists as it could result in nested lists in your case.

4 Opt for appropriate explicit waits. Using

visibility_of_all_elements_located

might not be effective if the text is only partially visible.

5 Refrain from using generic identifiers such as list for better code readability. Explore alternative list naming conventions in this engaging discussion on Better Python list Naming Other than "list". My resolution

Customized selenium script goes here ...
(printed 385 words)

Sample end result

385
keep
country
been
their
food
do
...

Displays the complete list consisting of 385 words.

Answer 3

Answer №2

Look out for the "accept all cookies" button, you'll need to give it a click. Here's a snippet of code example:

Sample Code :

driver.maximize_window()
driver.get("https://10fastfingers.com/typing-test/english")
wait = WebDriverWait(driver, 10)
wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, "a[id='CybotCookiebotDialogBodyLevelButtonLevelOptinAllowAll']"))).click()
sleep(5)
for name in driver.find_elements(By.XPATH, "//span[@wordnr]"):
    print(name.get_attribute('wordnr'))

Dependencies :

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

Answer 4

Look out for the "accept all cookies" button, you'll need to give it a click. Here's a snippet of code example:

Sample Code :

driver.maximize_window()
driver.get("https://10fastfingers.com/typing-test/english")
wait = WebDriverWait(driver, 10)
wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, "a[id='CybotCookiebotDialogBodyLevelButtonLevelOptinAllowAll']"))).click()
sleep(5)
for name in driver.find_elements(By.XPATH, "//span[@wordnr]"):
    print(name.get_attribute('wordnr'))

Dependencies :

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

Answer 5

Answer №3

My approach to solving this would be the following:
First, ensure that the page has fully loaded. Next, retrieve the list of relevant elements and extract the text from each element, adding it to the list.

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
import time

chrome_options = Options()
chrome_options.add_argument('--no-sandbox')
chrome_options.add_argument('--disable-dev-shm-usage')

driver = webdriver.Chrome(options=chrome_options)
wait = WebDriverWait(driver, 20)

driver.get("https://10fastfingers.com/typing-test/english")
texts_list=[]
# Wait for the first element to be visible
wait.until(EC.visibility_of_element_located((By.CSS_SELECTOR, "span[wordnr]")))
# Allow time for the remaining elements to load
time.sleep(1)

elements = driver.find_elements_by_css_selector("span[wordnr]")
for element in elements:
    texts_list.append(element.text)

Answer 6

My approach to solving this would be the following:
First, ensure that the page has fully loaded. Next, retrieve the list of relevant elements and extract the text from each element, adding it to the list.

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
import time

chrome_options = Options()
chrome_options.add_argument('--no-sandbox')
chrome_options.add_argument('--disable-dev-shm-usage')

driver = webdriver.Chrome(options=chrome_options)
wait = WebDriverWait(driver, 20)

driver.get("https://10fastfingers.com/typing-test/english")
texts_list=[]
# Wait for the first element to be visible
wait.until(EC.visibility_of_element_located((By.CSS_SELECTOR, "span[wordnr]")))
# Allow time for the remaining elements to load
time.sleep(1)

elements = driver.find_elements_by_css_selector("span[wordnr]")
for element in elements:
    texts_list.append(element.text)

Answer 7

Answer №4

Let's give this a try:

collection = []
terms = driver.find_elements_by_xpath("//div[@id='row1']/span")
for term in terms:
    collection.append(term.get_attribute("wordnr"))

Answer 8

Let's give this a try:

collection = []
terms = driver.find_elements_by_xpath("//div[@id='row1']/span")
for term in terms:
    collection.append(term.get_attribute("wordnr"))

Exploring ways to interact with Span elements using Selenium in Python

Answer №1

Answer №2

Answer №3

Answer №4

Similar questions

Ways to choose an option from a drop-down menu without the select tag using Selenium

Python script in PowerShell has arguments that include double quotes and whitespace

Issue with passing arguments for entry_points in Setuptools

pyOWM is failing to yield the desired outcome

Attempting to utilize Selenium to input data into a text field on a web page

Exploring the concept of Starred Expression

Converting strings to floats in Python without relying on specific locales

Query a string in MongoDB using Python3

Using a Django model field to automatically populate another field

Tips for reducing the browser window size in Selenium WebDriver 3

Creating a 2-dimensional array of binary digits using Python

MatPlotLib Pcolormesh displaying incorrectly

Verify if the file uploaded in django is a zip file

determining a precise match with Selenium through text-based criteria

Issues with deleting dictionaries from a list using Python

Is there an issue with HTTP Basic Authentication through the URL in Firefox?

The ElementClickInterceptedException error is thrown when the element at the specified point (x, y) is not clickable due to another element overlapping and

Utilize typehead.js in Python Django to retrieve an updated data list directly from the database

The Python interpreter behaves consistently across different platforms, except for a specific issue with json_set in Visual Studio Code

Utilize the same web browser across numerous test scenarios in Katalon Studio