Unable to click on a checkbox using Chrome WebDriver in Python

Question

Unable to click on a checkbox using Chrome WebDriver in Python

I've been working on a script to display only Pikachus on the Singapore Poke Map. The goal is to extract coordinates for each Pikachu and print out the list. Despite trying numerous suggestions I found, I still can't get the checkbox to be set with the latest code:

from selenium import webdriver
from selenium.webdriver.chrome.service import Service as ChromeService
from webdriver_manager.chrome import ChromeDriverManager
from selenium.webdriver.common.by import By
import time

def find_pokemon():
    links = []
    service = ChromeService(ChromeDriverManager().install())
    driver = webdriver.Chrome(service=service)
    driver.get('https://sgpokemap.com/index.html?fbclid=IwAR2p_93Ll6K9b923VlyfaiTglgeog4uWHOsQksvzQejxo2fkOj4JN_t-MN8')
    driver.find_element(By.ID, 'filter_link').click()
    driver.find_element(By.ID, 'deselect_all_btn').click()
    driver.find_element(By.ID, 'search_pokemon').send_keys("pika")
    driver.switch_to.frame(driver.find_elements(By.ID, "filter"))
    driver.find_element(By.ID, 'checkbox_25').click()

The second part of the code works when I manually check the box after setting a breakpoint and ignoring the checkbox click() exception.

If you have any new ideas or suggestions, please let me know!

As a bonus question, how do I identify and close the donation pop-up view: https://i.stack.imgur.com/blcOM.jpg

python google-chrome selenium-webdriver selenium-chromedriver webdriver

Answer 1

Answer №1

Here are a few issues found in your code:

The element with the ID 'search_pokemon' is missing
There is no frame available to switch into it.
You should utilize WebDriverWait and expected_conditions to wait for elements to be clickable.
It's important to understand how to create accurate locators.
The code snippet below demonstrates a working solution:

from selenium import webdriver
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

options = Options()
options.add_argument("start-maximized")

webdriver_service = Service('C:\webdrivers\chromedriver.exe')
driver = webdriver.Chrome(options=options, service=webdriver_service)
wait = WebDriverWait(driver, 30)

url = "https://sgpokemap.com/index.html?fbclid=IwAR2p_93Ll6K9b923VlyfaiTglgeog4uWHOsQksvzQejxo2fkOj4JN_t-MN8"
driver.get(url)

try:
    wait.until(EC.element_to_be_clickable((By.ID, 'close_donation_button'))).click()
except:
    pass

wait.until(EC.element_to_be_clickable((By.ID, 'filter_link'))).click()
wait.until(EC.element_to_be_clickable((By.ID, "deselect_all_btn"))).click()
wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, "[name='search_pokemon']"))).send_keys("pika")
wait.until(EC.element_to_be_clickable((By.XPATH, "//div[@class='filter_checkbox'][not(@style)]//label"))).click()

Check out the screenshot of the outcome:

https://i.stack.imgur.com/1mvKJ.png

UPD

I managed to close the donation dialog this time.
I couldn't locate the element with ID = 'search_pokemon', as you mentioned.
In terms of finding the relevant checkbox using XPath - upon inserting the pokemon name, invisible checkboxes will be visible in the dev tools. However, only one of them will be enabled. The hidden elements have the attribute style="display: none;", while the visible one does not have a style attribute. Hence, I'm looking for the parent element //div[@class='filter_checkbox'] that has no style attribute. In XPath, it would be
```
//div[@class='filter_checkbox'][not(@style)]
```
, after which I select the child label to click on. This can also be achieved using CSS Selectors.

List of invisible elements along with the visible one:

https://i.stack.imgur.com/NqU6v.png

Answer 2

Here are a few issues found in your code:

The element with the ID 'search_pokemon' is missing
There is no frame available to switch into it.
You should utilize WebDriverWait and expected_conditions to wait for elements to be clickable.
It's important to understand how to create accurate locators.
The code snippet below demonstrates a working solution:

from selenium import webdriver
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

options = Options()
options.add_argument("start-maximized")

webdriver_service = Service('C:\webdrivers\chromedriver.exe')
driver = webdriver.Chrome(options=options, service=webdriver_service)
wait = WebDriverWait(driver, 30)

url = "https://sgpokemap.com/index.html?fbclid=IwAR2p_93Ll6K9b923VlyfaiTglgeog4uWHOsQksvzQejxo2fkOj4JN_t-MN8"
driver.get(url)

try:
    wait.until(EC.element_to_be_clickable((By.ID, 'close_donation_button'))).click()
except:
    pass

wait.until(EC.element_to_be_clickable((By.ID, 'filter_link'))).click()
wait.until(EC.element_to_be_clickable((By.ID, "deselect_all_btn"))).click()
wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, "[name='search_pokemon']"))).send_keys("pika")
wait.until(EC.element_to_be_clickable((By.XPATH, "//div[@class='filter_checkbox'][not(@style)]//label"))).click()

Check out the screenshot of the outcome:

https://i.stack.imgur.com/1mvKJ.png

UPD

I managed to close the donation dialog this time.
I couldn't locate the element with ID = 'search_pokemon', as you mentioned.
In terms of finding the relevant checkbox using XPath - upon inserting the pokemon name, invisible checkboxes will be visible in the dev tools. However, only one of them will be enabled. The hidden elements have the attribute style="display: none;", while the visible one does not have a style attribute. Hence, I'm looking for the parent element //div[@class='filter_checkbox'] that has no style attribute. In XPath, it would be
```
//div[@class='filter_checkbox'][not(@style)]
```
, after which I select the child label to click on. This can also be achieved using CSS Selectors.

List of invisible elements along with the visible one:

https://i.stack.imgur.com/NqU6v.png

Answer 3

Answer №2

Collaborating with @Prophet, the updated code for parsing the map and retrieving all Pikachu coordinates is as follows:

from selenium import webdriver
from selenium.webdriver.chrome.service import Service as Service
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.by import By

from keep import saveToKeep


def find_pokemon():
    links = []
    options = Options()
    options.add_argument("--headless")
    options.add_argument("disable-infobars")
    webdriver_service = Service('C:\webdrivers\chromedriver.exe')
    driver = webdriver.Chrome(options=options, service=webdriver_service)
    wait = WebDriverWait(driver, 30)

    driver.get('https://sgpokemap.com')
    try:
        wait.until(EC.element_to_be_clickable((By.ID, 'close_donation_button'))).click()
    except:
        pass
    wait.until(EC.element_to_be_clickable((By.ID, 'filter_link'))).click()
    wait.until(EC.element_to_be_clickable((By.ID, "deselect_all_btn"))).click()
    wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, "[name='search_pokemon']"))).send_keys("pika")
    wait.until(EC.element_to_be_clickable((By.XPATH, "//div[@class='filter_checkbox'][not(@style)]//label"))).click()
    
    wait.until(EC.element_to_be_clickable((By.CLASS_NAME, 'pokemon_icon_img')))
    pokeList = driver.find_elements(By.CLASS_NAME, 'pokemon_icon_img')
    for poke in pokeList:
        try:
            poke.click()
            links.append(driver.find_element(By.LINK_TEXT, "Maps").get_attribute('href'))
        except Exception:
            pass

    res = []
    for link in links:
        res.append(link.split("=")[1].replace("'", ""))

    if len(res) > 1:
        saveToKeep(res)
        print("success")
    else:
        print("unsuccessful")
        find_pokemon()


if __name__ == '__main__':
    find_pokemon()

The headless chrome option was utilized to improve performance.
'count' variable remains commented out for potential result limitation (currently restricted to 15 results only).

The

wait.until(EC.element_to_be_clickable((By.CLASS_NAME,    'pokemon_icon_img')))

line was included due to delayed icon appearance on the page.

This method has been made recursive to handle potential exceptions and unsuccessful attempts.
The saveToKeep(res) method is used to store results in Google Keep notes after obtaining an app password for secure login.

Feel free to provide any feedback or suggestions for enhancements!

Answer 4

Collaborating with @Prophet, the updated code for parsing the map and retrieving all Pikachu coordinates is as follows:

from selenium import webdriver
from selenium.webdriver.chrome.service import Service as Service
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.by import By

from keep import saveToKeep


def find_pokemon():
    links = []
    options = Options()
    options.add_argument("--headless")
    options.add_argument("disable-infobars")
    webdriver_service = Service('C:\webdrivers\chromedriver.exe')
    driver = webdriver.Chrome(options=options, service=webdriver_service)
    wait = WebDriverWait(driver, 30)

    driver.get('https://sgpokemap.com')
    try:
        wait.until(EC.element_to_be_clickable((By.ID, 'close_donation_button'))).click()
    except:
        pass
    wait.until(EC.element_to_be_clickable((By.ID, 'filter_link'))).click()
    wait.until(EC.element_to_be_clickable((By.ID, "deselect_all_btn"))).click()
    wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, "[name='search_pokemon']"))).send_keys("pika")
    wait.until(EC.element_to_be_clickable((By.XPATH, "//div[@class='filter_checkbox'][not(@style)]//label"))).click()
    
    wait.until(EC.element_to_be_clickable((By.CLASS_NAME, 'pokemon_icon_img')))
    pokeList = driver.find_elements(By.CLASS_NAME, 'pokemon_icon_img')
    for poke in pokeList:
        try:
            poke.click()
            links.append(driver.find_element(By.LINK_TEXT, "Maps").get_attribute('href'))
        except Exception:
            pass

    res = []
    for link in links:
        res.append(link.split("=")[1].replace("'", ""))

    if len(res) > 1:
        saveToKeep(res)
        print("success")
    else:
        print("unsuccessful")
        find_pokemon()


if __name__ == '__main__':
    find_pokemon()

The headless chrome option was utilized to improve performance.
'count' variable remains commented out for potential result limitation (currently restricted to 15 results only).

The

wait.until(EC.element_to_be_clickable((By.CLASS_NAME,    'pokemon_icon_img')))

line was included due to delayed icon appearance on the page.

This method has been made recursive to handle potential exceptions and unsuccessful attempts.
The saveToKeep(res) method is used to store results in Google Keep notes after obtaining an app password for secure login.

Feel free to provide any feedback or suggestions for enhancements!

Unable to click on a checkbox using Chrome WebDriver in Python

Answer №1

Answer №2

Similar questions

Guide on choosing a checkbox within a multiple select box using Selenium WebDriver in Java

Obtaining a particular ID from a URL using PHP WebDriver Selenium: A Comprehensive Guide

Shifting items in a pandas dataframe column below the nth item: A step-by-step guide

Searching for specific information within a JSON file (across multiple lines)

Unable to interact with cookies using Python's selenium package

Using Python to navigate JSON files containing multiple arrays

Clearing up confusion around identifying checkbox elements using XPath in Selenium WebDriver with Java, specifically within a

Creating a mouse locator program in Python: A step-by-step guide to developing a tool similar to the Free Utility for tracking mouse cursor position

Tips for optimizing JSON parsing and database writing for faster performance

The variable "display" in the global scope was not located

Navigating through JSON data in Python with a nested for loop

Selenium-powered Python Web Scraping

Should I simply open the URL or navigate to a page when creating end-to-end selenium tests?

Conceal the results of the Yolov8 model.predict() function by Ultralytics in the terminal

Chrome fails to read font family correctly

Selenium encountered an error when trying to execute the 'querySelector' function on the document. The selector provided, my_selector, is not recognized as a valid selector

Looking for assistance with parsing out four numerical values from an HTML scrape using Python

Retrieving data from relational databases based on specific conditions in Django

How can I divide a Python pandas dataset based on the presence of a specific value in a row?

Is Bootstrap CSS cached by Chrome?