Python script utilizing Selenium is returning an empty string when trying to extract data from

Question

Python script utilizing Selenium is returning an empty string when trying to extract data from

When I try to retrieve the value from a dynamically loading table by clicking on the TD element, it works fine. However, when I attempt to fetch the text from the same TD element, it returns an empty string despite trying XPATH and CSS Selector methods.

Here is what the UI looks like; I am trying to extract the amount: https://i.stack.imgur.com/dw2o7.png

Below is the HTML Snapshot https://i.stack.imgur.com/tfYrL.png

amount = driver.find_element_by_xpath('//*[@id="Table_Cheque_Ref_Details"]/tbody/tr[2]/td[11]').click

This part is working properly.

amount=driver.find_element_by_xpath('//*[@id="Table_Cheque_Ref_Details"]/tbody/tr[2]/td[11]').text
print amount

This is returning an empty string.

amount = WebDriverWait(driver, 10).until(EC.text_to_be_present_in_element((By.XPATH, '//*[@id="xfe38"]'), '0')) print amount

This is resulting in a Timeout Exception.

python html selenium selenium-webdriver

Answer 1

Answer №1

Solution

It has been pointed out by @Andersson that you can utilize get_attribute('value') to retrieve the text from an input field. Let's illustrate this with the following example:

driver.get('http://demo.automationtesting.in/Register.html') # access sample page
time.sleep(3) # wait for page load

input_el = driver.find_element_by_xpath("//*[@id='basicBootstrapForm']/div[4]/div/input") # locate phone input field
input_el.click()
input_el.send_keys("123")

print(input_el.text) # no output
print(input_el.get_attribute("value")) # prints '123'

Analysis

If we inspect the dev tools:

https://i.stack.imgur.com/F2Jf2.png

We will observe the HTML snippet representing our input:

<input type="tel" class="form-control ng-touched ng-dirty ng-valid-parse ng-invalid ng-valid-required ng-invalid-pattern" ng-model="Phone" required="" pattern="^\d{10}$">

The tag does not contain any visible text, hence calling

print(input_el.text)

yields no result. However, if the HTML had resembled:

<label class="col-md-3 col-xs-3 col-sm-3 control-label">Email address*</label>

then

print(label_el.text)

would display the content within the label tag - Email address*.

Answer 2

Solution

It has been pointed out by @Andersson that you can utilize get_attribute('value') to retrieve the text from an input field. Let's illustrate this with the following example:

driver.get('http://demo.automationtesting.in/Register.html') # access sample page
time.sleep(3) # wait for page load

input_el = driver.find_element_by_xpath("//*[@id='basicBootstrapForm']/div[4]/div/input") # locate phone input field
input_el.click()
input_el.send_keys("123")

print(input_el.text) # no output
print(input_el.get_attribute("value")) # prints '123'

Analysis

If we inspect the dev tools:

https://i.stack.imgur.com/F2Jf2.png

We will observe the HTML snippet representing our input:

<input type="tel" class="form-control ng-touched ng-dirty ng-valid-parse ng-invalid ng-valid-required ng-invalid-pattern" ng-model="Phone" required="" pattern="^\d{10}$">

The tag does not contain any visible text, hence calling

print(input_el.text)

yields no result. However, if the HTML had resembled:

<label class="col-md-3 col-xs-3 col-sm-3 control-label">Email address*</label>

then

print(label_el.text)

would display the content within the label tag - Email address*.

Python script utilizing Selenium is returning an empty string when trying to extract data from

Answer №1

Solution

Analysis

Similar questions

Error: Function call in PySpark dataframe with IndexError due to exceeding list index range

Can the pandas apply function be enhanced for better performance within groupby operations?

Struggling to map JSON data (received from WCFRest) onto an HTML table

What could be causing the incorrect updating of React State when passing my function to useState?

What is the best way to assign attributes to multiple HTML elements using an array?

Phonegap's JavaScript canvas feature is experiencing issues

Share your hefty files through an online portal

CSS Grid having trouble with wrapping elements

PySpark - Utilizing Conditional Logic

Unique option preservation on customized HTML select menus - Maintain original selection

Is there a way to update the button's value upon clicking it?

Unable to expand the dropdown button collection due to the btn-group being open

What is the best way to grab and retrieve a toast notification using Python's Selenium?

IE6 disrupts stored layouts

The conversion of string to number is not getting displayed correctly when using console.log or document.write. Additionally, the concatenated display is also not functioning as intended

Adding a semi-transparent layer to cover half of the canvas while still allowing the canvas to be visible

A guide on incorporating a customized Google map into your website

How to calculate the logarithm of a positive number in Python and deal with the result of negative

Python Creating a callback function in Matplotlib with parameters

Intriguing flashing dark streak, reminiscent of a boundary within NextJS