Scraping a website using selenium resulted in the following message appearing in the output, amidst the desired content:
[0306/125211.693:INFO:CONSOLE(0)] "A cookie associated with a cross-site resource at http://yahoo.com/ was set without the `SameSite` attribute.Code Used:
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
user_agent = 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_3) AppleWebKit/537.36 (KHTML, like Gecko) ' \
'Chrome/80.0.3987.132 Safari/537.36'
driver_exe = 'chromedriver'
options = Options()
options.add_argument("--headless")
options.add_argument(f'user-agent={user_agent}')
options.add_argument("--disable-web-security")
options.add_argument("--allow-running-insecure-content")
options.add_argument("--allow-cross-origin-auth-prompt")
options.add_argument("--disable-cookie-encryption")
driver = webdriver.Chrome(executable_path=r"C:\Users\intel\Downloads\Setups\chromedriver.exe", options=options)
driver.get("https://www.amazon.com/s?k=asus&rh=n%3A300189&nav_sdd=aps&pd_rd_r=58b28d7d-1955-433b-b33b-b1b5dcf1f522&pd_rd_w=MJzan&pd_rd_wg=QG3cj&pf_rd_p=6d81377b-6d6c-4363-ae02-8fa202ed7b50&pf_rd_r=X0BDDAPN7TTW0ZT1REX6&qid=1583290662&ref=sxwds-sbc_c2")
class_Name = "a-size-medium a-color-base a-text-normal"
x = driver.find_elements_by_class_name(class_Name.replace(' ','.'))
for i in list(x):
print(i.text,"\n")
The Output Including CORS Policy:
list of ASUS products...
[0306/125211.693:INFO:CONSOLE(0)] "A cookie associated with a cross-site resource at http://yahoo.com/ was set without the `SameSite` attribute...
[0306/125211.696:INFO:CONSOLE(0)] "A cookie associated with a cros...
more list of ASUS products...
ASUS GT-AC5300 ROG Rapture TriBand 4x4 AC5300 Gaming WiFi Router
ASUS RT-AC87R Wireless-AC2400 Dual Band Gigabit Router
ASUS RT-AC66R 802.11ac Dual-Band Wireless-AC1750 Gigabit Router
ASUS Dual-Band AC750 wireless router 733 Mbps with USB port (RT-AC51U)
NETGEAR Nighthawk X4S Smart WiFi Router (R7800) - AC2600 Wireless Speed (up to 2600 Mbps) | Up to 2500 sq ft Coverage & 45 Devices | 4 x 1G Ethernet, 2 x 3.0 USB, and 1 x eSATA ports
ASUS RT-AC1900 Dual Band WiFi Router
How can I eliminate the CORS line from my output? Any assistance would be greatly appreciated!