Here is the code snippet I am currently using - and yes, I have tried to keep it short and concise.
import selenium
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
import bs4
options=Options()
#options.add_argument('--headless') # Works while not headless?
options.add_argument('--disable-gpu') # Last I checked this was necessary.
options.add_argument("--user-data-dir=profiles\\") #Keeps login data
options.add_argument("--profile-directory=Profile 1")
driver=webdriver.Chrome(chrome_options=options)
driver.get("http://www.google.com")
html=driver.page_source
soup=bs4.BeautifulSoup(html, "html.parser")
print(soup)
The main issue arises from the --user-data-dir and --profile-directory parameters. In my testing scenario, a custom chrome profile (usually located at
C:\Users\User\AppData\Local\Google\Chrome\User DataIf the --headless parameter is activated with the above parameters, the driver hangs (the CMD window stays open and no output is displayed on the Python command line). However, without enabling it, the window pops up and functions properly.
Nevertheless, --headless does function when using any profile within the default directory mentioned earlier.
This is the console output:
[0120/222514.611:ERROR:gpu_process_transport_factory.cc(967)] Lost UI shared context.
DevTools listening on ws://127.0.0.1:59961/devtools/browser/ee317ed6-93c7-47c2-b26d-63647980ba0d
[0120/222514.619:ERROR:devtools_http_handler.cc(289)] Error writing DevTools active port to file
[0120/222514.624:ERROR:cache_util_win.cc(19)] Unable to move the cache: 0
[0120/222514.625:ERROR:cache_util.cc(140)] Unable to move cache folder profiles\Default\GPUCache to profiles\Default\old_GPUCache_000
[0120/222514.625:ERROR:disk_cache.cc(184)] Unable to create cache
[0120/222514.625:ERROR:shader_disk_cache.cc(622)] Shader Cache Creation failed: -2
It seems like Chromium is assuming that I am using the Default profile even though I explicitly specify that I am not.
Any suggestions would be greatly appreciated. Thank you!