Trying to complete and submit an HTML form using HtmlUnit, encountering issues with retrieving a select element loaded via <body onLoad="...">.
The Issue: Unable to access the desired select element through methods like getSelectByName or getChildElements (ElementNotFoundException thrown), despite data being present in org.apache.http.wire log.
When inspecting page.asXml(), only the original HTML document is displayed.
Sample Code:
public static void main(final String[] args) throws Exception {
final URL url = new URL("http://www.rce-event.de/modules/meldung/annahme.php?oid=471&pid=1&ac=d98482bbf174f62eaaa4664c&tkey=468&portal=www.dachau.de&ortsbox=1&callpopup=1");
final WebClient webClient = new WebClient(BrowserVersion.FIREFOX_3_6); // also tried FIREFOX_3
webClient.setAjaxController(new NicelyResynchronizingAjaxController());
final HtmlPage page = webClient.getPage(url);
webClient.waitForBackgroundJavaScript(10000); // also attempted Thread.sleep()
// replaced 'page' with webClient.getCurrentWindow().getEnclosedPage() - same issue
final HtmlForm form = page.getFormByName("formular");
// ElementNotFoundException occurs at this point:
final HtmlSelect select = form.getSelectByName("event.theme");
final HtmlOption option = select.getOptionByText("Sport/Freizeit");
final Page newPage = select.setSelectedAttribute(option, false);
// submission process, etc.
}
Stacktrace:
Exception in thread "main" com.gargoylesoftware.htmlunit.ElementNotFoundException: elementName=[select] attributeName=[name] attributeValue=[event.theme]
at com.gargoylesoftware.htmlunit.html.HtmlForm.getSelectByName(HtmlForm.java:449)
at Xyzzy.main(Xyzzy.java:58)
Attempted solutions from various sources including here, here, and here without success.
Update:
Simplified code and initiated a bounty.