[HtmlUnit] [htmlunit:bugs] #1919 js_fonts not returning anything thus resulting has_lied_languages = true

This is a multi-part message in MIME format.
--===============4634379691501724940==
Content-Type: multipart/related;
 boundary="===============8661549132846296660=="

This is a multi-part message in MIME format.
--===============8661549132846296660==
Content-Type: multipart/alternative;
 boundary="===============5373847474673202122=="
MIME-Version: 1.0

--===============5373847474673202122==
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit

Will close this, i guess we have fixed what is possible with a headless browser.


---

** [bugs:#1919] js_fonts not returning anything thus resulting has_lied_languages = true**

**Status:** accepted
**Group:** 2.27
**Created:** Mon Sep 11, 2017 11:34 PM UTC by arya
**Last Updated:** Tue Oct 10, 2017 07:06 PM UTC
**Owner:** RBRi


I'm testing HTMLUnit with a fingerprinting website and it returns has_lied_languages = true and js_fonts also contains no fonts which is probably the reason for has_lied_languages being true. 

I have put the fingerprinting page here, if you access it by Google Chrome you will see that js_fonts has some fonts in front of it.

http://45.33.94.30/test.html

But if you access it with HtmlUnit, js_fonts is blank and has_lied_languages = false

~~~
try {
    BrowserVersion bv = BrowserVersion.CHROME;

    webClient = new WebClient(bv);
    webClient.getOptions().setTimeout(900000);
    webClient.getOptions().setJavaScriptEnabled(true);

    webClient.getOptions().setThrowExceptionOnScriptError(false);
    webClient.getOptions().setThrowExceptionOnFailingStatusCode(false);
    webClient.setCssErrorHandler(new SilentCssErrorHandler());
    webClient.getCache().setMaxSize(0);

    LogFactory.getFactory().setAttribute("org.apache.commons.logging.Log",
            "org.apache.commons.logging.impl.NoOpLog");
    java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit").setLevel(Level.OFF);
    java.util.logging.Logger.getLogger("org.apache.commons.httpclient").setLevel(Level.OFF);
    java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter")
            .setLevel(Level.OFF);
    java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject")
            .setLevel(Level.OFF);
    java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit.javascript.host.html.HTMLDocument")
            .setLevel(Level.OFF);
    java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit.html.HtmlScript").setLevel(Level.OFF);
    java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit.javascript.host.WindowProxy")
            .setLevel(Level.OFF);
    java.util.logging.Logger.getLogger("com.gargoylesoftware").setLevel(Level.OFF);
    java.util.logging.Logger.getLogger("org.apache").setLevel(Level.OFF);

    HtmlPage htmlPage = webClient.getPage("http://45.33.94.30/test.html");
    Thread.sleep(9000);

    htmlPage.save(new File("result.html"));
    webClient.close();
} catch (Exception e) {
    e.printStackTrace();
}
~~~





---

Sent from sourceforge.net because [email protected] is subscribed to https://sourceforge.net/p/htmlunit/bugs/

To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/htmlunit/admin/bugs/options.  Or, if this is a mailing list, you can unsubscribe from the mailing list.
--===============5373847474673202122==
MIME-Version: 1.0
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: 7bit

<div class="markdown_content"><p>Will close this, i guess we have fixed what is possible with a headless browser.</p>
<hr/>
<p><strong> <a class="alink" href="https://sourceforge.net/p/htmlunit/bugs/1919/">[bugs:#1919]</a> js_fonts not returning anything thus resulting has_lied_languages = true</strong></p>
<p><strong>Status:</strong> accepted<br/>
<strong>Group:</strong> 2.27<br/>
<strong>Created:</strong> Mon Sep 11, 2017 11:34 PM UTC by arya<br/>
<strong>Last Updated:</strong> Tue Oct 10, 2017 07:06 PM UTC<br/>
<strong>Owner:</strong> RBRi</p>
<p>I'm testing HTMLUnit with a fingerprinting website and it returns has_lied_languages = true and js_fonts also contains no fonts which is probably the reason for has_lied_languages being true. </p>
<p>I have put the fingerprinting page here, if you access it by Google Chrome you will see that js_fonts has some fonts in front of it.</p>
<p><a href="http://45.33.94.30/test.html" rel="nofollow">http://45.33.94.30/test.html</a></p>
<p>But if you access it with HtmlUnit, js_fonts is blank and has_lied_languages = false</p>
<div class="codehilite"><pre><span></span><span class="nt">try</span> <span class="p">{</span>
    <span class="err">BrowserVersion</span> <span class="err">bv</span> <span class="err">=</span> <span class="err">BrowserVersion.CHROME</span><span class="p">;</span>

    <span class="err">webClient</span> <span class="err">=</span> <span class="err">new</span> <span class="err">WebClient(bv)</span><span class="p">;</span>
    <span class="err">webClient.getOptions().setTimeout(900000)</span><span class="p">;</span>
    <span class="err">webClient.getOptions().setJavaScriptEnabled(true)</span><span class="p">;</span>

    <span class="err">webClient.getOptions().setThrowExceptionOnScriptError(false)</span><span class="p">;</span>
    <span class="err">webClient.getOptions().setThrowExceptionOnFailingStatusCode(false)</span><span class="p">;</span>
    <span class="err">webClient.setCssErrorHandler(new</span> <span class="err">SilentCssErrorHandler())</span><span class="p">;</span>
    <span class="err">webClient.getCache().setMaxSize(0)</span><span class="p">;</span>

    <span class="err">LogFactory.getFactory().setAttribute("org.apache.commons.logging.Log",</span>
            <span class="err">"org.apache.commons.logging.impl.NoOpLog")</span><span class="p">;</span>
    <span class="err">java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit").setLevel(Level.OFF)</span><span class="p">;</span>
    <span class="err">java.util.logging.Logger.getLogger("org.apache.commons.httpclient").setLevel(Level.OFF)</span><span class="p">;</span>
    <span class="err">java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit.javascript.StrictErrorReporter")</span>
            <span class="err">.setLevel(Level.OFF)</span><span class="p">;</span>
    <span class="err">java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit.javascript.host.ActiveXObject")</span>
            <span class="err">.setLevel(Level.OFF)</span><span class="p">;</span>
    <span class="err">java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit.javascript.host.html.HTMLDocument")</span>
            <span class="err">.setLevel(Level.OFF)</span><span class="p">;</span>
    <span class="err">java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit.html.HtmlScript").setLevel(Level.OFF)</span><span class="p">;</span>
    <span class="err">java.util.logging.Logger.getLogger("com.gargoylesoftware.htmlunit.javascript.host.WindowProxy")</span>
            <span class="err">.setLevel(Level.OFF)</span><span class="p">;</span>
    <span class="err">java.util.logging.Logger.getLogger("com.gargoylesoftware").setLevel(Level.OFF)</span><span class="p">;</span>
    <span class="err">java.util.logging.Logger.getLogger("org.apache").setLevel(Level.OFF)</span><span class="p">;</span>

    <span class="err">HtmlPage</span> <span class="err">htmlPage</span> <span class="err">=</span> <span class="err">webClient.getPage("</span><span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="mf">45.33.94.30</span><span class="o">/</span><span class="n">test</span><span class="o">.</span><span class="n">html</span><span class="s2">");</span>
<span class="s2">    Thread.sleep(9000);</span>

<span class="s2">    htmlPage.save(new File("</span><span class="n">result</span><span class="o">.</span><span class="n">html</span><span class="err">"</span><span class="p">));</span>
    <span class="err">webClient.close()</span><span class="p">;</span>
<span class="p">}</span> <span class="nt">catch</span> <span class="o">(</span><span class="nt">Exception</span> <span class="nt">e</span><span class="o">)</span> <span class="p">{</span>
    <span class="err">e.printStackTrace()</span><span class="p">;</span>
<span class="p">}</span>
</pre></div>


<hr/>
<p>Sent from sourceforge.net because [email protected] is subscribed to <a href="https://sourceforge.net/p/htmlunit/bugs/">https://sourceforge.net/p/htmlunit/bugs/</a></p>
<p>To unsubscribe from further messages, a project admin can change settings at <a href="https://sourceforge.net/p/htmlunit/admin/bugs/options.">https://sourceforge.net/p/htmlunit/admin/bugs/options.</a>  Or, if this is a mailing list, you can unsubscribe from the mailing list.</p></div>
--===============5373847474673202122==--
--===============8661549132846296660==--


--===============4634379691501724940==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline


--===============4634379691501724940==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
HtmlUnit-develop mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/htmlunit-develop

--===============4634379691501724940==--