Enhanced PHP File Manager

⬆️ Go Up (..)

📊 Server Information

Server:

nginx/1.28.0

System:

Linux 6.8.0-90-generic

PHP Version:

8.4.15

User:

alqudsvolunteers

Directory:

/home/alqudsvolunteers/rootlink/proc/thread-self/root/proc/self/root/usr/share/doc/varnish/html/phk

Free Space:

79.7 GB

🔧 Quick Actions

✏️ Editing: cheri2.html

<!DOCTYPE html>

<title>How Varnish met CHERI 2/N &#8212; Varnish version 7.5.0 documentation</title>
 <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=fa44fd50" />
 <link rel="stylesheet" type="text/css" href="../_static/classic.css?v=e2714048" />
 
 <script src="../_static/documentation_options.js?v=8214db13"></script>
 <script src="../_static/doctools.js?v=888ff710"></script>
 <script src="../_static/sphinx_highlight.js?v=dc90522c"></script>
 
 <link rel="index" title="Index" href="../genindex.html" />
 <link rel="search" title="Search" href="../search.html" />
 <link rel="next" title="How Varnish met CHERI 1/N" href="cheri1.html" />
 <link rel="prev" title="How Varnish met CHERI 3/N" href="cheri3.html" /> 
 </head><body>
 <div class="related" role="navigation" aria-label="related navigation">
 <h3>Navigation</h3>
 <ul>
 <li class="right" style="margin-right: 10px">
 <a href="../genindex.html" title="General Index"
 accesskey="I">index</a></li>
 <li class="right" >
 <a href="cheri1.html" title="How Varnish met CHERI 1/N"
 accesskey="N">next</a> |</li>
 <li class="right" >
 <a href="cheri3.html" title="How Varnish met CHERI 3/N"
 accesskey="P">previous</a> |</li>
 <li class="nav-item nav-item-0"><a href="../index.html">Varnish version 7.5.0 documentation</a> &#187;</li>
 <li class="nav-item nav-item-1"><a href="index.html" accesskey="U">Poul-Hennings random outbursts</a> &#187;</li>
 <li class="nav-item nav-item-this"><a href="">How Varnish met CHERI 2/N</a></li> 
 </ul>
 </div>

<div class="document">
 <div class="documentwrapper">
 <div class="bodywrapper">
 <div class="body" role="main">
 
 <section id="how-varnish-met-cheri-2-n">
<h1>How Varnish met CHERI 2/N<a class="headerlink" href="#how-varnish-met-cheri-2-n" title="Link to this heading">¶</a></h1>
CHERI capabilities are twice the size of pointers, and Varnish not
only uses a lot of pointers per request, it is also stingy with
RAM, because it is not uncommon to use 100K worker threads.
A number of test-cases fail because they are stingy with memory
allocations, and other test-cases run out of cache space.
The job of these test-cases is to push varnish into obscure code-paths,
using finely tuned sizes of objects, lengths of headers and parameter
settings to varnish, and the bigger pointers in Varnish trows that
tuning off.
These test-failures have nothing to do with CHERI.
There was enough margin that we could find magic numbers which work
on both 32 bit and 64 bit CPUs, that is with both 4 and 8 byte
pointers, but it is doubtful there is enough margin to make them
also work with 16 byte pointers, so I will merely list these tests
here as part of the accounting:
<div class="highlight-default notranslate"><div class="highlight"><pre>Workspace sizes
=====================
TEST tests/c00108.vtc
TEST tests/r01038.vtc
TEST tests/r01120.vtc
TEST tests/r02219.vtc
TEST tests/o00005.vtc

Cache sizes
=====================
TEST tests/r03502.vtc
TEST tests/r01140.vtc
TEST tests/r02831.vtc
TEST tests/v00064.vtc
</pre></div>
</div>
<section id="things-you-cannot-do-under-cheri-pointers-in-pipes">
<h2>Things you cannot do under CHERI: Pointers in Pipes<a class="headerlink" href="#things-you-cannot-do-under-cheri-pointers-in-pipes" title="Link to this heading">¶</a></h2>
Varnish has a central “waiter” service, whose job it is to monitor
file descriptors to idle network connections, and do the right thing
if data arrives on them, or if they are, or should be closed after
a timeout.
For reasons of performance, we have multiple implementations:
<code class="docutils literal notranslate">kqueue(2)</code> (BSD), <code class="docutils literal notranslate">epoll(2)</code> (Linux), <code class="docutils literal notranslate">ports(2)</code> (Solaris)
and <code class="docutils literal notranslate">poll(2)</code> which should work everywhere POSIX has been read.
We only have the <code class="docutils literal notranslate">poll(2)</code> based waiter for portability, one
less issue to deal with during bring-up on new platforms, its
performance degrades to uselessness with contemporary loads
of open network connections.
The way they all work is that have a single thread sitting
in the relevant system-call, monitoring tens of thousands
of file descriptors.
Some of those system calls allows other threads to add fds to the
list, but <code class="docutils literal notranslate">poll(2)</code> does not, so when we start the poll-waiter
we create a <code class="docutils literal notranslate">pipe(2)</code>, and have the waiter-thread listen to that
too.
When another thread wants to add a file descriptor to the inventory,
it uses <code class="docutils literal notranslate">write(2)</code> to send a pointer into that pipe. The kernel
provide all the locking and buffering for us, wakes up the waiter-thread
which reads the pointer, adds the new fd to its inventory and dives
back into <code class="docutils literal notranslate">poll(2)</code>.
This is 100% safe, because nobody else can get to a pipe created
with <code class="docutils literal notranslate">pipe(2)</code>, but there is no way CHERI could spot that to
make an execption, so reading pointers out of a filedescriptor,
cause fully justified core-dumps.
If the poll-waiter was actaully relevant, the proper fix would be
to let the sending thread stick things on a locked list and just
write a nonce-byte into the pipe to the waiter-thread, but that
goes at the bottom of the TODO list, and for now I just remove the
-Wpoll argument from five tests, which then pass:
<div class="highlight-default notranslate"><div class="highlight"><pre>-Wpoll
=====================
TEST tests/b00009.vtc
TEST tests/b00048.vtc
TEST tests/b00054.vtc
TEST tests/b00059.vtc
TEST tests/c00080.vtc
</pre></div>
</div>
But why five tests ?
It looks like one to test the poll-waiter and four cases of copy&amp;paste.
</section>
<section id="never-write-your-own-red-black-trees">
<h2>Never write your own Red-Black Trees<a class="headerlink" href="#never-write-your-own-red-black-trees" title="Link to this heading">¶</a></h2>
In general there are few pieces of code I dare not wade into,
but there are a LOT of code I dont want to touch, if there
is any way to avoid it.
Red-Black trees are one of them.
In Varnish we stol^H^H^H^H imported both <code class="docutils literal notranslate">&lt;queue.h&gt;</code> and <code class="docutils literal notranslate">&lt;tree.h&gt;</code>
from FreeBSD, but as a safety measure we stuck a <code class="docutils literal notranslate">V</code> prefix on
everything in them.
Every so often I will run a small shell-script which does the
v-thing and compare the result to <code class="docutils literal notranslate">vtree.h</code> and <code class="docutils literal notranslate">vqueue.h</code>,
to keep up with FreeBSD.
Today that paid off handsomely: Some poor person on the CHERI
team had to wade into <code class="docutils literal notranslate">tree.h</code> and stick <code class="docutils literal notranslate">__no_subobject_bounds</code>
directives to pointers to make that monster work under CHERI.
I just ran my script and 20 more tests pass:
<div class="highlight-default notranslate"><div class="highlight"><pre>Red-Black Trees
=====================
TEST tests/b00068.vtc
TEST tests/c00005.vtc
TEST tests/e00003.vtc
TEST tests/e00008.vtc
TEST tests/e00019.vtc
TEST tests/l00002.vtc
TEST tests/l00003.vtc
TEST tests/l00005.vtc
TEST tests/m00053.vtc
TEST tests/r01312.vtc
TEST tests/r01441.vtc
TEST tests/r02451.vtc
TEST tests/s00012.vtc
TEST tests/u00004.vtc
TEST tests/u00010.vtc
TEST tests/v00009.vtc
TEST tests/v00011.vtc
TEST tests/v00017.vtc
TEST tests/v00041.vtc
TEST tests/v00043.vtc
</pre></div>
</div>
Four failures left…
/phk
</section>
</section>

<div class="clearer"></div>
 </div>
 </div>
 </div>
 <div class="sphinxsidebar" role="navigation" aria-label="main navigation">
 <div class="sphinxsidebarwrapper">
 <div>
 <h3><a href="../index.html">Table of Contents</a></h3>
 <ul>
<li><a class="reference internal" href="#">How Varnish met CHERI 2/N</a><ul>
<li><a class="reference internal" href="#things-you-cannot-do-under-cheri-pointers-in-pipes">Things you cannot do under CHERI: Pointers in Pipes</a></li>
<li><a class="reference internal" href="#never-write-your-own-red-black-trees">Never write your own Red-Black Trees</a></li>
</ul>
</li>
</ul>

</div>
 <div>
 <h4>Previous topic</h4>
 <a href="cheri3.html"
 title="previous chapter">How Varnish met CHERI 3/N</a>
 </div>
 <div>
 <h4>Next topic</h4>
 <a href="cheri1.html"
 title="next chapter">How Varnish met CHERI 1/N</a>
 </div>
 <div role="note" aria-label="source link">
 <h3>This Page</h3>
 <ul class="this-page-menu">
 <li><a href="../_sources/phk/cheri2.rst.txt"
 rel="nofollow">Show Source</a></li>
 </ul>
 </div>
<div id="searchbox" style="display: none" role="search">
 <h3 id="searchlabel">Quick search</h3>
 <div class="searchformwrapper">
 <form class="search" action="../search.html" method="get">
 <input type="text" name="q" aria-labelledby="searchlabel" autocomplete="off" autocorrect="off" autocapitalize="off" spellcheck="false"/>
 <input type="submit" value="Go" />
 </form>
 </div>
</div>
<script>document.getElementById('searchbox').style.display = "block"</script>
 </div>
 </div>
 <div class="clearer"></div>
 </div>
 <div class="related" role="navigation" aria-label="related navigation">
 <h3>Navigation</h3>
 <ul>
 <li class="right" style="margin-right: 10px">
 <a href="../genindex.html" title="General Index"
 >index</a></li>
 <li class="right" >
 <a href="cheri1.html" title="How Varnish met CHERI 1/N"
 >next</a> |</li>
 <li class="right" >
 <a href="cheri3.html" title="How Varnish met CHERI 3/N"
 >previous</a> |</li>
 <li class="nav-item nav-item-0"><a href="../index.html">Varnish version 7.5.0 documentation</a> &#187;</li>
 <li class="nav-item nav-item-1"><a href="index.html" >Poul-Hennings random outbursts</a> &#187;</li>
 <li class="nav-item nav-item-this"><a href="">How Varnish met CHERI 2/N</a></li> 
 </ul>
 </div>
 <div class="footer" role="contentinfo">
 &#169; Copyright 2010-2014, Varnish Software AS.
 Created using <a href="https://www.sphinx-doc.org/">Sphinx</a> 7.2.6.
 </div>
 </body>
</html>

❌ Cancel

🗂️ Enhanced PHP File Manager

📊 Server Information

🔧 Quick Actions

✏️ Editing: cheri2.html

📤 Upload File

📁 Create Folder

📄 Create File

✏️ Rename Item

🗑️ Delete Confirmation