Re: [mp2] Memory not being shared

[prev] [thread] [next] [Date index for 2005/02/12]

From: Richard F. Rebel
Subject: Re: [mp2] Memory not being shared
Date: 14:31 on 12 Feb 2005
--=-+t+bF1IugHvDPOx+RRDG
Content-Type: text/plain
Content-Transfer-Encoding: quoted-printable


Stas,

As far as the kernel issue goes, you are right there has been changes.
The meaning of 'SHARE' pages reported by the Linux kernel has changed
over time.  This does not necessarily mean your processes aren't sharing
via COW pages, just in how the kernel reports them.

I posted a response from the linux kernel mailing list a short time ago
that goes into detail.

Best,

Richard F. Rebel

On Fri, 2005-02-11 at 23:04 -0500, Stas Bekman wrote:
> I plugged vmonitor in the mp2 test suite (which loads a lot of modules)=20
> and the conclusions are as following:
>=20
> perl           Size Share VSize   Rss
> non-threaded: 24.8M  8.3M 24.8M 20.6M
> threaded    : 30.4M  8.6M 30.4M 26.2M
>=20
> both running perl 5.8.6 under prefork mpm.
>=20
> so you can see that while there is a difference is the total memory usage=
=20
> (but not all modules are loaded for the non-threaded case), there is not=20
> much difference between the two when it comes to shared memory.
>=20
> While trying to shrink the test suite to find out where the unshared=20
> memory comes from I've discovered that 10.2MB come from loading=20
> Apache::TestRequest. I've verified that offline with:
>=20
> perl-5.8.6-ithread bloat.pl 'use blib; use Apache::TestRequest'
> use blib; use Apache::TestRequest added 10.2M
>=20
> so *all* the memory used by A-TR (and modules it has loaded) was=20
> completely unshared. I don't know why that happens. A-TR is preloaded at=20
> the server startup. It's probably the case where perl has tons of=20
> variables which change, making all pages unshared.
>=20
> I've run a quick test with mp1's test suite, and it seems to be quite=20
> similar (not much sharing)
>=20
> So it's quite possible that this is a kernel issue (Linux=20
> rabbit.stason.org 2.6.8.1-12mdk here) or something that has to do with li=
bc)
>=20
--=20
Richard F. Rebel <rrebel@xxxxx.xxx>
WhenU.com

--=-+t+bF1IugHvDPOx+RRDG
Content-Type: application/pgp-signature; name=signature.asc
Content-Description: This is a digitally signed message part

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)

iD8DBQBCDhNAx1ZaISfnBu0RAoqhAJ9NJRNHELwWoQSwR6kdh06zetki7ACdETuu
mtSF4S0biQMF7RYnW0SyMaQ=
=r/P1
-----END PGP SIGNATURE-----

--=-+t+bF1IugHvDPOx+RRDG--

(message missing)

[mp2] Memory not being shared
Kurt Hansen 15:57 on 11 Feb 2005

Re: [mp2] Memory not being shared
Stas Bekman 17:14 on 11 Feb 2005

Re: [mp2] Memory not being shared
Kurt Hansen 17:54 on 11 Feb 2005

Re: [mp2] Memory not being shared
Perrin Harkins 20:32 on 11 Feb 2005

Re: [mp2] Memory not being shared
Kurt Hansen 21:23 on 11 Feb 2005

Re: [mp2] Memory not being shared
Perrin Harkins 21:36 on 11 Feb 2005

Re: [mp2] Memory not being shared
Kurt Hansen 22:34 on 11 Feb 2005

Re: [mp2] Memory not being shared
Stas Bekman 04:04 on 12 Feb 2005

Re: [mp2] Memory not being shared
Richard F. Rebel 14:31 on 12 Feb 2005

Re: [mp2] Memory not being shared
Richard F. Rebel 14:22 on 12 Feb 2005

Re: [mp2] Memory not being shared
Kurt Hansen 17:58 on 12 Feb 2005

Generated at 17:31 on 15 Feb 2005 by mariachi v0.52