slowness of the site with 25 members online

DolphinD7.0.6 - dedicated server -  Intel Core2Duo - 2x 2.33+ GHz  - 4 Go DDR2  -  2x 750 Go - SATA2

Who can help me make this site faster

http://ns302329.ovh.net/cgi-bin/mrtg.cgi

top - 17:58:50 up 5 days, 20:06,  1 user,  load average: 4.33, 5.63, 6.84
Tasks: 321 total,   7 running, 313 sleeping,   0 stopped,   1 zombie
Cpu(s): 84.6% us, 13.4% sy,  0.0% ni,  1.8% id,  0.0% wa,  0.0% hi,  0.2% si
Mem:   4106508k total,  3509756k used,   596752k free,   379676k buffers
Swap:  1046520k total,      200k used,  1046320k free,  2402824k cached

PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
3254 qscand    23   3  163m 152m  852 S    0  3.8   0:50.65 clamd
3255 qscand    23   3  163m 152m  852 S    0  3.8   0:02.44 clamd
3256 qscand    23   3  163m 152m  852 S    0  3.8   0:00.00 clamd
1544 root      20   0 1188m  85m 3152 S    0  2.1   0:00.02 java
1729 root      20   0 1188m  85m 3152 S    0  2.1   0:13.34 java
3328 root      20   0 1188m  85m 3152 S    0  2.1   0:00.06 java
3329 root      20   0 1188m  85m 3152 S    0  2.1   0:00.06 java
5282 root      20   0 1188m  85m 3152 S    0  2.1   0:00.02 java
5446 root      20   0 1188m  85m 3152 S    0  2.1   0:00.01 java
5528 root      20   0 1188m  85m 3152 S    0  2.1   0:00.01 java
8197 root      20   0 1188m  85m 3152 S    0  2.1   0:00.80 java
8322 root      20   0 1188m  85m 3152 S    0  2.1   0:00.16 java
8601 root      20   0 1188m  85m 3152 S    0  2.1   0:01.48 java
9842 root      20   0 1188m  85m 3152 S    0  2.1   0:07.76 java
9910 root      20   0 1188m  85m 3152 S    0  2.1   0:00.48 java
10123 root      20   0 1188m  85m 3152 S    0  2.1   0:00.02 java
10224 root      20   0 1188m  85m 3152 S    0  2.1   0:00.06 java
10225 root      20   0 1188m  85m 3152 S    0  2.1   0:00.06 java
10438 root      20   0 1188m  85m 3152 S    0  2.1   0:00.01 java
10524 root      20   0 1188m  85m 3152 S    0  2.1   0:00.01 java
10601 root      20   0 1188m  85m 3152 S    0  2.1   0:00.01 java
10830 root      20   0 1188m  85m 3152 S    0  2.1   0:00.01 java
11083 root      20   0 1188m  85m 3152 S    0  2.1   0:00.00 java
12736 root      20   0 1188m  85m 3152 S    0  2.1   0:05.59 java
13407 root      20   0 1188m  85m 3152 S    0  2.1   5:08.45 java
18162 root      20   0 1188m  85m 3152 S    0  2.1   0:00.02 java
18513 root      20   0 1188m  85m 3152 S    0  2.1   0:08.41 java
21671 root      20   0 1188m  85m 3152 S    0  2.1   0:00.02 java
22060 root      20   0 1188m  85m 3152 S    0  2.1   0:00.32 java
22156 root      20   0 1188m  85m 3152 S    0  2.1   0:00.00 java
23134 root      20   0 1188m  85m 3152 S    0  2.1   5:53.66 java
25034 root      20   0 1188m  85m 3152 S    0  2.1   0:00.00 java
25037 root      20   0 1188m  85m 3152 S    0  2.1   0:02.68 java
25038 root      20   0 1188m  85m 3152 S    0  2.1   0:02.12 java
25039 root      20   0 1188m  85m 3152 S    0  2.1   0:58.31 java
25040 root      20   0 1188m  85m 3152 S    0  2.1   0:58.34 java
25041 root      20   0 1188m  85m 3152 S    0  2.1   1:06.67 java
25042 root      20   0 1188m  85m 3152 S    0  2.1   0:00.04 java
25043 root      20   0 1188m  85m 3152 S    0  2.1   0:00.09 java
25046 root      20   0 1188m  85m 3152 S    0  2.1   0:00.00 java
25047 root      20   0 1188m  85m 3152 S    0  2.1   0:04.02 java
25048 root      20   0 1188m  85m 3152 S    0  2.1   0:04.57 java
25049 root      20   0 1188m  85m 3152 S    0  2.1   0:00.00 java
25050 root      20   0 1188m  85m 3152 S    0  2.1   2:00.07 java

Have you read this?: http://www.boonex.com/trac/dolphin/wiki/HostingServerSetupRecommendations

yes I read - " I did everything" - except the php

my php version 5.2.13-pl1-gentoo  - System  Server API CGI

I do not really know what to do - I afraid of making bad choices

with 200 members and 25 members online - the pages are too slow - it's a snail

in  more -   RMS - is on another dedicated server

Ciao Daniel :-)

Si le site si lent est bien celui avec un menu noir sur 2 niveaux.... alors, pour sûr, tu peux l'accélérer grandement.

Mais tu risques de ne vas pas aimer:

• installer moins de modules
• afficher moins de blocs sur certaines pages

Ca, tu le fais probablement déjà: optimiser régulièrement (quotidiennement ou après la fin de l'envoi d'email de masse,...) ta base de données, vérifier qu'aucune tables ne contienne un nombre anormalement élevé d'enregistrements...

What are java processes if media server is on another server ?

clamd is antivirus, it is top process as I see.

Try to disable/kill java processes and antivirus, it should help.

Also php in CGI mode is most inefficient setup, switch to mod_php (php dso module) and it should help a lot too.

If you are using WHM/cPanel, there is munin plugin which is easy to install - it can show more graphs, including mysql server graphs.

Salut Michel

t'es plutôt rare en ce moment sur boonex :)

Non c'est pas mon site échangiste avec le double menu noir  toujours en D6 - cuila il tourne bien j'ai aucun problème

Le problème de lenteur c' est avec un nouveau site ouvert depuis quelque jours c'est un site naturiste avec la dernière version de D7 - il n'est pas a moi - j'ai juste  fait l'installation et le template -

Les deux sites on le même serveur sur mon site j'ai  presque 20000 milles membres et il tourne comme une horloge - sur le site naturiste y a environ  200 membres et quand j'ai 20 membres en ligne ça commence a être lent - pour tester  j'ai  connecté le rms de site naturiste sur mon serveur mais c'est  toujours aussi lent.

Hi AlexT

RMS server is already on another server

there are two server - and two site
it's the same servers - the same configuration - the same host

Site with problems of slowness = Site 1 - with D7 and 200 members
site without problem = site 2 - with D6 and 20000 members

RMS - of site 1 - (  RMS Address)  -  is connected to the server - of site 2

to change php - it is a problem
I look in the forum my host   - and contacted my host

then the server comes with Apache 2, PHP 5 and MySQL 5.
With security patch update monitoring system (this system Simply Involves The Use of software and services pre-installed by my host)
if I switch to  mod_php  - I go out, of system pre-installed -
is no longer assured by my host - and I spend the server administrator

from what I read on the forum my host
the configuration of my server - a configuration that is a bit special
to switch to mod_php - it can not be done since the administration - I do not use - WHM / cPanel but Webmin
there has only one tutorial - for  switch to  mod_php - and many people - have problems on their servers - by following this tutorial

or tried to follow this tutorial
or are there other solution for optimized this server without changing php
or - change the server - for a server naked under debian

how to disable or kill - java process and antivirus ?

more - I should make updating a site with D6 to D7 -
the site with D6 - is installed on another dedicated server - same setup - same host
but with 20000 members - I have no problem of slow - all going very well
view the performance problems with this server and D7 - with only 200 members
it is not reasonable to make this update

so I'm not sure what to do...

As-tu essayé de tester ton site avec http://gtmetrix.com/ ? Cela peut te donner de bonnes indications.

Ma remarque sur le nombre de modules et de blocks installés reste valable. Plus il y a de modules, plus c'est lent :-))

Je n'ai encore installé aucun accélérateur ou autre compression de fichiers sur mon VPS. Mais j'ai multiplié la vitesse du site par deux,  au minimum, en reprenant chaque fichier (surtout sans oublier les fichiers CSS) et en effaçant les remarques, les lignes vides et les espaces inutiles... C'est long, fastidieux, mais efficace  :-) 

It is better to ask your hosting support on how to disable antivirus and java processes, my solutions can break something, since I don't know what is the program on your server java based and where is antivirus used.

mod_php is simple configuration, I suggest you to try it anyway.

The main difference between D7 and D6 in terms of server load is that D7 has a lot of periodic requests every 2-5 seconds (for simple messenger, menu notifications, video messenger invitations, spy updates, shoutbox updates, etc). It is becoming even more critical when PHP is working in CGI mode, because each request to your server initiate creating of separate process with loading php interpreter from the scratch.

Désolé pour la réponse tardive mais j'ai fait une pose et y a surement un mec ( un ex ) qui a créer un faux profil de fille sur mon site adulte - avec une photo d'une fille , compte créer avec une adresse mail de la société ou la fille bosse et pour finir il a donner a certain membres  le tel du boulot de la fille -  la vraie fille ma contacté et je lui est donné l'adresse IP de celui qui a ouvert le compte - elle porte plainte demain

Pour la page d'accueil

Une galerie photo  - Slideshow -  photos

Blocs -  membres ( 12 ) - Shoutbox - Leaders - Latest News - Public photos (8), vidéos (8), audios (8)

Google map -  newsletter  - Ads (1) - spy  - learders points (12) -  c'est tout :)

Pour les modules - y a tout les modules de base - plus :

Deanos Tools  - http://www.boonex.com/m/Deanos_Tools_V1_6_Dolphin_7_0_Version

AQB Points System  -  http://www.boonex.com/m/Global_Points_System

Access Management - http://www.boonex.com/m/Access_Management_System_2_0_0

Dependent Fields -  http://www.boonex.com/m/Dependent_Fields

Real Estate -  http://www.boonex.com/m/Real_Estate_module_2010_06_02

Et le propriétaire du site veut en mettre d'autre

Pour le site http://gtmetrix.com/ - Je regarde tranquille demain

Le site qui pose problème  -  http://e-naturiste.com/

tu veut dire quoi par  :  effaçant les remarques, les lignes vides et les espaces inutiles

c'est la première fois que j'entend parler de ça  - j'ai encore beaucoup a apprendre :)

I will have tried to change for  mod_php

AlexT -  there is not a small error in the wiki

http://www.boonex.com/trac/dolphin/wiki/HostingServerSetupRecommendations

there are twice  : Server API    CGI/FastCGI

CGI/suPHP
Server API    CGI/FastCGI

FastCGI
Server API    CGI/FastCGI

on my phpinfo - it is written

Server API   CGI

It may be displayed like CGI or CGI/FastCGI, or even some other way depending on FastCGI library.

im trying to understand here how we are to interpret suggestions and recommendations:

FastCGI

PHP is working as a separate server process. Server API in phpinfo() looks the same as in CGI/suPHP mode:

This setup is very flexible. There are different webserver modules which implement the FastCGI interface. Also, PHP has built-in support for this interface. In general this is the best setup which provides great flexibility and speed, but setting up can be a bit tricky. It can be run under any user, so it can be run undera webserver user (nobody or apache as usual) or under a specific user.

It maybe a complicated situation with opcode cache PHP extensions, if there are many processes under different users running. In this case each user will have their own opcode cache - meaning more security from one side, but high memory usage from the other side.

Advantages:

• flexibility
• speed
• security (if properly configured)
• opcode cache extensions support
• enabled by default since PHP 5.3

Disadvantages:

• since there are a lot of ways to implement this setup, it may be difficult to tune it up for a specific situation.
• it may incur high memory usage with opcode cache extensions if there are several PHP processes under different users.

Conclusion: This is the best option in most situations. Just check how your site is functioning - maybe some things can be changed to increase speed and/or the security of your site.

as many can attest, the issue is not MEMORY USAGE, but CPU USAGE which is not even remotely mentioned here.

so what is being stated here is that where initially based on the 'conclusion', one could ascertain, that CGI/FastCGI is the best option, because that is what is stated here.

but what was asked here, and i see it has been danced around once again, how is that 25 users are crippling a server, mod_suphp DSO or any other configuration, no script should handicap a server with a mere 25 users?

I will personally take a stand against the suggestion to install Munin. Munin is a severe resource hog and does not provide adequate information. total piece of shit for a monitoring utility.

I have a similar problem at Host4Web.

I have 4000 members and have 30 or so members online at a time and my site crawls.

It's D 7.0.6 upgraded from D 6.0. something.

I have been looking into CloudFlare and similar.

Anyone has any suggestions?

I am open to chitchatting with other members with similar issues.

 LiteSpeed !!! I defo Recommend this

 cloud is a partial solution. what you need is a scaled network in most cases. i have seen a site with 3K+ with 50+ online at the same time. the site runs fine, but its not a bargain basement server.

and even that machine with 8 Processors and 16GB RAM, could see depletion in performance, and needs to have the platform scaled as traffic grows.

 cloud is an option for many who cant afford colocation of server or even leasing enough servers to serve teh dolphin platform. but the problem you get into even with cloud is I/0 and load balancing.

you really need some resource statistics to see where you are bottle-necking, and address those areas. first and foremost, i would pull the database from the webserver, and set it on something of a decent machine 4 Processors with minimum 4GB RAM, then the database can use whatever resources are there.

as has been stated on here that there are many modules that query the database every nth/sec and this is a load by itself. even inactive members (fake profiles) generate load on the database.

so there is not really a cut and dry solution to hosting dolphin and just as each site is a unique entity, so is the hosting requirement for each. and without somebody available with server knowledge and networking knowledge, then we see a trend in site owners facing issues of complexity.

This can be resolved. But a detailed website and database analysis is required to use a solution.

Your load is high, there is something that is running that steals your cpu.

-> Cpu(s): 84.6% us, 13.4% sy, 0.0% ni, 1.8% id, 0.0% wa, 0.0% hi, 0.2% si

So, 85% is used by 'users' and 13.4% by the system and you are woundering why your site is slow ?

Your swap is low, meaning that you are not running out of memory and with 2Gb cached you are fine with that so it's not a out of memory issue here.

I would check what takes that insane amount of cpu process in the first step, it might be temporary of course since you might have video re-encoding running behind.

To get the feeling of the machine - the best way is to let someone with machine knowlege and server tuning to take a peak at your machine before changing anything of your sites / apache / php configurarion so you can rule out that it's not the system and then focus on the apache / php settings.

You should also install some kind of apc/memcached solution too so you can use shared memory to store temporary objects and save some disk io and get a faster respons on your server.

Contact me if you want me to take a peak at your server, i wont charge you a dime for it.

Check what Mike said about me when I helped him with his server if you feel worried about me.

ArgonX. I need a quick solution to my speed issues too.

I have D 7.0.6 in Host4Web VPS (the highest one).

I have over 4000 members with about 30 active people online at a time. I expect the traffic to rise dramatically in a next month after a major ad campaign.

I need to prepare for it.

I am trying to work with a couple of guys here and Host4Web for solutions.

Host4Web suggested LightSpeed Server.

@DosDawg, I found you answer particularly interesting.
Everyone needs a slightly different  solution.

And that's why I would like to speak to someone who REALLY has the knowledge.

Of course, I am willing to pay a fee for diagnosis and consultations if the price is right. 

I recommend Litespeed and CloudFlare.

Never tested lightspeed, the progress of admins who knows their way around uses to get from Apache to lighttpd and then lightspeed and finaly ends up with nginx, i guess the complex of setting up nginx with cgi/php is the step that many people fears and stick to lightspeed. Anyone running/tested g-wan ?

 @JoeWa

Host4Web has suggested LiteSpeed to me.

1. Can you use Litespeed for Boonex without breaking anything?

2.  Can you use BOTH Litespeed and CloudFlare?

Most of my members are in Asia. The site is hosted in US.

any solution?

I'm using LiteSpeed of hostforweb VPS server its really fast, and u will love it.

It's the wrong thread to write in but bitch slap me admins for doing it.

I now know why lightspeed seems to be a good choise, simple is that it can read apache config files right out of the box and should be an easy replacement for apache but if you still looking for more performance and feel that you don't need a controlpanel to help you with diffrent tasks with your webserver:

http://turnkeye.com/blog/nginx-vs-litespeed-test-magento/

If anyone knows some performance charts between LightSpeed vs Nginx, please send me message about it, just intresting to read.

 quite honestly, i have ran apache | nginx, for something that is going to run one instance of a program, then configuring nginx could and thats a doubtful could have a slight performance advantage compared to apache. 

though, the time it takes configuring nginx, and keeping it updated and optimized, may not be worth the effort. 

 as you mention, for those who dont need a control panel, a nicely tuned *nix with all applications and modules compiled from source will give you a nice performing environment. but considering that many, who are attempting to run a website are not interested in server configuration, and would run if you told them they had to do the config as a prerequisite to hosting a site. 

what are the components of a server:

hmmmm

i might even miss some on this one

apache

php

mysql

mailserver

DNS

bind

spamassassin

dovecot

imap

ftp

so there is much to consider when doing a contrast comparison of apache webserver (with a control panel) and a webserver with nginx | lightspeed

anywho, thats my diagnosis. 

Hi all,

I do not recall how often I wrote about this...we have HFW dedicated Quadcore, 500GB + 2 aditiional 120 and 200 GB drives for MySqL and DB, 8 GB RAM, running on Lite Speed, server fine tuned  (bought a pack for that here at unity market plus some extras).

With more than 2.000 members, peak time always more than 80 online members, moving to LiteSpeed did improve a litle but...it is still sometimes painfully slow...we never crashed again though..

Regards

I have close to 5000 members with about 40 online at busy times. I have VPS -4 at Host4Web.

My site started slowing down and now I am getting LiteSpeed also.

You said "Moving to LiteSpeed did improve a little bit".

That worries me. I thought I was going to see the site flying ....

First before making an argument about what webserver is best, it all comes down to one boiling point - the software you are running.

Best optimization is not getting a better box, but instead try figure out what parts of dolphin that is not very well written to gain speed. What parts of Dolphin could/should be cached, special in shared memory and avoid running same sql query twice. Why dolphin can't be scaled to diffrent hostnames even if you can if you look in the header.inc.php, i tried to setup vhosts, pointing to save directory just to get the hits spead over many more hostnames, so far it's the flags and my banner that uses the variables in header.inc.php, most modules that serves matrials uses the $url as paramter and ignore that there is another variable it should be set to so start with figure out how to optimize dolphin and you will gain a lot more speed.

Another example, protecting the pictures by letting php serves them and do sql queries ? Not smart imho, simple let it be urls direct ot the pictures and make use of the site['mediaImages'] variable so we can setup those to another vhost - atleast let US make the choise not boonex.

I can continue on the subject but as long as we only have the tools Boonex are giving us and we simple have to start code / change the code to make things faster it's faster to buy one more machine or buy a bigger one.

A good start woud be to be able to scale requests on several hostnames, then dont use php to serve an image so you can use a front proxy like lightty / nginx as fron to apache or exchange with lightspeed. Store data in compiled ready php files like user profiles instead of making more unnessery sql lookups .. etc..

Coplight all spelling errors.. ;)

 I guess I wonder the same question. Can you actually use both Litespeed and CloudFare on the same setup, or is it basically using one or the other?

LiteSpeed and CloudFlare are two different things. LiteSpeed is commercial web server software used in preference, by us, to Apache which effectively doubles the capacity of your server. CloudFlare is a website that routes your DNS servers via theirs to weed out any IP/country blocks, to cache your site, save on bandwidth and to intercept attacks/threats. When we changed from Apache to LiteSpeed it was very simple and there was very little downtime. The speed increases and reliability of LiteSpeed proved its worth immediately. Check out this comparison list of LiteSpeed vs. Apache if you need further convincing.