mysql master slave config possible?

Hi

We have an erotic website running the boonex dolphin software and it is rediculously slow.
We have approx 10.000 users now and approx 200k visitors per day.

Running on 15 webservers and a dual quad core mysql server with 24 gig memory and it still manages to max out the cpus of the mysql server.
The webservers have a good load and can handle everything ok (only 180mbit/s for the bunch)

Is there an option in the software to use a master/slave/slave/etc configuration or is the software just not able to handle "heavy" traffic? (we just started 2 weeks ago, so i'm quite worried about more growth)

Thank you

Quote · 7 Oct 2010

Hi:

Did you solve the problem? I have the same problem.

Quote · 29 May 2011

I would be interested in knowing what you have to do when your site approaches traffic like that.  Do you really need 15 webservers?   Would a VPN cut it? 

Quote · 30 May 2011

so you are running 15 servers and only one of them is a sql server? what are you using for load distribution, and why is your database not scaled as well? and is mysql maxing the CPU on all CPU's or how are you getting your statistics on that?

 

also what have you done for tuning mysql?

 

what do you have in your my.cnf?

 

what modules are running on the dolphin platform?

When a GIG is not enough --> Terabyte Dolphin Technical Support - Server Management and Support
Quote · 30 May 2011

 hey rob, i think you got your acronyms mixed up. VPN was that supposed to be VPS bud?

 

if so then, to answer your question, NO. the problem with scaling a site like such as dolphin, is the requirement not only for viable resources, but also I/O, with VPS, you can scale, but what happens is you end up chasing your tail trying to keep up with the network because of I/O failure.

I would be interested in knowing what you have to do when your site approaches traffic like that.  Do you really need 15 webservers?   Would a VPN cut it? 

 seems they have gone the correct direction in scaling, but need more information on the database server to really be able to ascertain what needs to be done. there is really more to it, then just loading up a server on the internet and throwing a connection to it.

 

When a GIG is not enough --> Terabyte Dolphin Technical Support - Server Management and Support
Quote · 30 May 2011

Yes, I meant VPS.  It is academic - my sites are still little.

Quote · 30 May 2011

Install SSD Drives on your mysql server so you can cut some cpu power by reducing your IO load.

Since Dolphin don't have support for multiple mysql you can't use 2 servers like a replication where you have one read-only server (B) and one master mysql server (A) where you only does the writes to.

Solution would be to look on mysql cluster instead, they have built in load balancer but i think mysql-cluster needs atleast 3 machines to start with, 2 nodes and one monitor/load balancer.

In your case i would check how your current setup is, change your webserver to nginx/g-wan and try reduce load on your webservers so you could cut them down to say 10 instead of 15 and build a mysql cluster of
the remaining 5.

If Dolphin had support for a write-only and one read-only setup, you could easy installed a slave to your master server and have all your read-only (selects) from the slave while you had all your remaining queries to your current mysql server to offload it.

Preferd would be to have a local mysql server on each server so you could more quickly read data and improve your site performance while your master replicates to all your 15 webservers.

Since this is a major change in the Dolphin code, i would start to replace your harddrives on your dedicated mysql server to SSD drives (where you have your mysql data) and start think how you would like to progress forward. You should also see how you could improve your sites to use memcached to store database results in too, so you can avoid as much select queries as possible. Use of APC might work too, but then each machine will have the same data stored on each of them, memcached can be installed as a service so you could read over the network to fetch the data but you will also have a delay since you are doing this over the network, it's all about how fast you want your sites to go and how much memory you can spare on each server for APC.

It's hard to just say what exactly you need, so i rather want to look first and speak later how you could improve your system. Please contact me if you like further consulting help.

Quote · 30 May 2011

Doh, in my back head i just rememberd that there is a mysql proxy you could install on each of your webservers and that can distinct between select / other queries so you _could_ use a master / slave configuration, BUT i can't swear by it. Need to check this, was some years ago i was using it and if it still exist.

Quote · 30 May 2011

http://forge.mysql.com/wiki/MySQL_Proxy

Can do load blancing and i also think you can have multiple read-servers so you should be fine by installing a slave to your current setup and have mysql proxy installed on each of your webservers to go via.

If you are using it and put into work, please write about it, would be nice to hear how you scaled your Dolphin.

Quote · 30 May 2011
 
 
Below is the legacy version of the Boonex site, maintained for Dolphin.Pro 7.x support.
The new Dolphin solution is powered by UNA Community Management System.