Re: Loading date takes a long time after replication

[Raj Shekhar]

In infinite wisdom Sairam Krishnamurthy  wrote:

> [1  ]
> All,
> 
> I have a situation. We have a very large database(gigabytes). When we 
> load the data in to the table, it will be huge again (20 million rows). 
> So in order to get good backup we set up a replication(master-slave 
> setup). But now, because of this setup, loading into the table takes 
> hours which will be generally done in a few minutes otherwise.

What part of the system is busy the most when you load the data - is it
the CPU or the disk or the network?  Replication should not slow down
the speed of the insert, this might just be a red herring and the
problem might be somewhere else.
 
-- 
Raj Shekhar
-
If there's anything more important than my ego around, I want it
caught and shot now.
- 
Read the latest at my blog: "Humor in the bookstore" 




-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org

Re: MySql - crashes daily

[Raj Shekhar]

In infinite wisdom Basil Daoust  wrote:

> Any help greatly appreciated.
> 
> Our mysql is restarting a LOT!
> Here is what is in the log, it doesn't seem to give much help.
> 

Do you have the coredump from this crash?  If yes, can you load the core
dump into gdb and run "bt" (backtrace) and see what it produces?

Check this link to see what steps are required
 


 
-- 
Raj Shekhar
-
If there's anything more important than my ego around, I want it
caught and shot now.
- 
Read the latest at my blog: "Humor in the bookstore" 




-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org

Re: Loading date takes a long time after replication

[Sairam Krishnamurthy]

Thanks Guys. Let me check these options and will get back with the 
results. Thanks again.


Thanks,
Sairam Krishnamurthy
+1 612 859 8161


On 12/06/2010 04:47 AM, Ananda Kumar wrote:

Also, make sure your /tmp folder is on a separate and fast disk.
We had similar issues and we moved /tmp folder from Local to SAN 
storage and it was quite fast.


regards
anandkl

On Mon, Dec 6, 2010 at 4:10 PM, Johan De Meersman > wrote:


Are you saying that mass inserts go much slower now that you've set up
replication? In that case, I suspect you have your binlogs on the
same disk
as your data.

Put the binary logs on separate disks, and you'll notice a
dramatic increase
in performance.


On Mon, Dec 6, 2010 at 7:17 AM, Sairam Krishnamurthy
mailto:kmsram...@gmail.com>>wrote:

> All,
>
> I have a situation. We have a very large database(gigabytes).
When we load
> the data in to the table, it will be huge again (20 million
rows). So in
> order to get good backup we set up a replication(master-slave
setup). But
> now, because of this setup, loading into the table takes hours
which will be
> generally done in a few minutes otherwise.
>
> Is there a workaround for this? We really don't want to wait for
hours for
> the table to be loaded. Should we abandon replication for this?
Any pointers
> ?
>
> --
> Thanks,
> Sairam Krishnamurthy
> +1 612 859 8161
>
>


--
Bier met grenadyn
Is als mosterd by den wyn
Sy die't drinkt, is eene kwezel
Hy die't drinkt, is ras een ezel

Tüzifa fabrikett zsákosszén

[brikettnagyker . hu]

TÜZIFA - FABRIKETT - ZSÁKOSSZÉN 
 Meghozzuk az otthon melegét.
   www.tuzelonagyker.hu


Tisztelt Hölgyem/Uram .

Engedje meg hogy figyelmébe ajánljam kínálatunkat.

Nálunk megtalálja a megoldást, ha...

  -  Ön tüzelõt keres a családi háza gazdaságos, kényelmes és biztonságos 
fûtésére a fûtési szezonra.  
   Kattintson a következõ linkre:   
http://www.brikettnagyker.hu/content/f%C5%B1tse-otthon%C3%A1n-gazdas%C3%A1gosan-k%C3%A9nyelmesen-%C3%A9s-biztons%C3%A1gosan


  -  Ön kereskedõ, és megbízható beszerzési forrást keres, vagy hozzákezdene a 
háztartási tüzelõanyagok forgalmazásához.
   Kattintson a következõ linkre: 
http://www.brikettnagyker.hu/content/az-%C3%B6n-megb%C3%ADzhat%C3%B3-beszerz%C3%A9si-forr%C3%A1sa-h%C3%A1ztart%C3%A1si-t%C3%BCzel%C5%91anyagok


  -  Ön ipari felhasználó (Közintézmény, intézmény, üzem fûtésére, fóliasátor 
fûtése)
   Kattintson a következõ linkre: 
http://www.brikettnagyker.hu/content/int%C3%A9zm%C3%A9nyek-f%C3%B3li%C3%A1sok-ipari-felhaszn%C3%A1l%C3%B3k-t%C3%BCzel%C5%91-besz%C3%A1ll%C3%ADt%C3%B3ja

Ez egy egyszeri alkalommal kiküldött levél, a továbbiakban nem fogjuk zavarni 
levelünkkel, amennyiben ön nem íratkozik fel hírlevelünkre. 
Elnézést ha levelünkkel zavartuk.

Tisztelettel:
Tokaji László
Földvár-Táp Kft  Tüzifa , Fabrikett , Zsákos szén
5430 Tiszaföldvár   Meghozzuk az otthon melegét.
Döbrei J.út 125-127. www.brikettnagyker.hu 
i...@tuzelonagyker.hu
www.tuzelonagyker.hu

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org

Using MySQL in the Cloud? Help us by answering a short survey and win a T-shirt

[Avigail Ofer]

Hello!

With the rise of cloud computing and "big data", database scalability issues 
are becoming critical to the growth and success of many applications. Xeround's 
MySQL Cloud Database is an elastic, always-on database that lets you run your 
existing MySQL-based application in the cloud.

As we develop our Database-as-a-Service cloud offering, we'd like to hear from 
you:
Please help us by answering a few questions about your experiences with 
databases in the cloud.

Complete the survey and receive a free T-shirt!
http://xeround.com/developers/mysql-in-the-cloud-survey/

Thanks!

Re: Loading date takes a long time after replication

[Ananda Kumar]

Also, make sure your /tmp folder is on a separate and fast disk.
We had similar issues and we moved /tmp folder from Local to SAN storage and
it was quite fast.

regards
anandkl

On Mon, Dec 6, 2010 at 4:10 PM, Johan De Meersman wrote:

> Are you saying that mass inserts go much slower now that you've set up
> replication? In that case, I suspect you have your binlogs on the same disk
> as your data.
>
> Put the binary logs on separate disks, and you'll notice a dramatic
> increase
> in performance.
>
>
> On Mon, Dec 6, 2010 at 7:17 AM, Sairam Krishnamurthy  >wrote:
>
> > All,
> >
> > I have a situation. We have a very large database(gigabytes). When we
> load
> > the data in to the table, it will be huge again (20 million rows). So in
> > order to get good backup we set up a replication(master-slave setup). But
> > now, because of this setup, loading into the table takes hours which will
> be
> > generally done in a few minutes otherwise.
> >
> > Is there a workaround for this? We really don't want to wait for hours
> for
> > the table to be loaded. Should we abandon replication for this? Any
> pointers
> > ?
> >
> > --
> > Thanks,
> > Sairam Krishnamurthy
> > +1 612 859 8161
> >
> >
>
>
> --
> Bier met grenadyn
> Is als mosterd by den wyn
> Sy die't drinkt, is eene kwezel
> Hy die't drinkt, is ras een ezel
>

Re: Loading date takes a long time after replication

[Johan De Meersman]

Are you saying that mass inserts go much slower now that you've set up
replication? In that case, I suspect you have your binlogs on the same disk
as your data.

Put the binary logs on separate disks, and you'll notice a dramatic increase
in performance.


On Mon, Dec 6, 2010 at 7:17 AM, Sairam Krishnamurthy wrote:

> All,
>
> I have a situation. We have a very large database(gigabytes). When we load
> the data in to the table, it will be huge again (20 million rows). So in
> order to get good backup we set up a replication(master-slave setup). But
> now, because of this setup, loading into the table takes hours which will be
> generally done in a few minutes otherwise.
>
> Is there a workaround for this? We really don't want to wait for hours for
> the table to be loaded. Should we abandon replication for this? Any pointers
> ?
>
> --
> Thanks,
> Sairam Krishnamurthy
> +1 612 859 8161
>
>


-- 
Bier met grenadyn
Is als mosterd by den wyn
Sy die't drinkt, is eene kwezel
Hy die't drinkt, is ras een ezel