It is currently 30 Jul 2010, 11:55

All times are UTC + 1 hour [ DST ]




 Page 1 of 1 [ 5 posts ] 
Author Message
 Post subject: GARR mirror update
PostPosted: 15 Mar 2010, 12:59 
Shoulder Surfer

Joined: 12 Mar 2010, 18:09
Posts: 2
Hello, I'm one of the administrators of GARR mirror. I'd like to share some thoughts with you.

First of all, after our main storage fault, reconstruction is in progress. We now have 817GB of data, so we are at 50% of the total content if I remember correctly.

Some critical points I see:

- we are the only mirror: maybe we could try to get some other mirror like heanet or switch. We could act as main rsync site for the other mirrors without any problem.

- number of accesses: this is becoming an issue. We get an extremly high number of connections from single IPs, especially from China. We had to implement a limit of connections per IP in order to not disrupt service not only for rainbow tables, but also for the other mirrors that we host.

It would be nice to find other mirrors and implement something like mirrorbrain (see http://mirrorbrain.org/).... which could give metalinks "for free" in addition to a central distribution point for rainbow tables...

Regards,

Enrico


Offline
 Profile  
 
 Post subject: Re: GARR mirror update
PostPosted: 17 Mar 2010, 12:00 
Developer

Joined: 30 Mar 2008, 15:37
Posts: 847
hi enrico, for of all, tnx for offering this great mirroring service!

total storage for rt's is now 1.7TB at tbhost.eu where you guys mirror from.

i heard from root_ati that he was contacted by a UK university that might want to start a second mirror...

simultaneous connections are a real horror, previous tbhost provider had the same issues (ended up with only offering RT's by FTP and limiting FTP to 2 simultaneous connections, but that won't be an option for you guys i guess).
maybe just block china? :P


Offline
 Profile  
 
 Post subject: Re: GARR mirror update
PostPosted: 24 Mar 2010, 17:15 
Shoulder Surfer

Joined: 12 Mar 2010, 18:09
Posts: 2
Quote:
simultaneous connections are a real horror, previous tbhost provider had the same issues (ended up with only offering RT's by FTP and limiting FTP to 2 > simultaneous connections, but that won't be an option for you guys i guess).


Right now we are quite happy with 3 simultaneous connections per IP. We can deliver 340 Mbps (daily average). The main bandwidth eater is ubuntu, but also rainbow tables have a consistent impact.

We did not receive particular complaints so I assume that the mirror is working well.

Quote:
maybe just block china? :P


To be honest I thought about that, mainly because problematc client beavhiour origintaes from there. But it seems that the 3 connection per IP satisfies both sides.

I know about the UK university: I hope the found funding for a mirror.

Bye,

Enrico.


Offline
 Profile  
 
 Post subject: Re: GARR mirror update
PostPosted: 20 Apr 2010, 17:02 
Shoulder Surfer

Joined: 20 Apr 2010, 16:59
Posts: 1
I have a Bittorrent seedbox with 4TB of storage and a 100mbit connection. I can dedicate up to 2TB and be a "bittorrent mirror"


Offline
 Profile  
 
 Post subject: Re: GARR mirror update
PostPosted: 20 May 2010, 12:11 
Shoulder Surfer

Joined: 06 Feb 2010, 19:13
Posts: 6
Hi All,
have just successfully backed up all tables now, I have however left out the rarred index directories.
Do you need me to back these up as well?
How often do you think I should sync my backup with the garr site?

regards
kerravon
:D


Offline
 Profile  
 
Display posts from previous:  Sort by  
 Page 1 of 1 [ 5 posts ] 

All times are UTC + 1 hour [ DST ]


Who is online

Users browsing this forum: No registered users and 0 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  

cron