big mailing lists / slashdotable hosting

Bill McGonigle bill at bfccomputing.com
Wed Mar 28 19:19:05 EDT 2007


I'm wondering if anybody has experience running big mailing lists.   
Sure, I run a bunch of mailman lists, but I'm looking at what it  
would take to run a mailing list with a quarter million subscribers.   
(all opt-in, non-spam, properly run).

About the only thing I know is the project will run on linux (or  
maybe BSD, if needed) machines.  There are five aspects I'm thinking  
about:

1) software - I hear mailman can scale that big with a mysql  
backend.  Others wax poetic about mj2.  Lyris is commercial software  
that appears to be big in this space.  I used it a decade ago before  
mailman was groovy for a small list and it seemed fine.  Some, like  
lyris, seem to be built with statistics in mind; mailman appears  
stagnant and threatening to become a Zope app, but there are lots of  
patches for it - support for those patches could be an issue.
2) facility - in-house (bigger Internet connection) vs. co-locating  
vs. outsourcing.  The outsourcing guys seem to want $1-$3 per  
thousand messages or more, which is a nice business to be in, I  
think, but quite expensive per bit.  in-house has advantages as I can  
do things like rate-limiting to reduce the load, but:
3) blacklists - I expect with that many subscribers enough will have  
forgotten they opted in that blacklists will start listing whatever  
server sends mails.  I've seen some pay-for-cartels to gain  
credibility, others have said it takes 30 days for a server to gain a  
good reputation (I have no idea what that means).  Is it a full time  
job to babysit such a list and get off of blacklists?
4) image hosting - the mails will have image links in them because  
apparently lots of people like to see pictures (I always look at the  
text alternative myself...).  I expect to see 100GB or so of image  
traffic, peaking up to 50Mbps.  Can I load this up on a shared hoster  
offering 3TB per month of transfer for $12 or will they kill anything  
that approaches those limits?   I'd like to find a hoster that brags,  
"we can handle a Slashdotting", because this would be large, bursty,  
very intermittent traffic.  Akamai-type solutions look to be too high- 
end for this task.
5) everything else I didn't think to ask

I'd appreciate feedback on any of those items.  If anybody has  
actually done this soup-to-nuts before, I'm interested in hiring that  
person for a short consulting gig.

Thanks,
-Bill

-----
Bill McGonigle, Owner           Work: 603.448.4440
BFC Computing, LLC              Home: 603.448.1668
bill at bfccomputing.com           Cell: 603.252.2606
http://www.bfccomputing.com/    Page: 603.442.1833
New Blog: http://blog.bfccomputing.com/
VCard: http://bfccomputing.com/vcard/bill.vcf



More information about the gnhlug-discuss mailing list