Scribd Logo
Importer

Bienvenue sur Scribd !

  • Scribd Architecture Overview

    Transféré par

    scribdmonitoring
    19M vues19 pages
    Scribd.com is a social document sharing site that hosts over 14 million documents and receives 53.5 million visitors per month. It uses a Rails architecture with Nginx to deliver static content and handle file uploads, HAProxy for load balancing application servers, Squid to cache document pages, MySQL for data storage, Memcached, and Sphinx for search capabilities. Scribd also utilizes Amazon S3 for file storage and EC2 for document conversion.

    Description originale:

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Formats disponibles

    PDF, TXT ou lisez en ligne sur Scribd

    Avez-vous trouvé ce document utile ?

    Ce contenu est-il inapproprié ?

    Signaler ce document
    Scribd.com is a social document sharing site that hosts over 14 million documents and receives 53.5 million visitors per month. It uses a Rails architecture with Nginx to deliver static content and handle file uploads, HAProxy for load balancing application servers, Squid to cache document pages, MySQL for data storage, Memcached, and Sphinx for search capabilities. Scribd also utilizes Amazon S3 for file storage and EC2 for document conversion.

    Droits d'auteur :

    Attribution Non-Commercial (BY-NC)
    Téléchargez comme PDF, TXT ou lisez en ligne sur Scribd
    Signaler comme contenu inapproprié
    19M vues19 pages

    Scribd Architecture Overview

    Transféré par

    scribdmonitoring
    Scribd.com is a social document sharing site that hosts over 14 million documents and receives 53.5 million visitors per month. It uses a Rails architecture with Nginx to deliver static content and handle file uploads, HAProxy for load balancing application servers, Squid to cache document pages, MySQL for data storage, Memcached, and Sphinx for search capabilities. Scribd also utilizes Amazon S3 for file storage and EC2 for document conversion.

    Droits d'auteur :

    Attribution Non-Commercial (BY-NC)
    Téléchargez comme PDF, TXT ou lisez en ligne sur Scribd
    Signaler comme contenu inapproprié
    sur 19

    Scribd.

    com Architecture Overview


    X1 Tech Talks Dmytro Shteflyuk 04/09/2009

    Who Am I?

    Ruby developer at Scribd.com Lazy blogger at kpumuk.info Experienced in Ruby & Rails, ASP.NET, MySQL, Sphinx, etc. Author of several projects Sphinx Ruby API maintainer

    What Is Scribd.com

    Social document sharing The largest Rails site over the Net 65th place on Quantcast (before Digg) 53.5M visitors, 178M page views 10.5M users, 14M document, over 1PB 15 app, 17 db, 7 search, 3 web, 4 proxy boxes

    Online Viewer

    Groups

    Partners

    Desktop Uploader

    The Big Picture

    Nginx

    Delivers static content Handles file uploads Selects app cluster (main, api, etc) Forwards doc page requests to Squid Forwards all requests to HAProxy

    HAProxy

    Performs load balancing among application servers Thats all - as easy as pie :-)

    Squid

    Caches all document pages for bots and anonymous users Forwards requests to HAProxy Allows gracefully clear whole cache Clears cached pages by request (HTCP) Handles 90% of Scribd traffic!

    MySQL

    All writes to master Almost all reads from slaves. Texts are in separate DB (sharded) All tables are in InnoDB Mysql 5.0 / 5.1 with Percona patches

    Application Boxes

    Apache + Passenger (Ruby on Rails) Memcached Monit (we are looking for another monitoring tool)

    Sphinx Search Boxes

    Used for browsing, private documents search, extended site search, API search We are using Google Custom Search Engine, but users are able to switch to internal search engine Index consists of many small datebased chunks for fast indexing

    Amazon Services

    Amazon S3 for images and documents Each document in several formats Background task for doc backups Amazon EC2 for documents converting

    What Are You Talking About?

    Ask Your Questions


    It was just an introduction More information is coming

    Contacts

    Email: kpumuk@kpumuk.info Blog: http://kpumuk.info/ Twitter: http://twitter.com/kpumuk Github: http://github.com/kpumuk Scribd: http://www.scribd.com/kpumuk

    We Are Hiring

    Advanced knowledge of Ruby on Rails Java, .NET, Python Gurus are welcome Experience with heavily loaded apps Deep understanding of MySQL and RDBMS Ability to use Google and... Google etc.

    Vous aimerez peut-être aussi