archive-info.com » INFO » A » ALBERTON.INFO

Total: 86

Choose link from "Titles, links and description words view":

Or switch to "Titles and links view".
  • Lorenzo Alberton - Articles - Kafka proposed as Apache incubator project
    my eyes Hadoop support distributed and persistent queue extremely high throughput hundreds of thousands of messages per second At DataSift we deal with several thousand messages every second and that means that we need to move data around really really fast For a while we ve been using Redis internally for the intermediate queues perhaps abusing its pub sub support Redis has served us well so far but it showed several minor issues and we ve gradually replacing it with real message systems or to be more precise with a high performance duo Kafka and 0mq I m going to talk about how we use 0mq and the patterns that are more appropriate for each use case in another article Today I m happy to read that Kafka has been proposed as an Apache incubator project Since November it s come a long way after the native Scala and Java clients I contributed the first PHP client and now there are clients in Python Ruby C Clojure Node Js This week my colleague Ben wrote a C producer that we ll contribute soon Kafka is still a young project but it s maturing fast and we re confident enough to use it in production as a matter of fact we ve been using it for months now in front of our HBase cluster and to collect monitoring events sent from all our internal services We chose Kafka especially for its persistent storage which is essentially a partitioned binary log but we plan to do some analytics via its support for Hadoop soon And its distributed nature coordination between consumers and brokers is done via Zookeeper makes it very appealing too We encourage everyone to try it out and vote for it by subscribing to the general incubator mailing list If

    Original URL path: http://www.alberton.info/kafka_apache_incubator.html (2016-04-23)
    Open archived version from archive


  • Lorenzo Alberton - Articles - NoSQL Databases: What, When and Why (PHPUK2011)
    store All NoSQL databases are not created equal RDBMS databases are often blamed to be a one size fits all solution to all problems NoSQL databases are the exact opposite their extremely rich variety and diversity in the problems they re trying to solve and in the approaches they have is what makes them so successful in today s complex world So you can have products like Cassandra that are appropriate for full text indexing HBase that s perfect for low latency high write throughput and mostly offline processing CouchDB that s great for a small number of pre defined queries thanks to its materialised resultset views MongoDB that s good for more dynamic queries while retaining some data structure and then you have Graph databases that are thousands of times more efficient than all the others in expressing and traversing complex relationships But put any of them out of their comfort zone try asking questions they re not optimised for and see what happens Hint it s going to hurt badly And if you care about your data have a look at their persistency model too That s why it s so important to understand what each of them can and what they can t do and their architecture While almost all the NoSQL databases focus on scaling they do so in a very different way Some of them scale well with the growth in transaction volume e g number of concurrent requests some scale well with the growth in data set size some are good at both albeit sacrificing either the data model or the type of questions you can ask them some are good at neither and only focus in raw speed Related to the previous point a fact that s often overlooked not all the NoSQL databases are distributed The power of K V stores implementing consistent hashing is they scale beautifully with data size growth at the cost of a very poor data model and the same is true for BigTable derivates that sit on top of a distributed filesystem like GFS or HDFS Others can t be considered distributed at all for instance CouchDB and I would say the entire graph databases category focus on vertical scalability in the number of transactions either via replication or single node efficiency but do not distribute the data itself across many nodes As a side note if you re interested in distributed systems I can suggest reading Jeff Darcy s blog No I won t point you to any specific post just read the entire blog archive And then read it again and again It s that good Finally most people seem to make the jump from it s so cool to it must be easy Well it s not always the case starting from the language itself I bet many NoSQL products would love to have an SQL like query syntax if only they could a fact confirmed by the rise of interfaces like Pig and

    Original URL path: http://www.alberton.info/nosql_databases_what_when_why_phpuk2011.html (2016-04-23)
    Open archived version from archive

  • Lorenzo Alberton - Articles - PHPNW10 slides and new job!
    The room was maybe a bit small and it maxed out pretty soon some delegates told me they wanted to attend but couldn t get in Apart from that the conference was excellent interesting talks old and new friends and impressive organisation Well done everyone For those interested I published my slides online sorry for the delay I ve been trying for a week but SlideShare didn t seem to be working you can find them on my Talks page or on SlideShare I d really appreciate if you could leave your comments on Joind in if you haven t already New city new job I m also happy to say that I recently changed job I left Ibuildings to work with a team of amazing and dedicated people on DataSift in Reading UK I m very excited about the challenges ahead and about having to play with large scale data filtering and content curation Moving house meant not having internet access for a couple of weeks eek so please bear with me if you wrote me and you re waiting for an answer Some positive side effects of having no internet access more time to read books play music and a pleasant surprise BBC4 Radio highly recommended Follow lorenzoalberton 5 responses to PHPNW10 slides and new job Derick Rethans 19 October 2010 09 31 Hi Congrats on the new job You might want to update your bio on the right though cheers Derick LornaJane 19 October 2010 17 26 Lorenzo great to see you in Manchester congratulations on the new job and welcome to the club of radio 4 listeners Stefan 20 October 2010 10 52 wow Lorenzo congratz on the new job new challenges can often be very refreshing especially if they include a move fortruth 20 October

    Original URL path: http://www.alberton.info/phpnw10_summary_and_new_job.html (2016-04-23)
    Open archived version from archive

  • Lorenzo Alberton - about
    technical papers I read this weekend Google Dremel NoSQL comparison Gossip Protocols Historical Twitter access A journey into optimising Hadoop jobs Kafka proposed as Apache incubator project NoSQL Databases What When and Why PHPUK2011 PHPNW10 slides and new job Tags AJAX Apache Book Review Charset Cheat Sheet Data structures Database Firebird SQL Hadoop Imagick INFORMATION SCHEMA JavaScript Kafka Linux Message Queues mod rewrite Monitoring MySQL NoSQL Oracle PDO PEAR Performance

    Original URL path: http://www.alberton.info/search (2016-04-23)
    Open archived version from archive

  • Lorenzo Alberton - Articles - The Art of Scalability - DPC10 wrapup
    subject and whether it was right for this audience As my colleague Ian said developers usually expect two kind of talks either a story of how company X solved the problem thanks to technology technique Y or a series of concrete tips on how to implement database clustering or session data replication for instance And judging by some of the comments he was absolutely right At the same time he and others supported the approach since almost nobody treats the topic in a comprehensive way and very few mention the importance of people and processes when scaling an application The available time didn t allow me to add as much depth or examples as I would have wanted but I think I still managed to give the audience a bounty of ideas and solid architectural principles which they can research and read about later I can t recommend M L Abbot M T Fisher s book enough which was the main source for this talk And I stand by the decision of describing the importance that roles and organisational structure have on any scale related effort and how the right or wrong processes can make or break it This is a perspective we tend to forget too often so even stating the obvious can t hurt On this same thread I refer to Chris Shiflett s excellent keynote technology represents a minimal part of the bigger picture and it s our responsibility as developers yes programmers too to understand that Anyway I also received a lot of positive comments and to those that were a bit disappointed by the lack of concrete examples I might return to the topic with much more depth in the near future so stay tuned In the meanwhile you can find the slides of my

    Original URL path: http://www.alberton.info/talks_dpc_2010_wrapup.html (2016-04-23)
    Open archived version from archive

  • Lorenzo Alberton - Articles - PHP UK 2010: RDBMS in the social networks age
    the social networks age Slides My talk RDBMS in the social networks age was in the first slot after the keynote so I could get over with it soon and enjoy the rest of the conference According to the comments and the tweets it was very well received I was a bit worried at first because the topic was highly technical and not easy to follow but the audience was kind enough to bear with me You can find the slides at my talks page or on SlideShare If you attended please leave your comments on Joind in Follow lorenzoalberton Related articles Trees in the database It sure ain t no CouchDB The Art of Scalability DPC10 wrapup NoSQL Databases What When and Why PHPUK2011 9 responses to PHP UK 2010 RDBMS in the social networks age Xaprb 28 February 2010 01 56 Very nice examples Recursive and windowing queries can really be mind bending LornaJane 28 February 2010 18 29 I thought I might be out of my depth with your talk but I understood a lot of the concepts you showed a nice talk well delivered PHP jobs 11 September 2010 12 37 Thanks for the presentation Your talk on RDBMS in the social networks age was really interesting Coralife Lights 30 December 2010 22 34 Good article thanks for writing and sharing with us I really appreciate it Sorella 31 December 2010 15 32 Lorenzo Any chance of you coming to the States to give a similar talk Keep us posted if there are any plans for that Claire 13 January 2011 04 03 I ve missed to join that conference But I ve checked your presentation and slide they we re really good Looking forward to hear more from you Manuel A Reed 21 June 2011

    Original URL path: http://www.alberton.info/talks_phpuk_2010_wrapup.html (2016-04-23)
    Open archived version from archive

  • Lorenzo Alberton - Articles - Profiling PHP applications with XHProf: the path to scalability
    new job Profiling PHP applications with XHProf the path to scalability PHP Tutorial Performance Scalability Profiling 01 December 2009 22 22 3 comments This morning my latest article on how to use XHProf effectively has been published on Ibuildings TechPortal If you need to optimise your PHP application and improve its performance and scalability you might find it interesting The full article after the jump Profiling PHP applications with XHProf Follow lorenzoalberton Related articles Profiling PHP Applications with XHProf 3 responses to Profiling PHP applications with XHProf the path to scalability Robin 02 December 2009 19 50 How amusing to see PHP and the path to scalability mentioned in a single title If you want to scale better don t dig yourself deeper into the world of PHP devsmt 11 June 2010 09 30 Lorenzo ho scoperto oggi il tuo blog e il framework seagull e li trovo entrambe di qualità notevole volevo ringraziarti per il lavoro e l impegno che condividi con noi alcune informazioni che ho trovato spiegate in modo affrontabile solo sul tuo blog mi hanno tolto delle belle patate bollenti sei un grande complimenti Michael Triplett 24 June 2011 13 31 Using XHProf can be difficult

    Original URL path: http://www.alberton.info/profiling_with_xhprof_the_path_to_scalability.html (2016-04-23)
    Open archived version from archive

  • Lorenzo Alberton - Articles
    PostgreSQL Firebird SQL Oracle SQL Server 26 October 2009 Speaking at the PHP Barcelona Conference 2009 Talk Trees in the Database Advanced Data Structures New article Graphs in the database SQL meets social networks Database PostgreSQL Firebird SQL Oracle SQL Server Tutorial Data structures 7 September 2009 Graphs in the database how to store a graph data structure in a DBMS and answer the most common queries typical of social networks like You might also know or You might also like or How you are connected to XYZ degrees of separation Graphs in the database SQL meets social networks Database PostgreSQL Firebird SQL Oracle Data structures 7 September 2009 How to store a graph data structure in a DBMS and query it to solve many of the problems of social networks Create a video preview as animated GIF with FFmpeg and PHP SPL PHP SPL Tutorial Imagick 31 August 2009 Extract frames from a movie and create a preview as animated GIF using PHP SPL Imagick and FFmpeg Trees in the database It sure ain t no CouchDB PHP Database PostgreSQL Firebird SQL Oracle SQL Server Data structures 27 June 2009 Wrap up of the Dutch PHP Conference Amsterdam 11 13 June 2009 Speaking at the Dutch PHP Conference 2009 PHP Database PostgreSQL Firebird SQL Oracle SQL Server 10 April 2009 Speaking at the Dutch PHP Conference 2009 Talk Trees in the Database Advanced Data Structures Zend Framework mod rewrite and public dir in shared hosting PHP Zend Framework mod rewrite 15 February 2009 A quick tip on how to deal with Zend Framework directory structure and the public document root directory in most shared hosting accounts using mod rewrite and an htaccess file Book review TYPO3 Extension Development by Dmitry Dulepov PHP PEAR TYPO3 Book Review 8 January 2009

    Original URL path: http://www.alberton.info/articles/index/page/2 (2016-04-23)
    Open archived version from archive



  •