Industry Ignorance

Today I let out a dejected sigh after reading a response to my latest post on the Joel on Software message board.  My post was just a reminder about the BostonScalability User Group meeting that takes place next Wednesday the 28th.  I post the meeting announcements on JoS and a good number of people hear about the meetings from the JoS board.  Every month a few new people tell me they found the group through JoS.  So why did I sigh after reading the response to the meeting reminder?

I don’t make any money running the group.  In fact it costs me money.  I do a good amount of planning, coordinating, buying, booking and raffle prize finding for the group.  I love seeing 30+ people show up for our after work meetings.   It’s a lot of work but I do it because I am passionate about emerging trends in application scalability.  It’s a labor of love that I find professionally and personally rewarding.  Like all good geeks I maintain a healthy hobby writing software outside business hours.

I’m interested in building bigger, better software.  Batch applications, database interactions, web applications, CPU intensive algorithims should be as effective as possible.  Effective does not necessarily mean efficient.  Effectiveness is based on price, time-to-market, performance, maintenance cost, etc.  Analyzing these facets is important. The tools used to arrive at the solution are important, too.

BostonSUG has wonderful speakers who generously donate their time to speak at our meetings.  These people come in from all over the country.  Just a few examples, we’ve hosted Orion Letizi and Nikita Ivanov from San Francisco, Billy Newport from Minnesota and Mike Culver from Washington.  We’ve had numerous local speakers who we appreciate just as much as those that fly to see us.  Patrick Peralta, Tom O’Hare and Rakesh Chaudhary had large audiences.  Each of these speakers is an expert in a different facet of building scalable applications.  They are industry leaders in compute clouds, data grids, object caching, streaming media and more.

One thing we haven’t touched yet is building a web site that performs well.  The person that replied to the meeting reminder said:

save your time:
only put strings in session; and only put one item per-user in the session; unless they are doing some heavy form processing.
use native clustering.
put professional load balancer in from.
max pipe.

Thanks.  That is a helpful reply.  It immediately invalidates the hours of insightful discussion we’ve had at past BostonSUG meetings that have spent less than five minutes total dedicated to the problem to which he so generously offers his solution</sarcasm>.

traditional-web-architecture

This is a picture of what is described in the reply post.  As an industry we have known this works for a long time.  That’s why we don’t talk about the architecture depicted by this diagram at BostonSUG.  Sure, we’ll talk about HOW an app server achieve scalability.  We’ll talk about the implementation, not just about using JBoss or Mongrel.  We got a good look inside GridGain.  We had a guided tour around Terracotta.  BostonSUG evokes deeper discussion than “small sessions, load balancer, database cluster, done!”.  You should do that anyway.

Past meetings aside we have a lot to talk about this year.  Rails 3, Java 7, CloudFront, Hibernate Shards, Google AppEngine, tons of topics that push the industry foward.  If you’re interested in evolving and not building the same old software then come to BostonSUG.  If you’re interested in building what we know works (and have known since pre-2000) then it’s not the meeting for you.

I didn’t intend for this to turn into a meeting plug but I might as well include the link to the meeting announcement.  Wednesday January 28, 2009 @ 6 p.m.  IBM Innovation Center Waltham, MA 02451

4 Responses

  1. Nati Shalom wrote on January 23rd, 2009 at 7:03 am:

    Hi Anthony
    Looks like you established an interesting group on one of my favorite topics – Scalability. I’d be happy to assist in which ever way possible.

    I’d recommend looking at the following list of resources that was published by Max Indelicato (my blog included at the top) 17 Distributed Systems and Web Scalability Resources

    WRT to the web scaling diagram that you laid out i’d like to add that some of the challenges that we dealt with recently is how to make web applications dynamically scalable and self healing (without human intervention). Essentially what we did is add an agent in front of the load-balancer that listen for new web-containers. We wrapped the web-containers with SLA driven containers that monitors the load on each container. If a certain web container breached its SLA – a new container is brought up. The agent automatically add this server to the load-balancer which in return split the load to the additional server. Similar things happen when one of the servers stop responding. A new machine with new web-container is brought up automatically to replace the server. In the meanwhile the load-balancer is updated of this change.
    You can see more on that here

    You can see a live demo here

    HTH
    Nati S
    http://www.gigaspaces.com/cloud

  2. Anthony Chaves wrote on January 23rd, 2009 at 10:39 am:

    Hi Nati,

    Thanks for the response. I wasn’t aware of Max’s blog, though I subscribe to some of the others he lists. The presentations were helpful as well.

    What you describe about dynamic scalability is exactly the kind of topic we’d be interested in hearing about at BostonSUG. It takes a concept we’re familiar with and takes it a few steps further. Demos and walk-throughs would make a discussion on this topic outstanding.

    Thanks again, Nati! Hope to see you commenting around here more in the future. I’ve got a lot of interesting topics to write about this year.

    Anthony

  3. Nati Shalom wrote on January 23rd, 2009 at 6:14 pm:

    I’ll be watching your blog closely from now on:) BTW when is your next Boston meeting?
    I’ll be in the east coast in two weeks time (8th of Feb) – if it makes sense I’ll be happy to present on one of the topics – Dynamic scaling on the web tier could be a good candidate if your interested.

  4. Patrick Peralta wrote on January 23rd, 2009 at 9:29 pm:

    Hey Anthony,

    Don’t let the trolls at the JoS forums get you down. Half of them are professional cynics who like to do nothing but bitch about the industry ;)

    Hope to make it out to the meeting next week…

    -Patrick