Digital Edition

SYS-CON.TV
Headnet Improves Drupal Performance and Reliability with TraceView
Not only did Headnet find problems they couldn’t see before, but resolution time dropped

Headnet is a web consultancy firm based in Copenhagen, Demark. Headnet develops and hosts web applications, mainly for government clients, as well as private organizations and NGOs. The company utilizes a broad range of technologies to create custom sites, from CMS-based sites with Drupal and Plone to custom applications in Java and Python. As a one-stop shop for web apps, Headnet is entirely responsible for the creation, modification and upkeep of sites for its customers.

The Challenge
Until November 2012, Headnet relied on “old-school” monitoring tools, such as open-source infrastructure monitoring, to ensure the machines its applications ran on were up to the task. When a problem arose, sometimes they could add more RAM or replace a disk to fix the issue, but more often than not, it was an application issue. In many cases, Headnet engineers were left digging through application logs for days before identifying a resolution.

The Solution:
After installing TraceView, not only did the Headnet team find problems they couldn’t see before, but their resolution time dropped dramatically. “I showed TraceView to one of my colleagues, and he was like ‘Wow.’ It took literally minutes to see issues you could improve with it,” said Anton Stonor, Web Technology Lead at Headnet.

One of the first issues identified by Stonor and his team was a sporadic spike in latency. According to the infrastructure monitoring, there was no problem, and even the application itself seemed to be responding quickly. Looking at the slow requests directly revealed that Apache would occasionally think the backend was down, and those requests would stall in Apache until it re-established the connection. Stonor changed the Apache configuration to eliminate those slow requests, resulting in a much more consistent userexperience.

In another Drupal application, customers complained about a particular page taking two to three seconds to load, but only occasionally. Without a reproducible test case, Stonor’s team struggled to find a fix, as the problem could not be recreated in their environments. With TraceView, they immediately saw that the page in question was synchronously running a maintenance job before rendering the HTML. Moving the job into the background cut the time to consistently less than one second.

Throughout their projects, Stonor’s team found more subtle issues into which they previously had no visibility. In their SQL DBs, not only were there slow queries, but “there would be either way too many queries or [queries] would be fetching too-large data sets. In TraceView, you could see exactly the amount of queries and which one of them was taking a long time, and what code is to blame,” according to Stonor. TraceView also illuminated the impact of slow external calls. In one case, an API call to a reverse DNS lookup service was to blame, and Stonor’s team identifi d the problem in production immediately. “Something that may have taken days, weeks or months to find, we were able to find in just a matter of a few minutes,” said Stonor.

The Result:
Across Headnet’s projects, TraceView significantly improved the MTTR (Mean-Time-to-Resolution), not to mention the MTTPC (Mean-Time-to-Pretty-Chart). In the first two months with TraceView, Headnet dramatically reduced the average and worst-case load times on a number of sites, improving customer satisfaction and decreasing support incidents – all without taking significant time away from new development.

Related Articles

About TR Jordan
A veteran of MIT’s Lincoln Labs, TR is a reformed physicist and full-stack hacker – for some limited definition of full stack. After a few years as Software Development Lead with Thermopylae Science and Techology, he left to join Tracelytics as its first engineer. Following Tracelytics merger with AppNeta, TR was tapped to run all of its developer and market evangelism efforts. TR still harbors a not-so-secret love for Matlab-esque graphs and half-baked statistics, as well as elegant and highly-performant code. Read more of his articles at www.appneta.com/blog or visit www.appneta.com.



ADS BY GOOGLE
Subscribe to the World's Most Powerful Newsletters

ADS BY GOOGLE

Technological progress can be expressed as layers of abstraction - higher layers are built on top of...
When building large, cloud-based applications that operate at a high scale, it’s important to mainta...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, disc...
CloudEXPO | DevOpsSUMMIT | DXWorldEXPO Silicon Valley 2019 will cover all of these tools, with the m...
Big Switch's mission is to disrupt the status quo of networking with order of magnitude improvements...
Lori MacVittie is a subject matter expert on emerging technology responsible for outbound evangelism...
Dynatrace is an application performance management software company with products for the informatio...
In his session at 21st Cloud Expo, Michael Burley, a Senior Business Development Executive in IT Ser...
Having been in the web hosting industry since 2002, dhosting has gained a great deal of experience w...
NanoVMs is the only production ready unikernel infrastructure solution on the market today. Unikerne...
All in Mobile is a mobile app agency that helps enterprise companies and next generation startups bu...
SUSE is a German-based, multinational, open-source software company that develops and sells Linux pr...
Yottabyte is a software-defined data center (SDDC) company headquartered in Bloomfield Township, Oak...
Your job is mostly boring. Many of the IT operations tasks you perform on a day-to-day basis are rep...
Serveless Architectures brings the ability to independently scale, deploy and heal based on workload...
Whenever a new technology hits the high points of hype, everyone starts talking about it like it wil...
Every organization is facing their own Digital Transformation as they attempt to stay ahead of the c...
"Calligo is a cloud service provider with data privacy at the heart of what we do. We are a typical ...
Bill Schmarzo, Tech Chair of "Big Data | Analytics" of upcoming CloudEXPO | DXWorldEXPO New York (No...
Chris Matthieu is the President & CEO of Computes, inc. He brings 30 years of experience in developm...