C/C++ Profiling Tools

This blog will give you a brief overview of profiling C and C++ applications. Additionally, it will lay before you all of the tools available, with the purpose of aiding you in choosing the right tools at the right times.

The Steps for Profiling

Before we look at the actual tools, let's go over the steps to profiling. It's quite important to have a technique for doing this properly, to avoid the trap of changing something hoping it's better, committing it, and going home without making sure that you've actually improved things. So the way to do that is by, first, assessing what is important in terms of performance in your project. Is it the CPU usage? Is it the off CPU time, when your application is sleeping or waiting for something to happen? Is it memory allocations? Is it the battery usage that is the problem? Do you want to improve the frame rate? It can be many, many different things, not just one. It's a whole set of measures.

1. First, you'll want to assess what is important for your project. What do you want to measure?
2. Then, you'll decide which tools you can use to do these measurements. There are many different tools and they all cover a number of possible things to measure.
3. After you select your tools, you should write a benchmark. That means a reliable way of measuring something in your application. If you have to start the application, click here, click there, load a file, wait for something to be downloaded and so on and so on, you won't be able to do so three times in a row and get the same measurements. It's much better if you write some sort of automated test, like a unit test but for benchmarking instead of correctness, which means measuring the performance of a specific task. You decide what to measure, how to measure, and write a benchmark to actually be able to measure that reliably.
4. Use one of the tools to run the benchmark and establish a baseline by measuring the benchmark, before you make any changes to the code.
5. At step five, you can finally change the code. Keep in mind that you do not change the code until step 5. After you change it, measure the result, compare it to the baseline, and decide whether or not the change is an improvement. That can be a bit tricky if it's better on one measure than it is on another. You need to decide if that's good enough or if you should refine the solution.

Then, you would measure it again with the changes, repeat up to step 4, profile, repeat step 5, make the changes again, and so on.

The Tools to Use

In order to choose the best tools for the job, it's important to be aware of all the tools that are available and when to use them.

For Measuring Performance

Let's talk first about measurements of performance, specifically, CPU and off CPU performance.

Perf

Another tool you can use to measure performance is perf, which is part of the Linux kernel. That means it supports all of the architectures of the Linux kernel, including x86, ARM, PPC, and so on. Unfortunately, perf has no user interface. It's a command line tool that is pretty difficult to use. So, we at KDAB wrote a tool called Hotspot, which is a graphical interface for the measurements made by perf.

For Measuring Memory Allocations

Another thing you might want to measure, as previously mentioned, is memory allocations -- not just memory leaks but also the use of memory while the application is running.

Heaptrack

Another approach is to use Heaptrack, an open source tool that's part of KDE. It was developed by one of my colleagues, Milian Wolff. Heaptrack is able to locate and recall all of the memory allocations done while the application is running. Then it will show you graphs of the allocations, including temporary allocations, which is when an area of memory is allocated and then freed right away afterwards.

Another feature that Heaptrack has over Valgrind is that you can attach Heaptrack to a running program. This is quite useful if you want to measure only one operation, as opposed to the whole setup of the application. It can also show you the difference between tool runs, which is extremely useful if you apply the process that was mentioned earlier. You can measure the baseline, measure with the changes, and Heaptrack will show you only the difference between the two so you can figure out by how much you've improved things when making changes.

For a full demo of Heaptrack, watch this video.

Need More Details?

For more details about how to use all of these tools, check out the Profiling and Debugging videos on our YouTube channel. If you would like to learn even more about these tools than what's in the videos, we at KDAB also offer a 3 day Profiling and Debugging C and C++ Applications training.