dstat - Analyzing Linux System Performance

-

Knowing the effect of your application on the system and observing system performance while your application is going thru different scenarios can give you great insight about the bottlenecks and performance ceilings in your application. Today, lets look at some of the tools on Linux that will help us understand the system performance.

dstat is a tool that shows various system performance parameters in real time.

Install dstat on your Fedora system with "yum install -y dstat" or on your Debian based system with "apt-get install dstat"

 

Here's a screenshot of it working. Click on it to see the full image.

dstat in action

Here, you can see various useful information that can tell you if system performance is throttled due to one or more of the resources being maxed out or if there is scope to improve performance by balancing the usage of the under-utilized resources.

For example, on this specific system, you can see its resources are hardly utilized. It has capacity to handle to many times it's current load. Currently, there is barely some disk activity (maybe logging) and some network activity. Interrupts and context-switches are within decent range. Most of the memory is used by kernel for caching and hardly any swap usage.

Interesting column to watch is the first 3 columns under procs. It tells us the status of the current scheduler queue. We can see new processes are being spawned. If the system is suffering from too many processes being spawned and competing for CPU, these columns can indicate that. If we see too many processes in wait state and we see high disk or network I/O, it should indicate that the system is I/O bound. Also, memory column gives us the correct split of the memory actually in use v/s the memory used by kernel for caching and buffers.

Popular posts from this blog

Linux IPC and Limits

-
Note: POSIX implementation provides better and cleaner api to IPC compared to System V. Prefer using POSIX api if you are known to be running on 2.6 or later kernel. System V IPC implementation on Linux includes Shared memory, Semaphores and Message queues. There are system imposed limits that are important to keep in mind when developing application/services in Linux. To know the limits use ipcs command. For example on my system: [root@f7 ~]# ipcs -l ------ Shared Memory Limits -------- max number of segments = 4096 max seg size (kbytes) = 32768 max total shared memory (kbytes) = 8388608 min seg size (bytes) = 1 ------ Semaphore Limits -------- max number of arrays = 128 max semaphores per array = 250 max semaphores system wide = 32000 max ops per semop call = 32 semaphore max value = 32767 ------ Messages: Limits -------- max queues system wide = 16 max size of message (bytes) = 8192 default max size of queue (bytes) = 16384 Or via sysctl interface: kernel.shmmni = 4096 kernel.shmal...
Read more

htop: more than top. pstree: ps with tree.

-
Image
I'm a big fan of procexp and other sysinternals tools on Windows. Many people who use those and then come to Linux complain that there are no such tools in Linux. Most people are familiar with top and ps commands. I would like to introduce you to a bunch of utilities on Linux that are very useful while debugging issues. Lets start with htop, a better alternative to top. You can install htop on a yum based system like Fedora, Redhat, CentOS etc with "yum -y install htop" or with "apt-get install htop" on systems that are debian apt based like Ubuntu. htop is much better in displaying the process and resource information than top. It gives a more accurate and clearer picture of process memory usage than top. A screenshot of htop in action: It has many interesting features. It's display layout is refreshing different and nice. It can show tree view, a very important feature to understand the ancestry of a process. In the size column, the MB part is hig...
Read more

Access Apache WebDAV from Windows XP

-
This is a work-in-progress. This is not complete, may be never will be. It is purely for my own reference. Use at your own risk. Here I try to remember how to configure Apache and Windows XP so that WebDAV on Apache is accessible from Windows XP clients. Links: http://www.thrrrust.com/~pclark/blog/2005/03/fun-with-windows-xp-and-webdav.html http://www.hss.caltech.edu/help/unix/admin/web/apache-webdav-xp http://support.microsoft.com/?kbid=909423 http://www.greenbytes.de/tech/webdav/webdav-redirector-list.html Registry changes required to support large files and many files: http://support.microsoft.com/default.aspx/kb/900900/ http://support.microsoft.com/?kbid=912152 Automatic Protocol Driver Selection for MSDAIPP http://msdn2.microsoft.com/en-us/library/ms691698.aspx http://msdn2.microsoft.com/en-us/library/ms691696.aspx http://msdn2.microsoft.com/en-us/library/ms691722.aspx DHTML Behaviors for making webfolder open automatically. http://dean.edwards.name/moz-behaviors/ http://msdn.micr...
Read more