It really annoyed me that the iowait at the cpu on the Dom 0 system was approximatly 50% when the 4 virtual system was doing more or less nothing.

I showed my earlier blogpost about VM virtualization to our sysadmin at op5. He gave me a couple of more hints that really make a big difference, the best part is that they are real simple to implement.

I also noticed that I forgot some parts in the previous article that was obvius to me.

#1 use virtio drivers if possible

This is probably the single most important step to get the most out of the hardware.

When the virtual systems wants to communicate with the hardware it uses drivers, if the drivers are simulating hardware to give a service to the virtual operating system it adds alot of overhed. A simple example:

• The virtual system wants to access the disk
• The virtual system communicates via the driver to the hardware
• The hardware is not real hardware, it is emulated hardware in sofware 
• The software that emulates the hardware sends the I/O to the Dom 0 virtualization engine
• The Virtualization engine verifies that the access is ok, translate it to real hardware call via its driver
• The hardware do the operation and send the result back up via all the steps to the virtual operating system

All this transalations and software calls take alot of resources from the machine.

By using virtual drivers, so that there is no need to emulate hardware, many of the steps can be skipped or done with much less penalty. However not all operating system have virtio drivers.

#2 load the virtio modules in Dom 0

This is a real god hint I got from our sysadmin, load the virtual drivers in the Dom 0 system asweell. According to him, the virtual drivers in the Dom 0 and Dom U:s communicate and makes the I/O much more effective. I have not found any information about this at any place so I was sceptical but I tried it.

# modprobe virtio_balloon
# modprobe virtio_blk
# modprobe virtio_net
# modprobe virtio_pci

The virtual systems need to be rebooted as far as I know before the loaded drivers will have any effect.

At first no change at all, but after few hours I noticed that CPU idle raized and the iowait went from at least 50% down to below 5%.

A nice graph, created by op5 Monitor showing the difference:

I loaded the virtual drivers approximately 4 pm, and it took until 10 pm before the performance boost showed up.

The correct way of making sure that the drivers are loaded directly would be to remake the kernel but I'm lazy so I have just added the module load to /etc/rc.local

Conclusions

It is always important to monitor systems. When doing changes it is not possible know if the changes do have any impact if you do not monitor and follow up how and if the changes does anything.

My former statement that KVM is not mature is more true then I have thought. The knowledge how to tune and maintain KVM systems seems to be like black art where the knowledge is not documented and well spread. I have read the RedHat virtualization and I have not found anything about that the virtual drivers should be loaded on the Dom0 system.

If there is anyone out there that has some documentation or more hints, please send me the link or comment this blogpost.

Links:

• RedHat virtualization doc
• op5 Monitor that monitor and creates nice graphs
• check_cpu_stats Nagios plugin to monitor cpustat

As an it slave, I have the same problems as most datacenters:

• Running out of space because of more and more machines get into the datacenter
• Overheating
• Powerconsumption

Added to the "normal" datacenter problems, I also have to deal with:

• Wife acceptance
• Noice, my neighbours has complained about the noice outside my basement.

To address this issues I will run a consolidation project to get fewer machines by using virtualization. As virtualization engine, KVM is choosed.

This article will describe some pitfalls I run into and how I solved them.

KVM plattform

KVM seems to be the future for virtualization within the Linux area since Xen has done some mistakes.

As I have good experience of running CentOS and has KVM included I decided to use CentOS as the plattform for my virtualization.

Issues

Bridge network

To let the virtual boxes has full access to the network you need create a network bridge, it is rather straightforward and well documented so I will skip this part. I used the documentation on Red Hat customer support. Why KVM requires a bridge instead of a normal NIC is another question

Snapshots

One handy feature with virtualization is that the virtual systems can be one big fat file at the physical host, this gives the possibility to make full backups without turning the system down a.k.a snapshots.

However to get snapshot to work the filetype must be qcow2 and raw is the default format.

It is possible to convert from raw to qcow2 format by running the command:

qemu-img convert -f raw -O qcow2 <virtualhost>.img <virtualhost>.img.qcow2

Remember to turn of your virtual system by running:

virsh shutdown <virtualhost>

After the conversion:

virsh edit <virtualhost>

modify the type and path, i.e.

      <driver name='qemu' type='qcow2' cache='none'/>
      <source file='/var/lib/libvirt/images/web.img.qcow2'/>

Start your virtual system:

virsh start <virtualhost>

Take a snapshot with:

qemu-img snapshot -c <snapshotname> <virtualhost>.img.preallc.qcow2

To create a full image of your snapshot you need to compile a more resent version of qemu-img then shipped with CentOS 6.2, I download a later version and compiled it from here, i renamed the new to qemu.img2 and copied it to /usr/local/bin

qemu-img2 convert -p -f qcow2 -O qcow2 -s <snapshotname> <virtualhost>.img.preallc.qcow2 <targetpath>

Beware: This command can use all your resources and may affect all your virtual systems, use nice and ionice to prevent it.

Disk I/O

After installing just a few virtual system I noticed that my physical host got alot of I/O wait, it can be seen by using tools like top.

To monitor this I installed the nagios plugins:

• check disk io, can be found here
• check cpu stats, can be found here
• check_libvirt, developed by op5 and an Howto

However it seems like that though my virtual systems did more or less nothing they caused alot of disk I/O on the physical system.

I did some investigations and read quite many articles, fiddled and tested. The following is what worked for me in my setup.

#1 Change disk scheduler

The disk scheduler can be changed on runtime by modify the file:

/sys/block/sda/queue/scheduler

to see what scheduler you use now:

cat /sys/block/sda/queue/scheduler

Change sda to the device you have.

The scheduler that worked best for me is deadline

echo deadline > /sys/block/sda/queue/scheduler

#2 Mount with noatime

A feature in Unix and other Unixlike systems like Linux is that it normaly stores when a file is accessed. So one read always produce a write and if you are using raid like morroring this get worse, one reade always generate several writes. This creates alot of overhead for a feature soldom used.

So change /etc/fstab so it will mount the file systems with noatime.
An axample:

UUID=a290aa4b-635c-45fa-b144-1fbef90b3735 /                       ext4    defaults,noatime        1 1

#3 Preallocation disk images

A real boost that is hidden in the featureset and not shown in the virtualmachine gui is using preallocation disk images. They cannot be created from the GUI so I install the virtual machine, turn it of and convert it afterwards.

qemu-img convert -f qcow2 -O qcow2 -o preallocation=metadata <virtualhost>.img.qcow2 <virtualhost>.img.preallc.qcow2

Change the path to new image name by editing the virtual machine settings

virsh edit <virtualhost>

Conclusions

In my opinion it seems like KVM is still a little bit immature or at least the tools to handle it. Maybe it would be a good idea to have one linux distro focusing on beeing the best platform for virtualization.

I am convinced that I can get even more bang for the bucks out of my installation if I learn how to tweak it even more, so if you have any hints, do not hesitate to contact me. Preferably as a comment to this blogpost.

Referenses:

• op5 Monitor, a nagios based enterprise monitor tool to monitor my environment
• check_libvirt, a nagios plugin done by op5 to monitor KVM
• check_diskio, a nagios plugin to monitor disk I/O
• check_cpu_stats, a nagios plugin to monitor cpu usage rather detailed
• Another blogpost which helped me
• KVM performance improvements and optimizations – Red Hat presentation

• Support for offline maps – no need to have online gmap connection
• Introducing IP traffic “weathermaps” i.e. a user friendly way to present traffic flows, being WAN or LAN traffic
• Display monitor data on external web i.e visualise and distribute the information to greater crowd
• Multiple of  time saving tasks such as multidelete, free text filter, save searches etc.

Having a modern easy to use proactive monitoring system is the core of assuring quality delivery of your enterprise applications to your user. However cool report and dashboards are great, if they require complex skills, many hours to set up and maintain -  the value is quickly gone.

With op5 Monitor v5.5 we introduce a number of features to make the information more presentable and understandable. We have made lots of new micro features to make the everyday change management easier and faster.

Major features in this release:   
•    Support for offline map
    ⁃    Now integrating the open streetmap (OSM) project, making the vizualisation of large networks easier and offline
    •    Support for IP traffic flow visualisation on maps or any background
    •    Publish op5 Monitor data / widget on external web service
    •    Multi tier host & service groups
    ⁃    A host or service group can now be part of another group creating a tree structure of dependencies.
    •    Multidelete – it’s always easy to add a new host or service to a system – now it´s easy to remove as well – saves lots of time!
Usability improvements:
    •    Saved searches
    •    Search on notes and comments and search in scheduling queue
    •    Free text filter
    •    Enhanced Alert history
    •    Authentication fallback

In total we have fixed and added more then 240 items in this release. Please let us know what you think – we focus on Your needs, just tell us!

Best regards
The op5 Team!

More about the new release

I have a long time looked at Telldus Tellstick that can control wall-plug socket recievers and other devices. Finally I got my hands on one that my collegue wanted to sell.

This article will describe how to get it up and running on a x86_64 CentOS 6 box, the procedure would be the same on RHEL or Feodora and similiar on other Linux distributions. Unfortunatly the only distribution that has pre-made packages is Ubuntu so I will describe howto download the source code, compile it and get the amazing Telldus Tellstick up and running.

Kudos to Telldus that has understood the power of OpenSource and opened up the device to let third-part  vendors make solutions based on the device.

Installation

Install packages needed for the compilation

yum install gcc gcc-c++ autoconf automake cmake

Libconfuse is needed: 

wget http://pkgs.repoforge.org/libconfuse/libconfuse-2.6-2.el6.rf.x86_64.rpm

wget http://pkgs.repoforge.org/libconfuse/libconfuse-devel-2.6-2.el6.rf.x86_64.rpm

Install libconfuse:

rpm -Uvh libconfuse-*

warning: libconfuse-2.6-2.el6.rf.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 6b8d79e6: NOKEY

Preparing...                ########################################### [100%]

   1:libconfuse             ########################################### [ 50%]

   2:libconfuse-devel       ########################################### [100%]

Download, configure, compile, and install the Tellstick package from Telldus 

Configure

Useful links:

• Telldus
• Different Telldus Tellsticks
• Supported devices

As a monitoring fanatic, I think that have mirrored disk without monitor the mirror is worse then not have a redundant disk system at all. If you think that you are safe and you are not, is worse then be aware of a risk and calculate with it.

This article will describe how I did monitoring my FreeNAS system mirrored disks status using Nagios or op5 Monitoring. I assume basic knowledge of Nagios or op5 Monitor and that a Nagios agent is installed.

Demarcation

This article will focus on GEOM raid monitoring. Of cource all important services should be monitored, like HTTP, CIFS, SMB, disk space, CPU Load, memory usage and so on. However that is basic monitoring knowledge and there is alot of documentation on the net howto achive that.

Monitor the GEOM mirror

The most interesting part is to monitor the GEOM mirror to make sure that that the raid1 is working. 

After some googleing I found check_geom, downloaded it and put it in /usr/local/libexec/nagios/ where the other plugins are located.

Add a line to /etc/nrpe.cfg

command[check_geom_mirror]=/usr/local/libexec/nagios/check_geom mirror

and test from Nagios/op5 Monitor host:

# ./check_nrpe -H fnas -c check_geom_mirror
OK mirror  - mirror/2TBmirror0 COMPLETE { ad6 , ad4 }

It works!
 

Configure Nagios or op5 Monitor

In /opt/monitor/etc/services.cfg at the op5 Monitor host

# service 'Disk Raid Mirrors'
define service{
    use                            default-service
    host_name                      fnas
    service_description            Disk Raid Mirrors
    check_command                  check_nrpe!check_geom_mirror
    contact_groups                 it-slav_mail,it-slav_jabber
    }

The result

I tested unplugging the SATA cabel to one of the mirrored disk and after a couple of minutes I got an Critical notification that my disk mirror is broken, I plugged SATA cabel and got a Warning:

After a couple of hours the mirror was OK.

Useful links:

• Previous article describing howto install nagios or op5 Monitor agent on FreeNAS
• op5, an Enterprise Monitor product company
• op5 Monitor, Enterprise Monitoring based on opensource
• Nagios, an excellent opensource monitor tool
• FreeNAS, very capable NAS based on FreeBSD

My old NAS built on top of CentOS has some performence issues and the disks are quit old now. The hardware is leftovers that is approx 8 years old and not highend at that time either. The disks age has worried my for a time and I would like to have higher redunduncy with raid1/mirrored disks.

After some research I decided to run my new NAS on FreeNAS, which has all the features I use, like: CIFS, NFS, FTP, SSH, Rsync, Unison, iSCSI and also easy administration and disk management.

This article will describe how I did setup Nagios or op5 Monitoring on my FreeNAS system. I assume basic knowledge of Nagios or op5 Monitor.

Installing nrpe

Nrpe is the agent that nagios and op5 Monitor uses to monitor a system from the inside.

From the webgui add group nagios and user nagios. User nagios should be a meber of group nagios.

 freenas:~# pkg_add -r nrpe2
Fetching ftp://ftp.freebsd.org/pub/FreeBSD/ports/i386/packages-7.3-release/Latest/nrpe2.tbz... Done.
Fetching ftp://ftp.freebsd.org/pub/FreeBSD/ports/i386/packages-7.3-release/All/perl-5.10.1.tbz... Done.
Removing stale symlinks from /usr/bin...
    Skipping /usr/bin/perl
    Skipping /usr/bin/perl5
Done.
Creating various symlinks in /usr/bin...
    Symlinking /usr/local/bin/perl5.10.1 to /usr/bin/perl
    Symlinking /usr/local/bin/perl5.10.1 to /usr/bin/perl5
Done.
cd: can't cd to /usr/include
Cleaning up /etc/make.conf... Done.
Spamming /etc/make.conf... Done.
Cleaning up /etc/manpath.config... Done.
Spamming /etc/manpath.config... Done.
Fetching ftp://ftp.freebsd.org/pub/FreeBSD/ports/i386/packages-7.3-release/All/libiconv-1.13.1_1.tbz... Done.
Fetching ftp://ftp.freebsd.org/pub/FreeBSD/ports/i386/packages-7.3-release/All/gettext-0.17_1.tbz... Done.
Fetching ftp://ftp.freebsd.org/pub/FreeBSD/ports/i386/packages-7.3-release/All/nagios-plugins-1.4.14,1.tbz... Done.
You already have a "nagios" group, so I will use it.
You already have a "nagios" user, so I will use it.

**********************************************************************
 

freenas:~# cp /usr/local/etc/nrpe.cfg-sample /etc/nrpe.cfg

I changed the allowed_hosts line and added my op5 Monitor host.

So the nagios agent works.

Links

• op5, an Enterprise Monitor product company
• op5 Monitor, Enterprise Monitoring based on opensource
• Nagios, an excellent opensource monitor tool
• FreeNAS, very capable NAS based on FreeBSD

The widget keeps track of how many times the word "moln" appear on idg.se webpage and displays it in a easy view in The Tactical Overview.

Screenshoots from the different modes:

Links:

• op5 Sandbox with a live cloud widget online, registration is necessary
• Ninja, the new and inovative nagios gui
• Widget exchange area

Kudos to op5 support that has created this excellent widget 

It is very handy to have a temprobe attached to network devices like a Wlan router, if OpenWRT is installed it is easy to use 1-wire devices. By using this method it is possible to create wireless temperature probes that uses Wlan.

Install

root@OpenWrt:~# opkg install owserver owfs         
 

Using

root@OpenWrt:~# owserver -u -C --usb_regulartime -p 3001

root@OpenWrt:~# mkdir /mnt/1-wire         


root@OpenWrt:~# owfs -s localhost:3001 -m /mnt/1-wire

root@OpenWrt:/mnt/1-wire/10.87507C010800# ls /mnt/1-wire/
10.87507C010800  81.543A2A000000  alarm            bus.0            settings         simultaneous     statistics       structure        system           uncached

It works!         
 

To make sure that owserver starts when the router is rebooted, add to /etc/rc.local


/usr/bin/owserver -u -C --usb_regulartime -p 3001

Firewall

My op5 Monitor/Nagios system is on the Wan side of the OpeWRT box so I need to open the firewall to port 3001.

Add to /etc/config/firewall

#1-wire ok on Wan
config rule
    option src        wan
    option dest_port    3001
    option target        ACCEPT
    option proto        tcp
 

Result

To gather the data from 1-wire I use op5 Monitor and my Nagios plugin check_1-wiretemp, the result can be seen below

Links

• OpenWrt
• owfs
• op5 Monitor

It is real simple, just add to following to /etc/config/firewall:

#open ssh on wan interface
config rule               
        option src              wan
        option dest_port        22
        option target           ACCEPT    
        option proto            tcp 

And restart the firewall:

#/etc/init.d/firewall restart

After struggeling with my Linksys WRT-160NL to get OpenWRT stable I finally gave up. It ended upp with DD-WRT instead. Unfortunatly DD-WRT do not have the functionality I want like:

-rndis device so I could use my Android phone to connect to Internet

-1-wire device support

-Nagios agent

The solution was to buy another device where OpenWRT support is working better with USB and Gigabit interfaces. After some research I found TP-Link TL-WR1043ND for approx 50€.

Unpacking

The TL-WR1043ND package is good looking and has a printed GPL license included, that is impressive.

The basic installation with TP-LINK installed firware was easy and stright forward with all information you need in a simple "Quick installation Guide". No need for installing software on a windows machine to be able to access you new device. I think Cisco/Linksys has something to learn.

Installing OpenWRT

Find the Firmware upgrade menu and upload this firmware. It worked perfectly well and seems very stable. A positive suprise is that the WLAN seems to reach longer then the WRT 160NL.

Conclusion

The TP-LINK TL-WR1043ND seems to be a good Wlan router that has a good support for OpenWRT, with USB, Gigabit ethernetinterfaces and good Wlan range.

Background

I have a need of GPS tag my digital photos. Unfortunatly a GPS device to my camera costs approx 230 Eur. In my humble opinion I think that is way of, especially considering that with some software in the camera any standard USB GPS reciever would do the job. They cost approx 40 Eur.

I have an Android phone where there is tons of apps that could create a GPS log whenever I want to, however it drains the battery in just a couple of hours. I want to track my routes at least a whole day without the need to charge.

The solution is to buy a GPS logger and after some research I found Ventus GPS Route Logger G730, and it looked like it would work with Linux.

This article will describe my experience making the G730 Ventus GPS Route Logger and Linux.

Using skytraq

According to webpages skytraq can be used to create GPX tracks from the G730 Logger.

Unfortunatly the skytraq software are not in the Ubuntu repos so I had to download and install it manually. It is downloadable from  http://code.google.com/p/skytraq-datalogger/

It is out of the scope for this article how to compile and fullfill the requirements needs.

When the GPS Logger is attached the following will show up in /var/log/messages:

Jan 15 14:13:08 it-slav kernel: [21689.101101] usb 6-2: new full speed USB device using uhci_hcd and address 3
Jan 15 14:13:09 it-slav kernel: [21689.316181] usb 6-2: configuration #1 chosen from 1 choice
Jan 15 14:13:09 it-slav kernel: [21689.319138] pl2303 6-2:1.0: pl2303 converter detected
Jan 15 14:13:09 it-slav kernel: [21689.332192] usb 6-2: pl2303 converter now attached to ttyUSB0

So now we can communicate with the GPS Logger:

peter@it-slav:~/dl/skytraq/skytraq-datalogger-0.5-1$ ./skytraq-datalogger --info
kernel version: 1.4.8 -- ODM version: 1.8.22 -- revision: 2008-10-23
log_wr_ptr:      28626
total sectors:   510
sectors left:    506
max time:        3600 s
min time:        1 s
max distance:    1000 m
min distance:    0 m
max speed:       1000 km/h
min speed:       0 km/h
datalog enable:  1
log fifo mode:   1
AGPS enabled:    0
AGPS data left:  none
baud-rate:       38400 bps

Get the gpx file:

./skytraq-datalogger --dump >20110310.gpx

And now a gpx file named 20110310.gpx is created.

Setup

There is a possibility to conifigure the behvior of the GPS logger with skytraq, however it is possible to configure more parameters in the Ventus G730 so to fully configure I had to install the windows software that come with the logger.

The configuration is rather strange, there is a possibilty to log per time, over a certain speed and distance for the following:

• General
• Walking
• Car
• Bicycle

How the device knows what type of vehicle I use for traveling and if the General settings override the others is undocumented.

Problems

Most of the time when trying to communicate with the logger it gives this message:

peter@it-slav:~/dl/skytraq/skytraq-datalogger-0.5-1$ ./skytraq-datalogger --info
No response from datalogger.

And after a few seconds it works again. Sometimes unplugging the device and connect it again helps. The behavior is very stochastic and some patience will help:)

The logger can be used as a GPS recever and the output is in standard NMEA format that GPSd understand. So if you want to use it together with your favorite GPS software it works. However my experience is that if you want to dump the output from the G730 Logger the GPS output must be turned of:

./skytraq-datalogger --set-output-off

Suggestion

I suggest that Ventus should open the specification howto communicat with the device so third part software could use the device. To hide that type of information do not provide any advantage, rather the opposite.

I wrote an email to them and the correspondence can be seen below. I hope this blog post will make Ventus change their mind.

–cut–

-------- Original Message --------
Subject: Sv: Ventus g730
Date: Mon, 3 Jan 2011 13:25:49 +0800
From: <support@ventusdesign.com>
To: Peter Andersson <peter@it-slav.net>
CC: Ventus <info@ventusdesign.com>

> Hi
>
> I have just bought a Ventus g730 GPS Logger and I have some feedback.
> Before buying the device I made sure that it fullfilled my requriements:
> -Works with linux
> (http://www.petrilopia.net/wordpress/hardware/ventus-gps-route-logger-g730-linux/)
> -Create gpx files
> -Battery that last at least 12 hours
>
> Unfortunately you have have taken a strange decision and do not support
> Linux. However according to several forums the G730 is compatible with
> http://code.google.com/p/skytraq-datalogger/
> After fiddling with the device I found that the skytraq-datalogger
> sometimes works and sometimes does not. And I probably will return the
> device to the store if I cannot get it to work better with an open and
> free operating system.
>
> My recommendations to you are:
> 1-Provide an open specification how to access the data in the device
> 2-Modify the http://code.google.com/p/skytraq-datalogger/ software so it
> works with G730 and provide the code change to the team behind
> skytraq-datalogger, and also provide the software on you website.
>
> By following these simple steps (especially #1) you will sell a-lot of
> more devices to the people that prefer open and freedom.
>
> Best regards
> Peter Andersson
> peter@it-slav.net
 

The dashboard has been modified and improved by the community and an example can be seen at op5 sandbox dashboard and can be downloaded from op5 community.

The original project place is http://dingleberry.me/2010/04/our-new-dashboard/

When I was preparing a presentation about what op5 is doing and our contribution to the community, I went to ideas.nagios.org. When I browsed the list of the biggest issues with Nagios I found out that op5 has packaged and solved them all in op5 Monitor. I encourage everyone to take a peak at the list and judge for them self what platform you want to use for your enterprise monitoring solution.

1. Nagios Clusters

op5 has developed Merlin (Module for Effortless and Redundant and Loadbalanced Infrastructure with Nagios). It provides the possibility to have a redundant or/and loadbalanced solution using Nagios. It also provides a scalable database backend for Ninja and Nagvis, take a peak at Merlin webpage.

2. Performance Graphing

In op5 Monitor op5 has added pnp4nagios that graphs more or less any check that gives a numerical value back.

3. New Status Map

We provide a new statusmap, it is a part of Nagvis project and called Automap. op5 has contributed to Nagvis by adding support for Merlin database backend and GoogleMaps integration

4. Better Interface

op5 has created a new PHP based interface that makes you proud of your monitor solution, called Ninja. Ninja stands for Nagios is now Just Awesome, it looks so good so you can show it to your manager:-) Take a peak at Ninja webpage.

We had a naming competition at op5 my suggestion to call it Yang, Yet Another Nagios Gui, did not get so many votes so the name become Ninja.

5. Configuration

Any one that has tried to configure Nagios by hand has thought bad thoughts. It is cumbersome and in the begining it makes even a skilled Unix admin frustrated. op5 has developed a web based configuration tool named Nacoma. It is included in op5 Monitor.

6. SLA reports

op5 has got alot of feedback from the customers and one issue was better reports, we have created two reports: availability and SLA report. Both of them can be scheduled and looks god compared to the reports in Nagios, they are included in Ninja

 
7. More members in core team

Well, this is something that op5 cannot controll, however, Andreas Ericsson one of op5s core developers are a member og Nagios steering board.

8. SNMP Trap receiver

This is something op5 is working on right now, we have today created a prototype together with a customer and depending of the outcome of that project we will know better when it will be available to the market.

9. UI-Improvment

op5s solution to this issue is Ninja, a better, nicer, scalable, database backend gui to Nagios.

10. Nagios Dashboard

A newTactical Overview with widgets or Nagvis, all included in Ninja

Links

• ideas.nagios.org http://ideas.nagios.org
• Nagios http://www.nagios.org
• op5 http://www.op5.com
• op5 Monitor http://www.op5.com/op5/products/network-monitor
• Ninja http://www.op5.org/community/plugin-inventory/op5-projects/ninja
• Merlin http://www.op5.org/community/plugin-inventory/op5-projects/merlin
• Nagvis http://www.nagvis.org/
• pnp4nagios http://docs.pnp4nagios.org/

I have found one way of still doing geeky things combined with vacation. That is update OpenStreetmap. Take a peak at my updates at:

• http://www.openstreetmap.org/?lat=56.4476895332336&lon=14.0158939361572&zoom=14
• http://www.openstreetmap.org/?lat=56.4213931560516&lon=14.0284895896912&zoom=14
• http://www.openstreetmap.org/?lat=60.1418289542198&lon=15.4323390126228&zoom=17

Openstreetmap is wikipedia for maps, and like wikipedia it is dependent of that people will update with correct data. One thing that fascinates me is that openstreetmap is extremly detailed in some areas. Probably a geek lives nearby.

When the earthquake hit Haiti, OpenStreetmaps was used by rescuers because all other maps was inaccurate. Alot of volunteers helped keeping the maps updated.

If you want to participate in the project, the process is simple:

1. Get an GPS reciever that can generate gpx tracks, I use my Android
2. Turn on the GPS and walk, run or bicycle around and gather GPS tracks
3. Upload the gpx to openstreetmap.org
4. Tag the roads, buildings and whatever you found

 To get started, read the beginners guide at Openstreetmap.

I wanted to use a 3G dongle with a twin SIM card as my Internet connection when I’m traveling. I have earlier decribed howto share the Internet connection and make it more flexible by using an OpenWRT router with USB interface as a bridge between Wlan and 3G/GPRS provided internet.

Unfortunatly Tele2s support personel cannot keep track of the unlogical rules among their different subscriptions so they fouled my to buy a twincard to my regular subscription and use that for data. After a couple of more calls to Tele2, including that they listened to a recording of when I ordered the twincard I have to give up that track because it was not possible. The twincard only works for phone calls, not data connections and especially not when I had a flatrate subscription on my master SIM card.

After some investigation I came to the conclusion that I have to use my Regular phone, a HTC Desire with Android as my connection to internet.

Unfortunatly the work done with getting the USB 3G dongle was a waste of time.

PreReq

An OpenWRT router with a working USB interface and a rndis enabled modem, I use a HTC Desire.

Installation

root@WRT160NL:~# opkg install kmod-usb-net-rndis

I also installed some USB packages, probably not all of them are necessery:

root@WRT160NL:~#opkg install kmod-ar9170 kmod-usb-acm kmod-usb-core kmod-usb-ohci kmod-usb-serial comgt
kmod-usb-serial-option kmod-usb-storage kmod-usb-uhci kmod-usb2  usb-switch

Add the following to /etc/config/network

config 'interface' 'usb0'
    option 'name' 'usb0'
    option 'proto' 'dhcp'
    option 'ifname' 'usb0'
    option 'defaultroute' '0'
    option 'peerdns' '0'
 

Use the same firewall rules with your 3G connection as your normal WLAN, add the yellow marked line to /etc/config/firewall:

config 'zone'
    option 'name' 'wan'
    option 'input' 'REJECT'
    option 'output' 'ACCEPT'
    option 'forward' 'REJECT'
    option 'masq' '1'
    option 'mtu_fix' '1'
    option 'network' 'wan usb0 ppp0'

Do a reboot
 

Test

To use your new connection, run ifup

root@WRT160NL:~# ifup usb0
udhcpc (v1.15.3) started
root@OpenWrt:~# Sending discover...
Sending select for 192.168.100.100...
Lease of 192.168.100.100 obtained, lease time 864000
udhcpc: ifconfig usb0 192.168.100.100 netmask 255.255.255.0 broadcast +
udhcpc: setting default routers: 192.168.100.254
udhcpc: setting dns servers: 192.168.100.254

root@WRT160NL:~# ping www.google.com
PING www.google.com (74.125.39.104): 56 data bytes
64 bytes from 74.125.39.104: seq=0 ttl=51 time=371.025 ms
64 bytes from 74.125.39.104: seq=1 ttl=51 time=388.617 ms
64 bytes from 74.125.39.104: seq=2 ttl=51 time=316.767 ms
^C
--- www.google.com ping statistics ---
4 packets transmitted, 3 packets received, 25% packet loss
round-trip min/avg/max = 316.767/358.803/388.617 ms

Shutdown the connection with ifdown

root@WRT160NL:~# ifdown usb0

Background

After waiting for the Hummingbird release for the LaFonera 2.0G a long time and discussed with the Fon support team when 3G dongles will work, I gave up and installed OpenWRT on my LaFonera 2.0G router.

I’m sorry FON, you have a cool idea and nice routers but your unlogical approach to the users and communtity, finally got me to install plain OpenWRT instead.

Installation

After alot of googling and testing and downloading, reading and so on, I finally run into a guide that worked for me.

Most of the descriptions and howto assumes that the RedBoot will accept to download a new firmware via TFTP, this is true with the early releases of 2.0G , but the one sold now do not have this feature.

The trick is to install a firmware that allows changing the RedBoot partition of the memory, change the RedBoot parttion and install OpenWRT via TFTP.

The guide is unfortunatly in French, but google translate helped me to translate it to English.

The pitfalls I run into is to reboot the device several timesafter installing the hacked version of FON firmware: FON2202_2.2.5.0_Flipper_RedBootC_VoteGOP.image

The only difference is that I used a later version of OpenWRT. I used Backfire 10.03 instead of Kamikaze 8.9.1

After succesfully installed my new Linksys WRT160NL with OpenWrt, the next step is to configure it. As the summer is approaching and my need for Internet access in our summer cottage will arrise. The summer cottage is in the middle of nowhere so it would be handy to put a USB dongle and the Wlan router in the spot with best 3G field strength and use the WiFi to connect several computers to the router and Internet.

The 3G USB modem is a Huawei modem I bought for 20 EUR and unlocked using this guide.

I found an excellent guide describing excactly what I wanted todo but it did not work 100% in my environment so I will describe what I did to get it running. Read the guide to get background and deeper explanation of how things are done. This guide assumes that you have read the guide, basic knowledge of OpenWRT, howto edit files in a Linux environment and so on.

Installation

The USB hardware and the modem need some extra packages to be installed. I installed the following:

root@WRT160NL:~#opkg install kmod-ar9170 kmod-usb-acm kmod-usb-core kmod-usb-ohci kmod-usb-serial comgt
kmod-usb-serial-option kmod-usb-storage kmod-usb-uhci kmod-usb2  usb-switch

Probably not all of them are necessery but during my tests and fiddeling these are the ones I installed.

Configuration

Create /etc/modules.d/60-usb-serial:

usbserial vendor=0x12d1 product=0x1446
 

The vendor and product parameters can be found by attaching the 3G modem and run:

root@WRT160NL:~# cat /proc/bus/usb/devices

T:  Bus=01 Lev=00 Prnt=00 Port=00 Cnt=00 Dev#=  1 Spd=480 MxCh= 1
B:  Alloc=  0/800 us ( 0%), #Int=  0, #Iso=  0
D:  Ver= 2.00 Cls=09(hub  ) Sub=00 Prot=01 MxPS=64 #Cfgs=  1
P:  Vendor=1d6b ProdID=0002 Rev= 2.06
S:  Manufacturer=Linux 2.6.32.10 ehci_hcd
S:  Product=Atheros AR91xx built-in EHCI controller
S:  SerialNumber=ar71xx-ehci
C:* #Ifs= 1 Cfg#= 1 Atr=e0 MxPwr=  0mA
I:* If#= 0 Alt= 0 #EPs= 1 Cls=09(hub  ) Sub=00 Prot=00 Driver=hub
E:  Ad=81(I) Atr=03(Int.) MxPS=   4 Ivl=256ms

T:  Bus=01 Lev=01 Prnt=01 Port=00 Cnt=01 Dev#=  2 Spd=480 MxCh= 0
D:  Ver= 2.00 Cls=00(>ifc ) Sub=00 Prot=00 MxPS=64 #Cfgs=  1
P:  Vendor=12d1 ProdID=1446 Rev= 0.00
S:  Manufacturer=HUAWEI Technology
S:  Product=HUAWEI Mobile
C:* #Ifs= 2 Cfg#= 1 Atr=e0 MxPwr=500mA
I:* If#= 0 Alt= 0 #EPs= 2 Cls=08(stor.) Sub=06 Prot=50 Driver=usbserial_generic
E:  Ad=81(I) Atr=02(Bulk) MxPS= 512 Ivl=0ms
E:  Ad=01(O) Atr=02(Bulk) MxPS= 512 Ivl=0ms
I:* If#= 1 Alt= 0 #EPs= 2 Cls=08(stor.) Sub=06 Prot=50 Driver=usbserial_generic
E:  Ad=02(O) Atr=02(Bulk) MxPS= 512 Ivl=0ms
E:  Ad=82(I) Atr=02(Bulk) MxPS= 512 Ivl=0ms
 

The parameters are marked in yellow above.

The next step is to configure usb switch. Create /etc/usb-modeswitch.conf

########################################################
# Huawei E270+  (HSPA+ modem)

DefaultVendor= 0x12d1
DefaultProduct=0x1446

TargetVendor=  0x12d1
TargetProductList="1001,1406,140c,14ac"

CheckSuccess=20

MessageContent="55534243123456780000000000000011060000000000000000000000000000"

I have no clue of the syntax but I copied it from my Ubuntu machine /etc/usb_modeswitch.d/12d1:1446 and it works:-)

Add the following to /etc/config/network

config 'interface' 'ppp0'
    option 'ifname' 'ppp0'
    option 'proto' '3g'
    option 'device' '/dev/ttyUSB0'
    option 'apn' 'internet.tele2.se'
    option 'pincode' '1234'

The pincode is obvious, the apn is local and given by your local operator. It is handy to configure it to work in Ubuntu and then look at the configuration Ubuntu creates.
 

The firewall rules need to be updated and I added ppp0 to the wan section in /etc/config/firewall

config 'zone'
    option 'name' 'wan'
    option 'input' 'REJECT'
    option 'output' 'ACCEPT'
    option 'forward' 'REJECT'
    option 'masq' '1'
    option 'mtu_fix' '1'
    option 'network' 'wan ppp0'

To make the change to take effect run:

root@WRT160NL:~# /etc/init.d/firewall restart
 

Start it

Attach the modem and run:

root@WRT160NL:~# usb_modeswitch

Looking for target devices ...
 No devices in target mode or class found
Looking for default devices ...
 Found default devices (1)
Accessing device 002 on bus 001 ...
Using endpoints 0x01 (out) and 0x81 (in)
Inquiring device details; driver will be detached ...
Looking for active driver ...
 OK, driver found ("usbserial_generic")
 OK, driver "usbserial_generic" detached

SCSI inquiry data (for identification)
-------------------------
  Vendor String: HUAWEI 
   Model String: Mass Storage   
Revision String: 2.31
-------------------------

USB description data (for identification)
-------------------------
Manufacturer: HUAWEI Technology
     Product: HUAWEI Mobile
  Serial No.: not provided
-------------------------
Setting up communication with interface 0 ...
Trying to send the message to endpoint 0x01 ...
 OK, message successfully sent
 Device is gone, skipping any further commands

Checking for mode switch (max. 20 times, once per second) ...
 Original device is gone already, not checking
 Searching for target devices ...
 Searching for target devices ...
 Searching for target devices ...
 Searching for target devices ...
 Searching for target devices ...
 Found correct target device

Mode switch succeeded. Bye.
 

logread should now give something similiar to:

Jun 12 17:29:11 WRT160NL user.info kernel: generic ttyUSB0: generic converter now disconnected from ttyUSB0
Jun 12 17:29:11 WRT160NL user.info kernel: usbserial_generic 1-1:1.0: device disconnected
Jun 12 17:29:11 WRT160NL user.warn kernel: usb 1-1: usbfs: process 1345 (usb_modeswitch) did not claim interface 0 before use
Jun 12 17:29:11 WRT160NL user.info kernel: usb 1-1: USB disconnect, address 2
Jun 12 17:29:11 WRT160NL user.info kernel: generic ttyUSB1: generic converter now disconnected from ttyUSB1
Jun 12 17:29:11 WRT160NL user.info kernel: usbserial_generic 1-1:1.1: device disconnected
Jun 12 17:29:16 WRT160NL user.info kernel: usb 1-1: new high speed USB device using ar71xx-ehci and address 3
Jun 12 17:29:16 WRT160NL user.info kernel: usb 1-1: configuration #1 chosen from 1 choice
Jun 12 17:29:16 WRT160NL user.info kernel: option 1-1:1.0: GSM modem (1-port) converter detected
Jun 12 17:29:16 WRT160NL user.info kernel: usb 1-1: GSM modem (1-port) converter now attached to ttyUSB0
Jun 12 17:29:16 WRT160NL user.info kernel: option 1-1:1.1: GSM modem (1-port) converter detected
Jun 12 17:29:16 WRT160NL user.info kernel: usb 1-1: GSM modem (1-port) converter now attached to ttyUSB1
Jun 12 17:29:16 WRT160NL user.info kernel: option 1-1:1.2: GSM modem (1-port) converter detected
Jun 12 17:29:16 WRT160NL user.info kernel: usb 1-1: GSM modem (1-port) converter now attached to ttyUSB2
Jun 12 17:29:16 WRT160NL user.info kernel: scsi3 : SCSI emulation for USB Mass Storage devices
Jun 12 17:29:16 WRT160NL user.debug kernel: usb-storage: device found at 3
Jun 12 17:29:16 WRT160NL user.debug kernel: usb-storage: waiting for device to settle before scanning
Jun 12 17:29:16 WRT160NL user.info kernel: scsi4 : SCSI emulation for USB Mass Storage devices
Jun 12 17:29:16 WRT160NL user.debug kernel: usb-storage: device found at 3
Jun 12 17:29:16 WRT160NL user.debug kernel: usb-storage: waiting for device to settle before scanning
Jun 12 17:29:21 WRT160NL user.notice kernel: scsi 3:0:0:0: CD-ROM            HUAWEI   Mass Storage     2.31 PQ: 0 ANSI: 2
Jun 12 17:29:21 WRT160NL user.debug kernel: usb-storage: device scan complete
Jun 12 17:29:21 WRT160NL user.notice kernel: scsi 4:0:0:0: Direct-Access     HUAWEI   SD Storage       2.31 PQ: 0 ANSI: 2
Jun 12 17:29:21 WRT160NL user.notice kernel: sd 4:0:0:0: [sda] Attached SCSI removable disk
Jun 12 17:29:21 WRT160NL user.debug kernel: usb-storage: device scan complete
 

Using it

To start using your new configuration:

root@WRT160NL:~# ifup ppp0
SIM ready
PIN set successfully

And now ping a host on Internet

root@WRT160NL:~# ping ftp.sunet.se
PING ftp.sunet.se (194.71.11.69): 56 data bytes
64 bytes from 194.71.11.69: seq=0 ttl=55 time=119.351 ms
64 bytes from 194.71.11.69: seq=1 ttl=55 time=88.978 ms
64 bytes from 194.71.11.69: seq=2 ttl=55 time=88.751 ms
64 bytes from 194.71.11.69: seq=3 ttl=55 time=88.484 ms
64 bytes from 194.71.11.69: seq=4 ttl=55 time=128.257 ms
^C
--- ftp.sunet.se ping statistics ---
5 packets transmitted, 5 packets received, 0% packet loss
round-trip min/avg/max = 88.484/102.764/128.257 ms
 

Stop your connection:

root@WRT160NL:~# ifdown ppp0

Useful links

• http://josefsson.org/openwrt/dongle.html The excellent guide that I used as a platform, read it!
• OpenWrt, Linuxbased firmware for routers

Background

After getting fedup with the bad fon support I decided to give a new wireless router a try. After browsing internet and openwrt forums I thought that a Linksys WRT160NL would fulfill my requirements:

The requrements are:

• N
• 3G USB dongle
• Cheap

Packing up

The installation from Linksys is crap, a CD comes with the product and if you want to configure it you need to install software from the CD. The only supported operating systems are windows or Mac, I run linux.

I skipped the CD and connected my Linux box with a ethernet cable to the router. I tried to connect to http://192.168.1.1 and got a login screen.

After some googling I found that the default login was blank and the password admin.

I managed to configure my new router after logging in. I do not now the purpose of the CD, real stupid.

Install OpenWRT

I read the instructions to get OpenWRT on my Linksys WRT160NL and tried the "OEM easy installation". According to the instruction openwrt-ar71xx-wrt160nl-squashfs.bin is the image to install. Unfortunatly I get an errormessage " Firmware Upgrade Failed!"

I upgraded the firmware to the latest Linksys firmware and after that tried the OpenWRT firmware with the same error message.

After some bad language and alot of googling I found a bug reported that the version I tried to install always gives that message when installed from the Linksys webgui.

So I tried the Beta version instead and finally I success message.

I telneted to 192.168.1.1 and run passwd to change my password.

ssh to 192.168.1.

run:

root@OpenWrt:~# opkg update

root@OpenWrt:~# opkg install kmod-ath9k

root@OpenWrt:~# opkg install  hostapd

And start configure.

Update BETA to stable version

It was a annoying feeling to run beta when a stable version existed.

I used the luci webgui to update the firmware to the stable version and it looked alright. I managed to log in both with ssh and webgui.

But when I tried to install a new package it gave me an error message that there was no free disk, sigh!

I installed the BETA version and it worked, tried RC3 and the same problem with no free disk.

After some bad language and a lot of fiddeling I updated to the stable with the checkbox "Keep configuration files" unchecked and this time it works flawless.

Follow the guidlines above to change root password, update the software package list, install wlansupport, WAP support  and start configure.

A succefull login below:

peter@peter-laptop:~$ ssh -l root 192.168.1.1
root@192.168.1.1's password:

BusyBox v1.15.3 (2010-04-06 03:14:11 CEST) built-in shell (ash)
Enter 'help' for a list of built-in commands.

  _______                     ________        __
 |       |.-----.-----.-----.|  |  |  |.----.|  |_
 |   -   ||  _  |  -__|     ||  |  |  ||   _||   _|
 |_______||   __|_____|__|__||________||__|  |____|
          |__| W I R E L E S S   F R E E D O M
 Backfire (10.03, r20728) --------------------------
  * 1/3 shot Kahlua    In a shot glass, layer Kahlua
  * 1/3 shot Bailey's  on the bottom, then Bailey's,
  * 1/3 shot Vodka     then Vodka.
 ---------------------------------------------------

root@WRT160NL:~# uname -a
Linux WRT160NL 2.6.32.10 #20 Tue Apr 6 15:01:26 CEST 2010 mips GNU/Linux

I have registred me to attend the open Splunk event in Stockholm. Within 24 hours I got an email telling that they do not want competitors at the event and would like to discuss the purpose of me attending.

I called the Splunk representative and told him that op5 thinks Splunk is a competitor in some cases and in some cases we have products that run in parallel at customer sites. We want to integrate op5 Monitor with Splunk because we have got the question a couple of times from customers and potential customers. My intention of attending the meeting is to get a better understanding of Splunk so op5 can integrate our products, so our customers get the products that suits them best. If Splunk wants to be part of the integration, the better.

The Splunk representative still do not want me to attend. At Splunk they will discuss this matter internally but so far, this is their view.

I would really like to make a parallel with another op5 competitor, Würth, at their event they invited op5 as key speaker and I really recommend Splunk to reconsider their decision.

I wanted to unlock my operator locked Huawei e1750 modem. After googling I found this page in swedish.

The unlock code can be calculated by using the IMEI number, the unlock code is sent by using AT commands.

I have succesfully tested this on e1750 and e1550.

I also tried it on e220 and it did not work.

1. Get the IMEI number

Normally this is printed on the device put the geek way of getting it is by asking the device:

peter@peter-laptop:~/huawei$ cat /dev/ttyUSB0 &
[1] 9378
peter@peter-laptop:~/huawei$ echo -e "ATI\r" > /dev/ttyUSB0
peter@peter-laptop:~/huawei$ ATI
Manufacturer: huawei
Model: E1750
Revision: 11.126.07.04.00
IMEI: 123456789012347
+GCAP: +CGSM,+DS,+ES

OK

So the IMEI number is: 123456789012347

2. Calculate the unlock code

The following python script will calculate the unlock code:

import hashlib

def getCode(imei, salt):
    digest = hashlib.md5((imei+salt).lower()).digest()
    code = 0
    for i in range(0,4):
        code += (ord(digest[i])^ord(digest[4+i])^ord(digest[8+i])^ord(digest[12+i])) << (3-i)*8
        code &= 0x1ffffff
        code |= 0x2000000
    return code

# Your IMEI goes here:
imei = "123456789012347"

print "Unlock code: %s" % getCode(imei, "5e8dd316726b0335")
print "Flash code: %s" % getCode(imei, "97b7bc6be525ab44")

When run:

peter@peter-laptop:~/huawei$ python unlock_code.py
Unlock code: 36963763
Flash code: 53969249

3. Use the unlock code

peter@peter-laptop:~/huawei$ echo -e 'AT^CARDLOCK="36963763"\r' > /dev/ttyUSB0

OK

Congratulations, now your modem is unlocked

With my new and fancy HTC Desire I wanted to look at my Nagios or op5 Monitor status. I have found two apps Nagroid and NagMonDroid.

NagMonDroid did I not get working, probably because op5 Monitor only uses https as protocol.

Nagroid works like a charm:

The configuration is rather straightforward:

I wanted to use the Android SDK on my Ubuntu machine, mainly to grab screenshoots but also to play around with it.

I followed the guidelines at this guide, but it did not work. DDM just show garbage as the device and when trying to get a screenshoot it complained with:

54:42 W/ddms: Unable to get frame buffer: device (????????????)
request rejected: insufficient permissions for device

After some googling i figured out that I had to hack my udev rules.

I added to /etc/udev/rules.d/51-android.rules

SUBSYSTEMS=="usb", ATTRS{idVendor}=="0bb4", ATTRS{idProduct}=="0c87", MODE="0666"
 

and run

reload udev

The idVendor and  idProduct was found by running lsusb:

# lsusb
Bus 002 Device 011: ID 0bb4:0c87 High Tech Computer Corp. 

Now when starting DDM:

And I can take screenshoots:

For the first time I felt that this is more than a phone, for the first time calender integration works, for the first time I can use the builtin GPS, for the first time accessing the web with a phone works, for the first time downloaded software really works.

My favorite apps so far is:

• Nagroid, to be able to view my op5 Monitor status
• FONMaps, find hotspots for LaFoneras
• Car Cast, listen and download podcasts
• MapDroid, to use preloaded OpenStreetmaps and GPS without using any bandwidth. Perfect when abroad because of the crazy price of data roaming outside Sweden.
• HTC Facebook, read and post on facebook
• FON Access, automatically connect to FON hotspots when traveling.
• GPS Logger, logg tracks in gpx format that almost any GPS software understand
• Sipdroid, to connect to my Asterisk PBX using 3G or WiFi

Of  cource the device is not perfect, I miss:

• The phone must be ‘rooted’ to be real useful, why? Open the phone so the community and others can develop apps that are real useful. Vendor lock-in always sucks.
• IPSec VPN so I can connect to my IPSec based OpenBSD firewall. The IPSec implementation in the phone sucks.
• OpenVPN, there exists OpenVPN apps but to use the the phone must be ‘rooted’
• Bluetooth modem, it is not possible to use the phone as a modem using bluetooth
• Screenshots, the phone must be rooted or using the SDK to take screenshoots. Why?

I really hope that Google and/or HTC understand and use the power of the community to make the Android even more succesfull by open it even more.

I bought a Fonera 2.0g WLAN router and I wanted to extend the functionality to have the possibility to add packages from OpenWRT. I also wanted the possibility to manage my new router with ssh.

The way to achive this is by installing developer firmware.

Installing

I followed the instructions at Fons beta/developer wiki.

The image I used can be found here.

Test

I try to connect by using ssh

peter@peter-laptop:~$ ssh -l root 192.168.10.1
root@192.168.10.1's password: 

BusyBox v1.11.1 (2009-04-17 12:45:57 CEST) built-in shell (ash)
Enter 'help' for a list of built-in commands.

                                        __
                                    _.-~  )
                         _..--~~~~,'   ,-/     _
                      .-'. . . .'   ,-','    ,' )
                    ,'. . . _   ,--~,-'__..-'  ,'
                  ,'. . .  (@)' ---~~~~      ,'
                 /. . . . '~~             ,-'
                /. . . . .             ,-'
               ; . . . .  - .        ,'
              : . . . .       _     /
             . . . . .          `-.:
            . . . ./  - .          )
           .  . . |  _____..---.._/ ____ Seal _
     ~---~~~~----~~~~             ~~                

                      Flipper                       

--------  Fonera 2.0 Firmware (v2.2.5.0) -----------
      * Based on OpenWrt - http://openwrt.org
      * Powered by FON - http://www.fon.com
----------------------------------------------------