Hey Folks,

It’s my pleasure to announce the immediate availability of FrameOS 5.5 Beta 2.

Get it from here:

http://download.frameos.org/frameos-5.5b2.iso

You can check the ISO image integrity once downloaded using the following command:

checkisomd5 frameos-5.5b2.iso

Changes in FrameOS 5.5 Beta 2:

* KVM 88 + libvirt 0.8.3 with netcf support now in the FrameOS official repo (see the HOWTO).
* Chef client 0.9.6 installed by default (Once again, thanks to the great packages from Matthew Kent’s ELFF repository)

Enjoy!

Follow this steps to install kvm-88 + libvirt 0.8.3 (with netcf support).

First of all, install FrameOS :D

download.frameos.org

1. Install KVM And Libvirt

yum install kvm –enablerepo epel

2. Configure Libvirt to listen for TCP/IP connections (Optional)

To simplify the setup, edit /etc/libvirt/libvirtd.conf and set:

listen_tls = 0

WARNING:
Disabling TLS connections is a security risk. Do not use that in a production environment.

Edit /etc/sysconfig/libvirtd

And make sure the line:

LIBVIRTD_ARGS=”–listen”

3. Reboot

After the reboot, you will be able to manage the FrameOS KVM box using virsh or RedHat virt-manager

References:

https://fedorahosted.org/netcf/

http://libvirt.org/

http://wiki.libvirt.org/page/Networking

http://www.linux-kvm.org/

So, here is the list on what’s coming to FrameOS 5.5, final release:

* Chef 0.9.6
* Libvirt 0.8.2 + kvm-88 (userland)
* More rubygems and ruby stuff packaged and available in the FrameOS repo. In no particular order:
– Phusion Passenger
– JRuby
– Trinidad ( Calavera, dude, be ready. I’ll need your help ;) )
– Rails 2.3.8
– Related gems and packages to make it possible

If everything goes according to the plan, the final release is scheduled for Q4, 2010.

But before that, there’s going to be a new Beta2 (beta3 and RC will follow) in a couple of weeks, including the following changes:

* Chef 0.9.6 installed by default
* Libvirt 0.8.2 + KVM88 available in the FrameOS repo

To all the ruby lovers and devops out there. Let me know what you want or what you thing! ;)

We’ve got a Google Groups ready now at:

http://groups.google.com/group/frameos-linux

And a brand new and shiny Tender support account (special thanks to the nice folks @tenderapp):

http://support.frameos.org

Enjoy!

Phew!

It has been a crazy month… but finally I made it. It’s my pleasure to announce the immediate availability of FrameOS 5.5 Beta1!!!

www.frameos.org

FrameOS is a CentOS 5 based Linux distribution targeting the following users:

1. DevOps

* Opscode Chef is installed by default. One less step to tame the DataCenter beasts.
* Built-in kickstart profiles to perform a single step installation.

2. Ruby Enthusiast and Developers

* Ruby Enterprise 2010.2 release as the default ruby installation.
* Rubygems 1.3.6 installed.

3. Virtualization Gurus

* Gitco Xen 3.4 and 4.0 ready
* Modern kvm/libvirt stack.

4. Freedom Lovers

This is the very best OpenSource we all love. No closed source here, no sales crap in the middle ;).
Send me feedback, participate in Google groups and open bugs. No matter what you feel about the distro, share it!

—

I’d love to send special thanks to the CentOS crew, FrameOS would not exist without them. You have taught me so much, and brought me so far… Thank you!

To the ELFF, Gitco, EPEL and RPMForge repo maintainers: You’ve made my ops live easier for quite a few years, come and visit me @ Barcelona, I owe you a couple of beers ;)

To the Ruby and Chef community: You made infrastructure automation fun for all of us!

Kinda exhausted right now!. I’ll post tomorrow what’s coming to the next beta, links to relevant docs, roadmap and some other stuff.

Have fun!

howlingmine-client
====

0.1.4 / 2009-12-23
—–

* Added Issue.find method
* Updated examples
* Added script/console script
* Requires howlingmine-server 0.2

howlingmine-server
======

0.2 / 2009-12-23
—–

* Added find action to the plugin controller

Links
===
[http://github.com/rubiojr/howlingmine-server](http://github.com/rubiojr/howlingmine-server)

[http://github.com/rubiojr/howlingmine-client](http://github.com/rubiojr/howlingmine-client)

[Howling Mine](http://github.com/rubiojr/howlingmine-server) is a [Redmine](http://redmine.org) plugin that allows you to query Redmine issues via HTTP GET/POST, returning JSON in the response.

howlingmine-client is a thin wrapper around the http interface provided by the howlingmine-server plugin.

Installing the redmine plugin
=============================

Before using the client library you need to install the howlingmine-server plugin in Redmine. There are official docs on how to do this (see [here](http://www.redmine.org/wiki/redmine/Plugins)). Anyway, these are the steps required:

**IMPORTANT: the server plugin has only been tested in Redmine 0.8 stable branch, I don’t know if it will work with current trunk or past releases.**

Now reload the redmine server (passenger, mongrel, nginx, whatever…) and check if the plugin has been detected going to **Administration->Plugins** in the Redmine web interface.

You’ll need to generate an Email API Key if you haven’t done it yet:

In Redmine, go to **Administration->Settings->Incoming Emails** tab and generate the key there.

That’s all, you are ready to test the plugin.

Using the Howling Mine Client library
=====================================
First of all, install the client library from gemcutter.org:

gem install howlingmine-client


Now let’s show our Redmine who’s the boss here:

There are a lot of things to implement and optimize in the current release, but don’t hesitate and open a ticket at [http://github.com/rubiojr/howlingmine-client/issues](http://github.com/rubiojr/howlingmine-client/issues) if you have something in mind.

Enjoy!

Related pages
=============
**Github**

[Howling Mine Client](http://github.com/rubiojr/howlingmine-client)

[Howling Mine Server](http://github.com/rubiojr/howlingmine-server)

**Howling Mine Client Docs**

[rdoc.info](http://rdoc.info/projects/rubiojr/howlingmine-client)

1. Install AppFactory and MacRuby

gem install appfactory (gemcutter.org needs to be in your gem sources)

Get MacRuby from http://macruby.org

2. Create the script for the application

3. Generate the Application Bundle

appfactory –appname DeliciousReader –dsl delicious_reader_dsl.rb –bundle rest-client

Voila!

Check the screencast: http://appfactory.netcorex.org

The previous post with a twist!

The code:

mr_status_bar_app_growl.tar.gz

Here’s what you can do with a few lines of ruby and the power of MacRuby:

Install MacRuby and run the ruby script with it

macruby app.rb

You will see a new icon in your statusbar

Uploaded with plasq‘s Skitch!

Click it to show the menu.

Enjoy!

Download the code

mr_status_bar_app.tar.gz

Get MacRuby

http://macruby.org

Read Part II

Adding a permanent view

1. Fire up Futon (CouchDB Web Interface)

2. Open the chef database (click the chef link)

3. Select “Temporary view…” from the select view dropdown

4. Add some javascript to the Map Function

5. Click “Run” to test the view

6. Save it as a permanent view

Click “Save As…” button in the form

There you go!. You can create as many views as you want, they will make your life easier :D

The new view will appear under my_views node in the view selector:

Testing Views Code with Temporary Views and Curl

curl -X POST -d @post_data_file --header 'Content-type: application/json' http://your-chef-couchdb-server.com:5984/chef/_temp_view

Where @post_data_file is a json file describing the view:

For example:

{
  "map": "
    function(doc) {
      var date = new Date();
      var ohai_time = parseFloat(doc.attributes.ohai_time);
      var ctime = ((date.getTime()/1000) - ohai_time);
      if(ctime > 3600) {
        emit(doc.attributes.fqdn, parseInt(ctime/3600));
      }
    }"
}

This will list all the nodes out of contact (ohai_time greater than 1 hour)

Some more useful functions:

http://gist.github.com/198908

Enjoy!

1. edit /etc/chef/client.rb
2. add the following line to the end of the file:

Ohai::Config[:plugin_path] << '/etc/ohai/plugins' #you can choose
any path you want

3. add your custom plugins there (i.e. /etc/ohai/plugins)
4. reload the client:
/etc/init.d/chef-client restart

As an example, you can find a custom plugin that extends virtualization attribute adding a guest_lists sub-attribute here:

http://github.com/rubiojr/ohai-plugins/blob/master/virtualization_extensions.rb

WARNING:

There are no official docs on adding custom ohai plugins to your chef client AFAIK, thus the stuff above is a hack. Use it at your own risk :D

UPDATE: sample ohai plugin renamed to virtualization_extensions.rb

If you need to restart all the chef-clients, this might be of some help:

for h in `chef_node_last_checkin -t 35 |awk '{print $1}'|sed 's/://'`; do echo restarting $h; ssh root@$h /etc/init.d/chef-client restart;done

Iterate over all the node names with ohai time (last time they contacted the chef-server) greater than 35 minutes and restart the client issuing a ‘/etc/init.d/chef-client restart’ via SSH.

chef_node_last_checkin is a script provided by chef_knives:

http://wiki.github.com/rubiojr/chef-knives/home

Some notes on proxying a chef-server with Apache.

Sometimes you have a chef-server outside your corporate firewall and the firewall is preventing your chef-nodes from accessing it (i.e. outgoing connections to 444/443 tcp are not allowed). You can setup a simple http proxy with Apache and proxy the nodes through it (if your proxy is allowed to establish a tcp connection to 443/444, that is). Then you can fake the IP address of the real chef-server with a private DNS server (or editing /etc/hosts files per host…)

                             CHEF-SERVER
                              213.X.X.X
                     (my-chef-server.example.net)
                                 |
                              FIREWALL
___________________________________________________________________
|INTRANET                        |                                |
|                                |                                |
|                            CHEF PROXY (Apache)                  |
|                           192.168.04.10                         |
|                       (my-chef-server.example.net)              |
|                                |                                |
|                 _______________|_______________________         |
|                 |              |                      |         |
|           CHEF_NODE1        CHEF_NODE2           CHEF_NODE3     |
|_________________________________________________________________|

Sample Apache VirtualHost config file for the proxy:

<VirtualHost *:444>
	ServerName my-chef-server.example.net
	ProxyPreserveHost On
	SSLProxyEngine on
	SSLEngine On
     # sample cert/key files. You should change this and point to a valid one
	SSLCertificateFile    /etc/pki/tls/certs/localhost.crt
	SSLCertificateKeyFile /etc/pki/tls/private/localhost.key
	SSLCipherSuite ALL:!ADH:!EXPORT56:!RC4+RSA:+HIGH:!MEDIUM:!LOW:!SSLv2:+EXP:+eNULL
	ProxyPass / https://real-chef-server-ip-here:444/
	ProxyPassReverse / https://real-chef-server-ip-here:444/
</VirtualHost>
<VirtualHost *:443>
	ServerName my-chef-server.example.net
	ProxyPreserveHost On
	SSLProxyEngine on
	SSLEngine On
     # sample cert/key files. You should change this and point to a valid one
	SSLCertificateFile    /etc/pki/tls/certs/localhost.crt
	SSLCertificateKeyFile /etc/pki/tls/private/localhost.key
	SSLCipherSuite ALL:!ADH:!EXPORT56:!RC4+RSA:+HIGH:!MEDIUM:!LOW:!SSLv2:+EXP:+eNULL
	ProxyPass / https://real-chef-server-ip-here:443/
	ProxyPassReverse / https://real-chef-server-ip-here:443/
</VirtualHost>

http://drop.io/rubyclient

Pangea goes to Hollywood!

http://www.xen-fu.org/blog/

Tired of trying to find the right ffmpeg flags to encode the video 4 your device?

Checkout Handbrake!

HandBrakeCLI -Z “iPhone & iPod Touch” -i matzs-keynote-small.mp4 -o matzs-keynote-small_iphone.m4v

Interesantes números midiendo el rendimiento de los diferentes ‘motores’ de expresiones regulares que hay en ruby.

Las pruebas se han hecho analizando un fichero de 1 millón de líneas de log de apache.

ruby1.8.7

require 'benchmark'

logfile = '/data/logs/httpd/old/1m'
fields = [
  '(\d+\.\d+\.\d+\.\d+)',    # ip
  '(.*?)',                   # ident
  '(.*?)',                   # user
  '\[(.*?)\]',               # datetime
  '"(.*?)"',                 # request
  '(\d+)',                   # code
  '(-|\d+)',                 # size
  '"(.*?)"',                 # referer
  '"(.*?)"',                 # user-agent
  '\[(.*?)\]'                # vhost
] 

re = "^#{fields.join('\s+')}$"
regex = /#{re}/

Benchmark.bm do |x|
  3.times do
    x.report {
      File.open logfile do |f|
        f.each_line do |l|
          regex.match(l)
        end
      end
    }
  end
end


rubiojr@desire:~/lparse_bench$ ruby ruby_regex.rb
user system total real
42.820000 0.430000 43.250000 ( 43.578923)
42.640000 0.520000 43.160000 ( 43.495074)
42.780000 0.540000 43.320000 ( 43.369753)

———————–

ruby1.9.1 r19983 (ejecutando el mísmo código de arriba)

rubiojr@desire:~/lparse_bench$ /opt/ruby1.9/bin/ruby ruby_regex.rb
user system total real
13.200000 0.150000 13.350000 ( 13.357268)
13.190000 0.180000 13.370000 ( 13.401657)
13.220000 0.120000 13.340000 ( 13.333555)

———————–

ruby1.8.7 + oniguruma

require 'rubygems'
require 'oniguruma'
require 'benchmark'

logfile = '/data/logs/httpd/old/1m'
fields = [
  '(\d+\.\d+\.\d+\.\d+)',    # ip
  '(.*?)',                   # ident
  '(.*?)',                   # user
  '\[(.*?)\]',               # datetime
  '"(.*?)"',                 # request
  '(\d+)',                   # code
  '(-|\d+)',                 # size
  '"(.*?)"',                 # referer
  '"(.*?)"',                 # user-agent
  '\[(.*?)\]'                # vhost
]

re = "^#{fields.join('\s+')}$"
regex = Oniguruma::ORegexp.new(re)

Benchmark.bm do |x|
  3.times do
    x.report {
      File.open logfile do |f|
        f.each_line do |l|
          regex.match(l)
        end
      end
    }
  end
end


rubiojr@desire:~/lparse_bench$ ruby oniguruma_regex.rb
user system total real
12.500000 0.570000 13.070000 ( 13.146782)
12.520000 0.600000 13.120000 ( 13.242722)
12.470000 0.530000 13.000000 ( 13.010874)


Oniguruma forma parte de ruby1.9, lo que parece que explica la similitud de los resultados obtenidos con ruby1.8+oniguruma y ruby1.9.1.

Está claro que el motor de ruby1.8 no es el candidato ideal para el WayFinder Project :D

Update: jruby1.1.6 RC1 (IcedTea6 1.3.1)

rubiojr@desire:~/lparse_bench$ jruby ruby_regex.rb
user system total real
17.260000 0.220000 17.480000 ( 18.085660)
16.430000 0.160000 16.590000 ( 16.888714)
16.240000 0.220000 16.460000 ( 16.728076)

JRuby 1.1 incluye un port de Oniguruma a Java, de acuerdo con las “release notes“

Hoy me han encomendado la ‘divina’ tarea de comprobar 6 cupones de la ONCE y ver si habían sido premiados, así que para no deprimirme demasiado he decidido inaugurar la sección del sake del blog.

Necesitarás tener rubygems, sake y mechanize instalado para poder usar la ‘divina’ herramienta:

gem install sake mechanize

A continuación instala el sake task:


wget "http://github.com/rubiojr/sake-tasks/tree/master%2Fonce%2Fcheck_number.sake?raw=true" -O once_check_number.sake

sake -i once_check_number.sake


La tarea ya está lista para ser usada:


rubiojr@desire:~$ sake once:check_number 20081101 01234 011
El número 01234 no ha obtenido premio en la fecha 01/11/2008.

rubiojr@desire:~$ sake once:check_number
Usage: sake once:check_number <fecha> <numero> <serie>


Powered by ScribeFire.

Oh man, LISA is awesome. Tech sessions finish today.

I loved Bruce Schneier, David Wagner and Tobi Oetiker talks, loved them!

Uploading some pictures to Google Picasa. Lovely sunny San Diego weather by the way.

Going back to Spain and the real life tomorrow :D.

peace.