Foto’s gemaakt door Nils, Patrick en Ronald

The bad part about my girlfriend moving in with me is that my friend who was living with me left and took our local sever with him. We had combined our spare hardware to build us a server and used his old computer because he had 4 ATA controllers and I had only 2. So now I had to configure my old PC to create a new server (’cause you just can’t live without one of those :) and bought an extra 1.5TB hard disk. That caused quite some trouble. Since the first wasn’t properly detected by my onboard SATA controller I returned it and the replacement seemed to work, only to be mounted as read-only after formatting it. After a while the disk wasn’t properly detected at all. I was surprised with two new disks having the exact same problem, fortunately so was the owner of the web shop where I bought it. He actually called me personally to discuss the situation and concluded that my SATA controller was probably to old to work properly with this big modern disk. So I bought an PCI eSATA controller which solved my problems.

Last weekend I took this card to my friend who also bought a new hard disk and was experiencing similar problems. After I put the card back my big disk wouldn’t mount anymore, though it worked fine when I booted the Ubuntu Live CD. Long story short (live cd: works, reinstall ubuntu: works, dist-upgrade: broken, reinstall: works, reboot: broken) there we suddenly some errors in the FS which fsck managed to fix.

Anyway, most of you aren’t at all interested in the above snipped of my life and want some technical information. Which you are going to get in the remaining part of this post. Hey, the benefit of people blogging technical stuff on their personal blog is that you have to read through the irrelevant stuff. Nothing is perfect, right?

Setting up ubuntu as an file server

I followed a great tutorial to set up AFP on my server which was very easy and everything works like a charm. Well, almost everything.

Permissions

Since there are two users connecting to the machine there are files created by both that also need to be accessed by both users. Setting the setgid bit on the shares directories and adding both users to a common group is a start, unfortunately there doesn’t seem to be a way to set the umask for newly created files using netatalk, so in order for other users to be able to write/delete these files I just add the group write permission with a hourly cron job. It’s ugly, but it does the job.

Time Machine

After a short time of backing up with Time Machine I got the infamous error 109.  Since this issue seems to have no solution and chances are slim Apple will do something about it since it they do not support it I decided to make only manual backups at night so they can run uninterrupted, and make backups of my time machine sparsebundle in case the backup gets broken. Yes, that does sound kind of redundant. It’s far from ideal, but a workable situation. I don’t need hourly backups anyway, I just want to have something in case of a hard disk crash or something like that.

Yesterday I read that netatalk 2.0.5 adds time machine support! Since the current version of netatalk in the ubuntu repo is still 2.0.4 I removed it and downloaded the netatalk-2.0.5-2 (and libdb4.8 which it depends on and is also not yet in the ubuntu repo) packages from the debian site and installed them with dpkg. This was all much easier than I expected since people on the web were warning others that this is not the proper way to go and everything might get broken and so on. After some initial errors (removing the .AppleDB directories after error -5014 and removing the old sparsebundle as root after error 109 on an partially removed sparsebundle) it now seems to work just fine.

Interesting to note is that with this new time machine support I indeed do not have to create the sparsebundle by hand and that it is now named Granny.sparsebundle (Granny is my laptops name) without the MAC adres. Also interesting is that TM started to continue backing up in a copy of an old backup I made by hand named Granny_macadres.copy.sparsebundle. Apparently the name of the backup is much more flexible nowadays.

Now I’m just going to make backups wireless hourly without paying attention to it (and thus interrupting it when putting my laptop to sleep) as I used to with my old Time Capsule and see if the new version of netatalk solves the problems I had. For now I’ve interrupted the initial backup several times now and it is still running (and continuing every time where it was interrupted). So far so good, I can at least say that it works more reliable than with the previous version of netatalk.

Update: after some initial success backing up to this AFP share is as unreliable as is was before, still getting a lot of 109 errors. Too bad. I decided to just buy an external USB/eSATA case and put the disk in that. It not expensive and works for sure, though I am deeply unhappy with the situation.

PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php/extensions/no-debug-non-zts-20060613/pdo_mysql.so' - (null) in Unknown on line 0

Following instructions in the comment to remove all architectures but the x86_64 have no effect. I think I have to compile my own PHP installation and have apache use that. Which sucks so much I decided to just wait for Snow Leopard and pray that either pdo_mysql is installed or dynamicly loading libraries is allowed there. I am happy to inform you all that the first is the case. Hurray!

Installation

I’ve decided not to upgrade my existing installation of Leopard but to go for a fresh clean installation. Leopard was my first OS X installation and I’ve done quite some installating, customization and so forth and it sounded like a good idea to just start fresh. I remember reading something about a clean install option, but the installer just asks me for the location, gives me some options what to install and starts right away. I had to abort, reboot, and then used the disk utility on the installer DVD to first format my hard drive. Installation went smooth from that point on.

First impressions are as expected, it works smooth. I am surprised about the time it takes to wake from sleep, almost instantly, but that can also be because this installation is fresh and I was used to my old cluttered Leopard.

Afterwards

Time to install some.

• Firefox 3.5
• Growl 1.2b4, the latest beta of 1.2 because 1.1 is uncompatible with snow leopard. It seems to work fine, as does the HardwareGrowler.
• Perian 1.1.4
• Spark 3.0b9 for global hotkeys
• iWork ‘09 en iLife ‘09
• Software updates (10.6.1)
• Textmate
• Latest flash version since Snow Leopard ships with an unsafe one.
• MacTex

And to tweak some.

• Copied my old ~/Music directory, iTunes starts with my good old library. Hurray
• Copied my old ~/Photos directory, iPhoto cannot open (made with a newer version). Running another software update was the key to success.
• The first sync with my iPhone authorizes my computer with the iTunes store and gives me all my contacts back. Nice!
• Uncomment the line LoadModule php5_module libexec/apache2/libphp5.so in /etc/apache2/httpd.conf to enable php5. Fortunately for me, snow leopard provides me with pdo_mysql which Leopard did not (and it wasn’t possible to just add that module).

And to get stuck at some.

• System clock, going to System preferences > International > Formats > Times (customize button) and changing the medium format doesn’t work anymore :(

My ToDo list also has some.

• mail multicolumn
• mail imap subfolder check
• spark firewall status scripts
• adium

More Tweaks

Firewall scripts

I take my laptop everywhere so I want to keep the built-in firewall fully closed at all times. I do, however, sometimes take it down if some sharing/program/game doesn’t work, and I almost always forget to enable it again afterewards. Thats what the following script is for. I use the cron daemon to run it every 5 minutes and it checks the firewall status and gives me a growl notification if it’s disabled.

#!/bin/sh
if [ `defaults read /Library/Preferences/com.apple.alf globalstate` -eq "0" ]; then
  echo Firewall is currently disabled | /usr/local/bin/growlnotify -a /Applications/System\ Preferences.app -t Warning;
fi

I also added an applescript to a global hotkey in Spark to change the firewall status. It checks the status, displays it with the options to change it with a timeout of 5 seconds.

# brings the dialog window to front
delay 1
tell me to activate

set fw_status to (do shell script "defaults read /Library/Preferences/com.apple.alf globalstate")

if fw_status is equal to "2" then
  set dlg_result to display dialog "Allow only essential services" with title "Firewall Status" buttons {"All", "Specific", "Essential"} default button 3 cancel button 3 with icon note giving up after 10
  set res to button returned of dlg_result
else if fw_status is equal to "1" then
  set dlg_result to display dialog "Set access for specific services" with title "Firewall Status" buttons {"All", "Specific", "Essential"} default button 2 cancel button 2 with icon caution giving up after 10
  set res to button returned of dlg_result
else if fw_status is equal to "0" then
  set dlg_result to display dialog "Allow all incomming connections" with title "Firewall Status" buttons {"All", "Specific", "Essential"} default button 1 cancel button 1 with icon stop giving up after 10
  set res to button returned of dlg_result
end if

if res is equal to "All" then
  do shell script "defaults write /Library/Preferences/com.apple.alf globalstate 0"
  display dialog "Set to 'Allow all incomming connections'" with title "Firewall Status" buttons {"OK"} default button 1
else if res is equal to "Specific" then
  do shell script "defaults write /Library/Preferences/com.apple.alf globalstate 1"
  display dialog "Set to 'Set access for specific services'" with title "Firewall Status" buttons {"OK"} default button 1
else if res is equal to "Essential" then
  do shell script "defaults write /Library/Preferences/com.apple.alf globalstate 2"
  display dialog "Set to 'Allow only essential services'" with title "Firewall Status" buttons {"OK"} default button 1
end if

And now I can easily change the status of my firewall

So I am puzzled. Why would Microsoft launch a new product, show off its great features and then put a website live that doesn’t do any of the promised features? Looks to me like they have just doomed Bing.

Sommige dingen zijn dusdanig banaal dat een genie ze echt niet meer aan kan.

I started playing around with several scripts and GeekTool because it looked cool at first and it was fun to do some shell scripting. As the amount of information displayed on my desktop grew I started wondering why I was creating a lot of small processes taking up a little CPU time. I hardly ever look at my desktop because of all the windows in front of it. But the stats now on my desktop are easily accesable with one key (F11), and some starts are already displayed in either the menu bar or my iStat Pro widget. Removing it there gives me more room in the menu bar (which is starting grow full of icons) and saves some resources used by the widget.

Now I shall explain the GeekTool entries I created more detailed.

Battery

You can get a lot of information about your battery with the ioreg command. I found a battery status script which doesn’t work on leopard but with plenty of comment in the code to use it as a reference for the output of ioreg and write a little script of my own which prints the status, charge and time remaining. The code should be pretty self-explanatory.

#! /bin/sh
#
# Battery status script, writen by Ronald Chu for GeekTool usage. Free to
# use as you please.
#
# Prints the current charge, time remaining on battery power or the AC
# power status

# Create an array (Capacity, Voltage, Flags, Current, Amperage, Cycle Count)
# in 10.6 the order has changed to (Amperage, Flags, Capacity, Current, Voltage, Cycle Count) so we need to re-order
if [ -n '`sw_vers |grep ProductVersion:.10.6`' ]; then
  status=(`ioreg -w0 -l|grep LegacyBatteryInfo|sed -e 's/[^1234567890]/ /g'|awk '{print $3" "$5" "$2" "$4" "$1" "$6}'`)
else
  status=(`ioreg -w0 -l|grep LegacyBatteryInfo|sed -e 's/[^1234567890]/ /g'`)# Fix Amperage (convert large number to negative one)
  status[4]=$(expr ${status[4]} + 0)
fi

# if charger connected
if [ $((${status[2]} & 1)) == 1 ]; then
  #if battery is charging
  if [ $((${status[2]} & 2)) == 2 ]; then

    # Calculate minutes until  fullycharged
    if [ ${status[4]} -lt 0 ]; then
      mins=''
    else
      mins=`echo "(${status[0]}-${status[3]})*60/${status[4]}"|bc`
      if [ $mins -gt 59 ]; then
        mins=`printf ", %d:%02d until full" $(( mins / 60 )) $(( mins % 60 ))`
      else
        mins=`printf ", 0:%02d until full" $mins`
      fi
    fi
    echo `echo "${status[3]}*100/${status[0]}"|bc`"% (charging$mins)"
  else
    perc=`echo "${status[3]}*100/${status[0]}"|bc`
    if [ $prec -lt 100 ]; then
      echo "$perc% (not charging)"
    else
      echo "100% (charged)"
    fi
  fi

# if charger not connected
else
  # Calculate minutes until empty
  if [ ${status[4]} -ge 0 ]; then
    mins=''
  else
    mins=`echo "- ${status[3]}*60/${status[4]}"|bc`
    if [ $mins -gt 59 ]; then
      mins=`printf "(%d:%02d remaining)" $(( mins / 60 )) $(( mins % 60 ))`
    else
      mins=`printf (0:%02d remaining)" $mins`
    fi
  fi

  echo `echo "${status[3]}*100/${status[0]}"|bc`"%$mins"
fi

Hard disk

I only care about the free space on my main hard disk and not at all in what other drives, shares, disk images and so forth are mounted. So I filter and reformat output of df to show just that.

df -h | grep 'disk0s2' | awk '{print $4" free ("$5" of "$2" used)"}'

Memory

Calling top and extracting the memory usage is pretty simple. I am planning to extract much more information from top (like the load en processes using the most CPU time) later.

top -l 1 | awk '/PhysMem/ {print $8 " used, " $10 " free"}'

Network

I’ve written a bash script that takes the name of a network interface as a parameter and returns its status, IP address, the SSID if it is an airport connection and last but not least the amount of data sent and recieved. The comment in the code should explain everything.

#! /bin/sh
#
# Network status script, writen by Ronald Chu for GeekTool usage. Free to
# use as you please.
#
# Prints status, ip, trafic and (if aplicable) SSID name of the airport and
# ethernet connection. Network IO is stored with timestamp in milliseconds
# in a text file so with the difference in time and bytes the IO in bytes
# per second can be calculated.

workdir="/Users/ronaldchu/Applications/Scripts/GeekTool/"

# parameter is a number of bytes * 100 (for float precision)
function formatBytes()
{
  if [ $1 -lt 102400 ]; then echo `echo "scale=2; $1/100"|bc` b; else
    if [ $1 -lt 104857600 ]; then echo `echo "scale=2; $1/102400"|bc` Kb; else
      echo `echo "scale=2; $1/104857600"|bc` Mb;
    fi
  fi
}

# The script takes the name of the interface as a parameter
if [ $# -lt 1 ]; then
  echo "Parameter missing"
  exit 1
fi

# Check if interface exists
ifconfig $1 > /dev/null 2>&1
if [ $? -ne 0 ]; then
  echo "Interface \"$1\" does not exist"
  exit 2
fi

#Extract ip adress
ip=`ifconfig $1 | grep "inet " | grep -v 127.0.0.1 | awk '{print $2}'`

if [ $ip ]; then

  # Make IO info string "
  IO_now="`${workdir}milliseconds` `netstat -ib | grep -e "$1" -m 1 | awk '{print $7" "$10}'`"

  # If there is an old IO info file
  if [ -f "${workdir}NetworkStatus_$1_IO.txt" ]; then
    IO_old=`cat ${workdir}NetworkStatus_${1}_IO.txt`

  # else create one and sleep for a second
  else
    echo $IO_now > ${workdir}NetworkStatus_${1}_IO.txt
    IO_old=$IO_now
    sleep 1
    IO_now="`${workdir}milliseconds` `netstat -ib | grep -e "$1" -m 1 | awk '{print $7" "$10}'`"
  fi

  #calculate IO trafic in Kb/s
  IO_in=`echo $IO_old $IO_now|awk '{print "scale=0; (100*("$5"-"$2"))/("$4"-"$1")"}'|bc`
  IO_out=`echo $IO_old $IO_now|awk '{print "scale=0; (100*("$6"-"$3"))/("$4"-"$1")"}'|bc`

  # Write current IO info
  echo $IO_now > ${workdir}NetworkStatus_${1}_IO.txt

  # Echo network status (with SSID iff the network interface is the airport)
  if [ $1 == "en1" ]; then
    SSID=`/System/Library/PrivateFrameworks/Apple80211.framework/Versions/Current/Resources/airport -I|grep '[^B]SSID' |sed -e 's/^[^:]*: //'`
    echo "$ip ($SSID) `formatBytes $IO_in`/s down `formatBytes $IO_out`/s up"
  else
    echo "$ip `formatBytes $IO_in`/s down `formatBytes $IO_out`/s up"
  fi

else
  echo "Disconnected"
fi

To obtain the timestamp for the network data readings using date isn’t accurate enough, so I use the following little C program to get a more accurate timestamp.

#include <stdlib.h>
#include <sys/time.h>

main()
{
  struct timeval tv;
  gettimeofday(&tv, NULL);
  printf("%d.%d\n", tv.tv_sec, tv.tv_usec);
}

Twitter

What else can I do? Well, whenever you want add something fancy you can always do something with Twitter! It makes you modern and Web 2.0, and stuff like that. Also it was extremely easy to add the latest tweets from my friends to my desktop with only one single command.

curl -u username:password http://twitter.com/statuses/friends_timeline.rss?count=20| \
grep title|\
tail -n 20 |\
sed -e 's/.*\(.*\)<\/title>/\1/'

iTunes

For information on the track currently playing in iTunes I’ve combined several scripts and ideas from others and myself to create an applescript which extracts the album art and returns the artist, title and album of the current song. Add another entry in GeekTool to show the image, which is a PNG file in a fixed location. In my case, this is located at file:///Users/ronaldchu/artwork.png

# iTunesCurrentSong.scpt
#
# An applescript which returns the title, artist, album and player
# status of iTunes and writes the current album art (or blank if
# iTunes not running, or a default image if no art available) to a
# png file
#
# Network status script, writen by Ronald Chu for GeekTool usage. Free to
# use as you please.

# folders specs
set artworkFolder to ((path to home folder) as text) & "Applications:Scripts:GeekTool:"
set artworkFile to artworkFolder & "artwork.png"
set artworkiTunes to artworkFolder & "artwork.pict"
set artworkBlank to artworkFolder & "blank.png"
set artworkDefault to artworkFolder & "default.png"
set unixArtworkFile to the quoted form of POSIX path of artworkFile
set unixArtworkiTunes to the quoted form of POSIX path of artworkiTunes
set unixArtworkBlank to the quoted form of POSIX path of artworkBlank
set unixArtworkDefault to the quoted form of POSIX path of artworkDefault

# Check if iTunes is running
tell application "System Events"
	set powerCheck to ((application processes whose (name is equal to "iTunes")) count)
	if powerCheck = 0 then
		# If there's no iTunes running use the Blank Arwork
		do shell script "cp " & unixArtworkBlank & " " & unixArtworkFile
		return ""
	end if
end tell

tell application "iTunes"

	# Get current track name and status
	try
		set playerstate to (get player state)
	end try
	if playerstate = paused then
		set trackPaused to "
"
	else
		set trackPaused to ""
	end if
	if playerstate = stopped then
		# If there's iTunes use the default Arwork.
		do shell script "cp " & unixArtworkDefault & " " & unixArtworkFile
		return "

"
	end if

	set trackID to the current track
	set trackName to the name of trackID
	set artistName to the artist of trackID
	set albumName to the album of trackID

	(* Is there any Artwork? *)
	if (count of artwork of trackID) ≥ 1 then
		set artworkData to data of artwork 1 of trackID
		set fileRef to (open for access artworkiTunes with write permission)
		try
			set eof fileRef to 512
			write artworkData to fileRef starting at 513
			close access fileRef
		on error errorMsg
			try
				close access fileRef
			end try
			error errorMsg
		end try

		tell application "Image Events"
			launch
			set theimg to open artworkiTunes
			scale theimg to size 100
			save theimg as PNG in artworkFile with replacing
			close
		end tell

	else
		(* If there's no Artwork use the default artwork. *)
		do shell script "cp " & unixArtworkDefault & " " & unixArtworkFile
	end if

	return trackPaused & "
" & artistName & "
" & trackName & "
" & albumName
end tell

For some reason the code contains html code for special character like < and &. I’ll look into this later, for now you just have to change that when copying the code. Also I’m having lot’s of difficulty with getting syntax highlighting working right, damnit…

Update 07/06/09: Changed the battery script so it will show “100% (charged)” instead of “100% (not charging)”.

Update 23/06/09: Please leave a comment if you like my scripts, or if you don’t. I’d love to get some feedback and know how many of the visitors google analytics reports to me are actualy using the scripts

Update 24/08/09: Updated the battery script, changed > to -gt to actualy do a greater-than comparisation instead of dumping into a file called 59.

Update 27/11/09: Added a version check to the BatteryStatus script because the order of the battery info has changed since 10.6

And sometimes being right is wrong after all.