Tim Anderson's ITWriting » blogging

Gadget Writing – iPhone docks, 5.1 headphones, mobile, gaming and more

tim — Mon, 31 Jan 2011 11:02:01 +0000

I have started a new blog over at gadgets.itwriting.com which is for reporting on mobile, audio, gaming and other such enthusiasms. The main reason is to have somewhere to cover these subjects without diluting the focus of itwriting.com itself.

Currently on Gadget Writing:

AVI preparing a successor to the ADM 9.1 – the floorstanding ADM 40

Surround sound 5.1 headphones–why and why not. Roccat Kave reviewed

How to get better sound: higher resolution, or something else?

Review: Audyssey iPhone Audio Dock South of Market Edition

and a few more bits and pieces.

What you read in 2010: top posts on ITWriting.com

tim — Wed, 29 Dec 2010 10:24:38 +0000

With three days to go, traffic on ITWriting.com in 2010 is more than 50% up over that of 2009 with over 1 million unique visitors for the first time. Thank you for your attention in another crazy year in technology.

So what did you read? It is intriguing to look at the stats for the whole year, which are different in character from stats for a week or month. The reason is that over a short period, it is the news of the day that is most read – posts like The Java Crisis and what it means for developers. Over the year though, it is the in-depth technical posts like How to backup Small Business Server 2008 on Hyper-V that draw more readers, along with those posts that are a hit with people searching Google for help with an immediate problem like Cannot open the Outlook window – what sort of error message is that?

The most-read post in 2010 though is in neither category. In July I made a quick post noting that the Amazon Kindle now comes with a web browser based on WebKit and a free worldwide internet connection. Mainly thanks to some helpful comments from users it has become a place where people come for information on that niche subject.

On the programming side, posts about Microsoft’s changing developer story are high on the list:

Lessons from Evernote’s flight from .NET

Microsoft wrestles with HTML5 vs Silverlight futures

Microsoft’s Silverlight dream is over

Another post which is there in the top twenty is this one about Adobe Flash and web services:

SOA, REST and Flash/Flex – why Flash does not PUT

along with this 2009 post on the pros and cons of parallel programming:

Parallel Programming: five reasons for caution. Reflections from Intel’s Parallel Studio briefing

This lightweight post also gets a lot of hits:

Apple iPad vs Windows Tablet vs Google Chrome OS

It is out of date now and I should do a more considered update. Still, it touches on a big theme: the success of the Apple iPad. When you take that alongside the interest in Android tablets, perhaps we can say that 2010 was the year of the tablet. I first thought the tablet concept might take off back in 2003/2004 when I got my first Acer tablet. I was wrong about the timing and wrong about the operating system; but the reasons why tablets are a good idea still apply.

Watching these trends is a lot of fun and I look forward to more surprises in 2011.

Speeding page load with dynamic JavaScript

tim — Tue, 15 Jun 2010 03:49:38 +0000

I’m delighted that ITWriting.com is sufficiently popular to sustain some advertising. I’m not pleased though with the impact on performance. The problem is that ads such as those from Google Adsense or Blogads are delivered by remote scripts. It usually looks something like this in the HTML:

When the browser encounters this script, it stops and waits until the script returns. This means that your site’s performance depends on the performance of the site serving the script. At times I’ve noticed significant slowdown – though to be fair, Google is normally faster than most others in my experience.

So how can this be fixed? I’ve spent some time on the problem, but with limited success. Ideally I’d like an Ajax-y solution where the ads flow in after the rest of the page had loaded and rendered, because the content is more important than the ads. The first step though is to place the scripts at the end of the page, so that the rest of the content is downloaded first. However, the ads have to appear towards the top of the page, otherwise the advertisers will not be happy. I tried inserting the script dynamically like so:

var addiv = document.getElementById("addiv"); //where the ad is to appear
var theScript = document.createElement("script");
theScript.type="text/javascript";
theScript.src = "http://some/remote/script.js";
addiv.appendChild(theScript);

While this works after a fashion, it does not do the job. The problem is that the script typically calls document.write. If you are lucky, the ad will appear at the bottom of the page. If you are unlucky, the ad will replace the entire page.

What I needed to do is to capture the output sent to document.write and then insert the HTML dynamically. It turns out that JavaScript makes this easy. We can simply override document.write with our own function. Like so:

var addiv = document.getElementById("addiv"); //where the ad is to appear
var adHtml = ”;
var oldWrite = document.write;
document.write = function(str)
{
adHtml += str;
}

document.write = oldWrite;
addiv.innerHTML = adHtml;

This is brilliant, and in fact works perfectly for some of my ad scripts. Unfortunately it does not work for the slowest performer. The problem is that I have no control over the content of the remote script. In the non-working case, the remote script does not return HTML. It returns another script, which references another remote script. Now I have to figure out how to handle all the possible cases where scripts return scripts, which might or might not call document.write.

I’d be interested if anyone has a generic solution. There is a library here that looks like it might be helpful.

Another reflection is that it is in the interests both of advertisers and publishers to have scripts that execute fast and/or behave in a predictable manner that is friendly towards deferred loading techniques. It is no use writing convoluted code to deal with a particular script, when it might change at any time and break the site.

A note to RSS subscribers

tim — Thu, 21 Jan 2010 09:02:03 +0000

This blog has a full-text RSS feed. In other words, you can read the entire contents of a post without visiting the site – though I hope you will visit the site from time to time to read the comments, like the excellent discussion on web vs desktop applications here.

The reason for this note is that the feed broke for some subscribers recently; and the reason it broke was that I’d hacked the code to ensure that you get full text feeds and not excerpts with a “read more” link. I had hacked the code not because WordPress was broken exactly, but because of a legacy problem. The feed for this blog used to be http://www.itwriting.com/blog/rss.php. WordPress still supports this URL, but without my hack it delivers excerpts, even though WordPress is set for full text. The hack works; but it is perilous because I use Subversion to keep WordPress up-to-date. If I modify the WordPress source, and then the same file gets updated in the official source, then Subversion inserts some stuff in the file to assist in resolving the conflict. That’s fine, except that it may break the PHP until I get round to fixing it. There’s also a risk that the modified file will no longer work because of changes elsewhere.

The sane solution then is not to modify the WordPress source, but to ask you to use the modern, approved and up-to-date RSS feed URLs which are:

http://www.itwriting.com/blog/feed for RSS

and

http://www.itwriting.com/blog/feed/atom

for Atom.

If you use Google Reader, for example, I suggest you remove the existing subscription and add a new one with one of the above URLs.

That said, the old URL now works again, but with excerpts and not full text. The reason is not that I want you to visit the site, add to my page views and enjoy the unobtrusive advertising (though I do); it’s because of the technical issue above. Now you know how to fix it.

Fixing a WordPress plugin setting

tim — Tue, 19 Jan 2010 20:25:30 +0000

I changed the theme and plugins used on this blog recently. Along the way I managed to slightly corrupt the settings for one of the plugins, GD Star Rating, the result being that the stars in the Top Rated Posts widget would not display. I figured out the problem: the plugin stores the path to the graphics which represent the stars, and this had incorrectly been set to an https path. Since I use a self-generated SSL certificate, the result was that browsers did not trust the connection and refused to display the graphics.

Unfortunately this path is not configured directly in the plugin options, as far I can see. I temporarily changed it to display a text rating while I worked out how to fix it.

The setting had to be in the MySQL database somewhere; and I found it. It is one value in a massive 10,000 character field called option_value, in the main options table. It seems that most of the settings for the plugin live in this single colon-separated field, even though the plugin also creates 12 tables of its own for the ratings data. Hmm, I don’t like the way this implemented. How often does this field get queried and parsed?

Still, the immediate problem was to alter the value. I ran up the MySQL interactive SQL utility and typed very carefully. This is where one false move can obliterate your WordPress install; I’m reminded of someone I knew (not me, honest) who set all his company’s customers to have the same address with a careless update missing its WHERE clause. Fortunately this is only a blog. Transactions are also good. Anyway, what could go wrong? it was a simple combination of UPDATE, REPLACE and WHERE.

It worked, the stars have returned, and I know a little bit more about the innards of WordPress and this particular plugin.

Seven years of blogging, and a redesign

tim — Sun, 10 Jan 2010 16:16:52 +0000

This blog began in 2003, though the website goes back to 2000, and I now see little difference between what is now a blog, and what in 2000 was a more painful process of authoring web content, especially with the decline of RSS readers. Still, my first blogging efforts were powered by a now-defunct project called bblog. I modified this heavily to add features and cope with comment spam – almost non-existent in 2003 – and then in 2006 accepted that I would be better off with a mainstream blog engine and selected WordPress, which has exceeded my expectations.

When I moved to WordPress I picked a theme which met my requirements, then modified it to tidy up the layout and to support non-intrusive advertising. I found myself to some extent boxed in once again, since I could not change or upgrade the theme without losing my modifications. This also meant I was missing out on newer features of WordPress. Widget support is a breakthrough feature, letting you add features to the site through a simple drag-and-drop admin page, but I could not use them. I also wanted to support gravatars, which show an image chosen by the author alongside their comments, and to add a ratings system.

Ratings are a lot of fun, though not really reliable as a gauge of quality. If your article extolling the merits of the Xbox 360 gets linked by a PlayStation fan site, or your article critical of Apple gets linked by an Apple fan site, there is little chance of a fair rating. Some readers also find it difficult to separate what they think about the subject matter from what they think about the quality of reporting. Even so, ratings are always interesting and I’d like to include a list of best-rated posts.

It has taken me some time to find a theme that looked right for my needs, but I have now settled on Atahualpa from BytesForAll. It is a popular theme, so my blog will look similar to many others, but it is flexible and I’ve been able to add the most important features by modifying settings rather than editing the raw PHP, a critical issue for upgradability. I’ve also added rating support with GD Star Rating.

As ever, it is work in progress, and I expect to modify the design and add features as time allows. Although it may not look much improved yet, it is much easier to modify in a maintainable fashion, so expect more changes soon.

A year of blogging: another crazy year in tech

tim — Thu, 31 Dec 2009 22:55:41 +0000

At this time of year I allow myself a little introspection. Why do I write this blog? In part because I enjoy it; in part because it lets me write what I want to write, rather than what someone will commission; in part because I need to be visible on the Internet as an individual, not just as an author writing for various publications; in part because I highly value the feedback I get here.

Running a blog has its frustrations. Adding content here has to take a back seat to paying work at times. I also realise that the site is desperately in need of redesign; I’ve played around with some tweaks in an offline version but I’m cautious about making changes because the current format just about works and I don’t want to make it worse. I am a writer and developer, but not a designer.

One company actually offered to redesign the blog for me, but I held back for fear that a sense of obligation would prevent me from writing objectively. That said, I have considered doing something like Adobe’s Serge Jespers and offering a prize for a redesign; if you would like to supply such a prize, in return for a little publicity, let me know. One of my goals is to make use of WordPress widgets to add more interactivity and a degree of future-proofing. I hope 2010 will be the year of a new-look ITWriitng.com.

So what are you reading? Looking at the stats for the year proves something I was already aware of: that the most-read posts are not news stories but how-to articles that solve common problems. The readers are not subscribers, but individuals searching for a solution to their problem. For the record, the top five in order:

Annoying Word 2007 problem- can’t select text – when Office breaks

Cannot open the Outlook window – what sort of error message is that? – when Office breaks again

Visual Studio 6 on Vista – VB 6 just won’t die

Why Outlook 2007 is slow- Microsoft’s official answer – when Office frustrates

Outlook 2007 is slow, RSS broken – when Office still frustrates

The most popular news posts on ITWriting.com:

London Stock Exchange migrating from .NET to Oracle/UNIX platform - case study becomes PR disaster

Parallel Programming: five reasons for caution. Reflections from Intel’s Parallel Studio briefing – a contrarian view

Apple Snow Leopard and Exchange- the real story – hyped new feature disappoints

Software development trends in emerging markets – are they what you expect?

QCon London 2009 – the best developer conference in the UK

and a few others that I’d like to highlight:

The end of Sun’s bold open source experiment – Sun is taken over by Oracle, though the deal has been subject to long delays thanks to EU scrutiny

Is Silverlight the problem with ITV Player- Microsoft, you have a problem – prophetic insofar as ITV later switched to Adobe Flash; it’s not as good as BBC iPlayer but it is better than before

Google Chrome OS – astonishing – a real first reaction written during the press briefing; my views have not changed much though many commentators don’t get its significance for some reason

Farewell to Personal Computer World- 30 years of personal computing – worth reading the comments if you have any affection for this gone-but-not-forgotten publication

Is high-resolution audio (like SACD) audibly better than than CD – still a question that fascinates me

When the unthinkable happens: Microsoft/Danger loses customer data – as a company Microsoft is not entirely dysfunctional but for some parts there is no better word

Adobe’s chameleon Flash shows its enterprise colours – some interesting comments on this Flash for the Enterprise story

Silverlight 4 ticks all the boxes, questions remain – in 2010 we should get some idea of Silverlight’s significance, now that Microsoft has fixed the most pressing technical issues

and finally HAPPY NEW YEAR

Technorati Tags: flash,silverlight,tim anderson,google,apple,.net,microsoft,sun,oracle,adobe

10 Mac alternatives to Windows utilities

tim — Wed, 02 Sep 2009 16:27:13 +0000

I’ve been spending an extended time on the Mac in order to explore Snow Leopard. As far as possible, I’ve done all my work on the Mac since its release. The trial will be over soon … but in the meantime I’m sharing notes on some of the utilities I used for tasks I normally do on Windows, in no particular order.

1 Capturing screenshots

On Windows I press PrintScreen or Alt-PrintScreen (for the current window), then paste into an ancient copy of Paint Shop Pro 5.0 for trimming and re-sizing. No, it’s not PhotoShop, but it loads in a blink.

For the Mac I use Ctrl-Command-Shift-3 (whole screen) or Ctrl-Command-Shift-4 (selectable area) which adds a screenshot to the clipboard. Then I use the latest Preview, which has a File – New from Clipboard option. I love Preview – it has tools for further trimming and resizing, and when you save it shows the file size as you select different formats. Since I often want to minimise the size for a web page, it’s ideal.

2 Secure file transfer

I avoid FTP for security reasons, so on Windows I normally use WinSCP for secure file transfer.

On the Mac I use Fugu, and of the two I prefer it.

3 Word processing

On Windows I use Microsoft Word. On the Mac I mainly use NeoOffice, which actually felt a bit nicer than its parent, OpenOffice. I also spent some time with Word 2008 (good for compatibility, but slow) and Apple’s Pages from iWork 09. One nice feature of Pages, for journalism, is the stats window that shows the word count as you type.

4 Web browsing

I used Safari, in order to get the most complete Apple experience. I’m getting to like the Top Sites feature, though it’s hardly essential, especially the way it shows at a glance which pages have changed.

5 Sound editing

On Windows I use Audacity. On the Mac I use … Audacity, though for some reason I found it slightly less smooth.

6 Playing FLAC

Apple is still stubbornly refusing to support FLAC in iTunes or Quicktime. My solution was Songbird, a great alternative, which supports FLAC straight out of the box, or rather download.

For converting to FLAC I used MacFLAC, though I found it less than robust. I missed dbPowerAmp (Windows).

7 Remote desktop

I find Remote Desktop invaluable for managing servers. On the Mac I used the official Remote Desktop client, which worked well though it falls slightly short of the Windows version (perhaps this is a policy!).

8 Twitter

I use Twhirl on both Mac and Windows, an Adobe AIR application. One oddity (getting picky): the font spacing is slightly better on Windows. In the word Blog, for example, there is too much space between the B and the l, but only on the Mac.

9 Email

I never thought I’d say I missed Outlook, but I did. The thing is, after much experimentation I’ve found a permutation that works really well on Windows: 64-bit Windows and Outlook 2007 SP2 in online mode (only for a desktop, of course).

On the Mac I use Mail, but I’ve found it less than satisfactory even though I run Exchange 2007 with all the required configuration.

10 Blog authoring

On Windows I use Live Writer, which is superb.

On the Mac I write posts (like this one) in the WordPress online editor. I don’t like it as much, but it does the job.

11 Bridge

Now this one is a problem . I find JackBridge ideal for those moments when I need a break from work. It won this year’s World Champion computer bridge contest.

The Mac is not so well served, but I have trialled Bridge Baron and found it not bad at all.

More RSS madness from Microsoft – this time it’s Live Mail

tim — Wed, 28 Jan 2009 19:47:49 +0000

Once upon a time I was enthusiastic about the “common feed list” in Windows. I thought there was all sorts of potential for sharing and synchronizing content across the network. When it was introduced, Microsoft called it the Windows RSS Platform, though it gets installed as part of IE7.

What’s curious is that even Microsoft doesn’t seem to use the platform in the way it was (presumably) intended. I opened up Windows Live Mail 2009 today (I use it only occasionally as a newsgroup reader), and was puzzled to see 6724 unread feed items.

What’s going on? Well, I use the IE7 feed list and access it either in IE7 or in my own home-brew reader, which uses the COM API to the common feed list.

Windows Live Mail had grabbed the list of feeds and made its own copy of all the data. Am I sure? Yes, first because of this suspicious option in Live Mail:

“When deleting a feed here, also delete it from your Internet Explorer feed list” – implying synchronization, not a common database. Note also the jargon; the Live Mail folk clearly think of this as a feature of IE, not a feature of Windows.

I also took a look in:

C:\Users\USERNAME\AppData\Local\Microsoft\Windows Live Mail\Your Feeds\

and there is was, a copy of all the entries in X-MimeOLE format. The real common feed list, by contrast, is stored in:

C:\Users\USERNAME\AppData\Local\Microsoft\Feeds

It is not quite as bad as it first appears. When I chose to sync the feeds in Live Mail, the unread items synchronized with those in IE7. I am also hopeful that the data is only retrieved from the Internet once. though it is hard to be sure. A quick experiment suggests that if you delete a feed in IE7, it stays in Live Mail, though it no longer updates (one or other of these facts could be a bug). If you delete a feed in Live Mail it is deleted from IE7 unless, presumably, the box in the dialog above is checked.

The Outlook team made a similar error, but worse, because the feeds end up messing up your Exchange mailbox as well.

So why doesn’t Live Mail simply present a view of the common feed list, like my home-brew reader? Well, maybe the API is not robust or fast enough. The solution then is to fix the common feed list, not to do all this error-prone synchronization.

The whole thing would make more sense if the feed list was synchronized with the cloud, so that I could also read my feeds on the Web, in the style of Google Reader. Despite the name, Live Mail seems thoroughly bound to the desktop. It is simply an update to Outlook Express.

Technorati tags: rss, ie7, microsoft, live mail, outlook, windows live, outlook express

2008 on IT Writing: browser and OS stats, plus what you’ve been reading

tim — Thu, 01 Jan 2009 14:25:22 +0000

There were 780,000 unique visitors to this site in 2008, according to my stats, up from 650,000 in 2007.

OS stats

Windows 80.5% (down from 82.1%)

Mac 4.2% (up from 4%)

Linux 4.1% (up from 3.5%)

Browser stats

IE 51.5% (down from 58.8%)

Firefox 25.3% (up from 20.5%)

Opera 4.1% (up from 3.2%)

Safari 2.8% (up from 2.5%)

Chrome 0.6% (new, not available all year)

Most read 2008 posts

Note: some of the most-read posts in 2008 were published in 2007 or earlier, including Outlook is slow, RSS broken (complete with 188 comments), and Annoying Word 2007 problem – can’t select text (248 comments) – both examples of users searching for fixes to problems with Microsoft software.

From 2008, these were the 10 most read:

Fixing wifi on Asus Eee PC 901 with Linux

Vista SP1 vs Server 2008 as a desktop OS: more comparisons

Why I can’t use Microsoft Live search for real work (I now think some of the problems mentioned in this post are to do with inappropriate localization)

More Silverlight, Visual Studio setup hassles

VirtualBox is amazing, 50% faster than Virtual PC on my PC (intriguing as a recent review I saw claimed that Virtual PC is actually faster than VirtualBox).

CNN Daily Top 10 spam shows failure of user education

Changing the motherboard or storage controller underneath Windows XP and Vista

What’s new in Delphi 2009

Counting Primes in Flash and Silverlight (see also tests for Alchemy, JavaFX and Chrome)

Debugging PHP code to fix a WordPress problem