All posts by onlyconnect

When backups fail

Jeff Attwood has lost the content from two popular blogs that he runs:

http://blog.stackoverflow.com
http://www.codinghorror.com

thanks to:

100% data loss at our hosting provider, CrystalTech.

He gives a little more detail here. He is now trying to recover data from search engine caches such as Google’s – a painful business, apparently; Google banned his IP.

Backup is a complex problem. I’d been meaning to post on the subject following another recent incident. Here’s a quote from an email a friend received from his ISP after asking whether the SQL Server database was backed up:

Needless to say, we do back the databases up every 12 hours to a remote location automatically.

Just 11 days later “a crucial disk” failed on that SQL Server; following which the ISP discovered that its recent back-ups were also “corrupt” and data was lost. In the end a data recovery specialist was enlisted and most, but not all data recovered.

No doubt the post-mortem will reveal multiple issues; but it shows that knowing backups are being done is insufficient. You have to do test restores as well, because the backup might not be working as well as you think.

In addition, as Attwood is now tweeting:

don’t trust the hosting provider, make your OWN offsite backups, too!

Good advice for those of us using commodity ISPs. But it also gives me pause for thought following the CloudForce event I attended earlier this week. A specialist like Salesforce.com has more resources to put into data resilience than any of its users. So if Salesforce.com (or Amazon, or Google, or Microsoft) is your ISP, is it then OK to leave backup to them?

Technorati Tags: ,

The virtual Small Business Server 2008 backup problem

Microsoft’s Small Business Server 2008 is supported running as a Hyper-V guest; but there’s one nasty problem. The built-in backup expects external USB drives, and a Hyper-V guest does not have direct access to USB.

Here’s a solution I’ve come up with. It lets you use the built-in backup wizard, and lets users simply attach a new external USB drive each day as they expect. It is not perfect, since it requires copying the entire backup afresh to the USB drive, rather than doing a differential backup – though SBS itself still does a differential backup. It also requires Hyper-V 2008 R2, which means struggling with server core if you use the free version. Still, it’s better than any solution I’ve seen from Microsoft.

Salesforce Chatter: Twitter-like status updates for the Enterprise

Today I attended Cloudforce in London: essentially the Salesforce.com Dreamforce conference on tour. The platform marches on: CEO Marc Benioff says the company is growing at 20% per year, and in general the customers I spoke too seem pleased with their choice. Benioff was as usual full of jabs at the “old stuff” – things like Siebel, Microsoft Office, anything that is not Cloud – but made so many jibes aimed at SharePoint that I began to think he has some respect for Microsoft’s document collaboration platform.

The major theme of the conference was Chatter, which is being rolled out to Salesforce.com users next year. Chatter takes key features from Twitter, including status updates and followers, and integrates them with the platform. There is also a Facebook-like profile page for all users. We saw several possible applications for the feature:

  • Keeping in touch with what colleagues are up to
  • Keeping in touch with progress on specific projects or opportunities, which can have their own status feeds
  • Using the Chatter mechanism as a commenting system, for example for collaborating on a draft document

There is a security mechanism, whereby alerts can be restricted to certain people or groups. You can also filter alerts to reduce noise.

We also saw a desktop client built with Adobe AIR, for monitoring status feeds in the same style as familiar Twitter clients.

While I don’t question the potential of Chatter, the current craze for Twitterising everything reminds me of the hype around RSS a few years back, which which it has many parallel. In the end it is another way to communicate, with better contextualisation than email and less vulnerability to spam.

Twitter itself has little chance of penetrating the Enterprise, when it is so easy to re-implement its essential features.

There was not much developer content here, sadly, though we did see a “30 minute Cloudforce application” in one of the sessions. It was all wizard-drive data form design, and strongly reminiscent of what we used to with the likes of Access and FileMaker, but all browser-hosted. One difference though is that the Salesforce platform has built-in workflow and approval. Another advantage is that you are in effect extending an application that already knows about your organisation’s users and contacts. The result is that working applications can be put together quickly, provided that they fit nicely with the platform model.

How Microsoft adds COM to everything

I’ve been writing a retrospective on Microsoft and noticed an intriguing pattern.

When Microsoft was fighting the browser wars, it first of all developed its own web browser, and then added COM (ActiveX).

When Microsoft was countering Sun’s Java, it came up with its own implementation, Visual J++. Key differentiator: COM integration.

When Microsoft was responding to Adobe Flash, it came up with its own implementation, Silverlight, and then – you guessed.

The reason is that COM is the gateway to everything Windows; but it is a frustrating habit for those who want to live in a cross-platform world.

Review: Sansa’s iPod alternative

The number of shelves dedicated to non-iPod music players in the average electronics retailer seems to shrink with each passing year, and as I write the top 10 bestselling MP3 players at Amazon.co.uk are all iPods, so it’s good to note that Apple alternatives still exist. As it happens, I’d been using an iPod Nano for a few weeks when Sansa’s latest Clip+ turned up for review; and it makes an interesting comparison.  

Feature-wise, the Sansa falls somewhere between a Nano and a Shuffle. There’s no camera, games or accelerometer on a Sansa Clip, and at 4GB it has half the storage of the least capacious Nano (though see below); but unlike a Shuffle the Clip has a screen, an FM radio, and a voice recorder.

Sansa’s device also has something all the iPods lack: a slot for a Micro SD or SDHC card, which means you can plug in extra capacity up to 16GB.  This port also supports a concept called slotRadio, where you purchase 1000 pre-selected songs on a card, but they are locked to that card. A slotRadio card costs $39.99 in the USA; as far as I can tell they are not available yet in the UK.

In use, the Sansa Clip+ offers none of the tactile pleasure of an iPod; but check out the price. This particular model is £34.99 at Amazon.co.uk; a new-generation Nano is over £100 and even a 4GB Shuffle is over £55.00.

The good news is that the Clip+ sounds very good. That’s just as well, since I doubt many will care about slotRadio (especially in the UK). Expandable storage is a nice feature, though I’d more likely stick in 4GB and forget about it, rather than trying to manage a set of tiny SD cards.

Another strong feature of the Clip+ is that it plays FLAC and Ogg Vorbis as well as MP3, though I’d have liked to see MP4 in there too, for DRM-free purchases from iTunes. I also like being able to attach the Clip+ to a PC via USB and simply copy songs to it, rather than having to use Apple’s bloated iTunes.

Still, I have to admit that the controls are rather fiddly and annoying; I kept clicking back when I needed to click the centre button and sometimes vice versa.

In the end, there are two reasons to get a Clip+. One is because you like having an Apple-free musical life. The other is because you value function over form. The Clip+ does a great job at a lower price than an iPod; but if you like the silky feel and stylish appearance of Apple’s toys, this alternative is not going to win you over.

Technorati Tags: ,,,

Fear of Google

Shares in Rightmove, a UK web site for house sales, have dropped  by move then 10% over the last couple of days, following a report by the Financial Times that “Google is in talks with British estate agents to launch an online property portal.”

I do not know what chances of success this venture has. Google does not instantly dominate any market into which it moves; the combination of Google Checkout and Google Shopping hasn’t killed off PayPal/eBay or Amazon as yet.

What interests me though is the impact of the rumour. It is not  only Google’s size and profitability; it is the fact that Google is for many (most?) people the portal to the Web, giving it huge power to reach any Web-based market.

The restraining factor is that it is difficult for Google to exploit that power without falling foul of legislation that protects free markets. When I search for a product on Google, I don’t see any evidence that it favours its own shopping site, for example; though having said that I am only one click away from the Shopping link at the top of the page that searches only Google’s site.

Still, drawing the line between what is and is not reasonable is hard to do. For example, what if Google had a “search for houses on sale here” link in Google Maps?

If Android and later Chrome OS succeed, Google may become the portal to more than just the Web. Its services will have geo-location data as well. Its data-gathering algorithms might learn our shopping and eating out preferences and guide us with uncanny prescience towards things that we enjoy.

I am not surprised that Google rumours have the power to move markets.

Importing folders to SharePoint

I’ve been working with Small Business Server 2008 recently and one of the tasks was to import an existing shared folder into SharePoint.

You would have thought that would be trivial, but it turns out it is not quite so. The normal suggestion is to open a SharePoint library in Explorer and do the import there. That’s actually not ideal. One problem is that, at least in our case, it does not work on the server though it does work on workstations. I suspect this is some arcane permission problem or feature; but doing this over the network is inefficient. Another issue is that Explorer is not smart about things like setting the date to that of the original, which can be annoying. A third problem is that some characters are allowed in document names on the file system, but not in SharePoint – such as  & { } and %. If your Explorer copy hits one of these the copy will fail.

I looked for a script-based solution, initially using PowerShell, but came across SPIEFolder instead. This is a simple C# application. Once I’d figured out that you have to run it from an elevated command prompt, it worked fine. However, it only imports into the top level of a SharePoint library. I added a target subfolder argument to SPIEFolder, and some name mangling to deal with illegal characters, and now it does what I want. I’ve not changed the default file date behaviour yet; but I think I can see how do do this if necessary: see http://msdn.microsoft.com/en-us/library/ms439259.aspx for the code.

Google Gears out, HTML 5 in: what this means for offline web apps

I was interested to read that Google is abandoning Gears in favour of HTML 5.

While that makes sense, it is a hassle for developers who have developed for Gears, since there are differences between features such as HTML 5 local storage and Gears LocalServer. The Gears API was tidy and effective so in some ways I’m sorry to see it go, though a broad standard will be much more useful.

Still, this does mean that you can develop to the HTML 5 standard for Offline Web Applications with some hope that, although broad implementation is lacking now, it will come in future. Even IE 9 is likely to have a fair amount of HTML 5 in it.

It is a critical standard because the success of something like Google’s Chrome OS will depend on it. Nobody can count on being always connected.

In the meantime, there are also offline features in Adobe Flash and Microsoft Silverlight.

How many people buy software from sites like this?

Over the weekend I was helping a student find the best price for some software, taking advantage of any educational discounts on offer. We tried Google and soon came up with a company offering excellent prices.

Unfortunately all the software on offer is pirated. If you make a purchase, you are doubly caught: first you have downloaded software that is no more legal than what you might get for free from a torrent; and second you have paid good money while acquiring nothing of value.

But how would you know? I admit, it did not take me long. I went to the terms and conditions, and saw stuff like this:

2.3. You have no possibility to register the software with the producer and updates are accessible for selective commodities.
2.4. The printed license documents will not be available for you.
2.5. We will not give you a disk with a copy of software.

I also noticed that the About Us gave no address nor even a country for the store; and that Contact Us was just a web form, no address or telephone number. Finally I looked up the domain name which is registered to a gentleman in Slovenia; a web search on the name brings it up in connection with other fraudulent ecommerce sites – though frankly it would be surprising if anyone of that name exists at all.

Nevertheless, I would be intrigued to know how many people do purchase from these sites. After all, many of us don’t read the small print; and we may know that both OEM and educational discounts are a reality, and that downloaded software can be cheaper.

I was interested to know how I would be asked to pay, so I commenced a purchase for Adobe CS4 Master Collection for just $299.00. Proceed to checkout, and I ended up on an SSL connection which raised no alerts from the browser bad-site protection in any browser that I tried. In fact, the certificate checked out OK, secured by Equifax Secure Global eBusiness CA-1.

Naturally I declined to enter my credit card details.

Still, I can imagine someone who is in a hurry or not expert in the wiles of the web thinking everything is OK. For all I know, there may be many satisfied customers out there, who got cheap software and do not know or care about its origins.

It strikes me that both the search engines and especially the SSL certificate providers could do better at defending against this kind of scam.

In the meantime, how can you tell if a site is genuine? My suggestions:

1. Disregard any familiar logos – particularly if they are images without links. This example has logos from Shop.Com, PriceGrabber.com, CNet Certified Store, and BBB Accedited Business. Just images.

2. The fact that you got to the site through a Google search or even a Google ad tells you nothing about its legality.

3. Look at the About and Contact details. Genuine companies have address, company registration and tax details, which you can also look up elsewhere. Lack of any such details is suspicious.

4. If the prices seem too good to be true, they likely are.

5. Text in broken English is a dead giveaway – but I’ve noticed the scammers getting better at this.

6. If in doubt, use a well-known and trusted retailer instead.

Technorati Tags:

A few observations on King Crimson: The Court of the Crimson King

DGM has released a magnificent CD/DVD box set reissue of King Crimson’s classic debut, The Court of the Crimson King.

Maybe I will write more about this when I have listened to it properly, but in the meantime a few observations.

This is completist heaven. There is always argument about whether reissues should feature the original mix (for authenticity) or a new mix (to benefit from modern noise-free mixing techniques). The makers of the recent Genesis boxes contentiously chose the latter. DGM by contrast offers both.

Not only that, you get several versions of both. You get a new 2009 mix in CD and several DVD versions – several DVD versions because only DVD audio players can cope with the highest resolution, and most people only have DVD video players – so we end up with a 2009 surround mix in two audio versions; a 2009 stereo mix in two audio versions; and the original mix as mastered in 2004 in two audio versions.

It doesn’t stop there. We also get a needledrop from the first pressing of the UK vinyl release on Island Records; and an alternate take version of the album with different performances, such as an instrumental-only 21st Century Schizoid Man.

Then there are the other extras: the full version of Moonchild; a live concert from 1969 (Hyde Park, July 5th combined with Filmore East, New York in November); a mono album mix issued for US radio.

If 5 CDs and a DVD aren’t enough for you, you can also enjoy the LP-size box, which enables the original artwork to be printed at its proper size, and inserts including a well-written 24 page booklet, two photographs from the era, and rattling aimlessly about inside, two little badges.

But I promised some observations, not just a description. I love the album; never be deceived by the opening clamour of 21st Century Schizoid Man, this is thoughtful music, not a mindless thrash. It was extraordinary hearing it for the first time; I’m not sure when that was for me – not 1969, but a couple of years later. It might have been on that wonderful Island Records sampler, Nice Enough to Eat, which I listened to in 1972 or thereabouts. If any album deserves this kind of treatment, this one does.

It was particularly thoughtful of the compilers to include the vinyl needledrop and the full-size artwork. Still … as it happens I have the record, not the first pressing, but an early ILPS, 4U matrix if you really want to know.

I played the record and then the CD needledrop. You know what? My record sounds better to my ears. Oddly, on the “declicked” needledrop you can easily hear pre-echo of the opening salvo of Schizoid, where it goes from very quiet to very loud. This is a vinyl flaw, where a quiet groove picks up a faint echo of the louder groove which follows it. My cut doesn’t have that, at least not audibly. It also sounds richer, more open, more dynamic.

Another thing I noticed: the artwork. Honestly, you have to see an early pressing of the original LP to appreciate this very striking image. The definition is much better, the colours more vibrant, those eyes – they stare manically out of the original, in the new print they are muted.

I’m guessing that they didn’t manage to get hold of the original artwork, and that what we have here is a print of a print.

Never mind. If you love this album, get the box; it is fantastic. You can get it from burning shed.