Scribbles – my final clutter frontier

Like  many other people, I wrote some poetry in my youth, wrote a few pieces of text and went through a phase of avid doodling. The term ‘scribbles’ refers to all these things, as well as to diary entries, though I’ve already dealt with my own diaries so they are not included in this particular journey. The various bits of paper on which my scribblings were scribbled were shoved into folders over the years such that I now have a two inch stack of unsorted material – the final set of material that is cluttering up my cupboard. There is no point in keeping it in its current state – it is taking up valuable space and will only get thrown out when I die. I want to organise it, reflect on it, and even make use of it in some way. For, example, for some years I’ve had a notion that the doodles might be combined into some much larger picture.  I’m hoping some ideas will emerge as I go through the material.

A Platform Challenge story (Win10)

My recent attempts to upgrade from Windows 7 to Windows 10 is a good illustration of some of the platform challenges associated with digital preservation planning. The background to this tale is that my lifetime collection of work documents is held in a document management system called Fish which employs an underlying SQL Express database to store the digital documents. The high level index to the collection is contained in a FileMaker database which integrates with Fish via some simple commands. All these pieces of software run on a laptop under the Windows 7 operating system.

Last year, when I first heard about Microsoft’s plan to enable users to upgrade to Windows 10 for free for an initial period, I decided that I would take advantage of the offer but would leave it till close to the cut-off date – which turned out to be the day before yesterday (29Jul2016).  In the intervening months, FileMaker issued yet another new version of its database (15) which I decided to take up (at £280) as my current  version (11) was no longer going to be supported, and I wanted to have a version which I could be sure would work successfully under Windows 10.

With FileMaker 15 in place, I got confirmation from my document management supplier that Fish does work under Windows 10, and so set about preparing to undertake the Win10 upgrade. The upgrade screen informed me that there were no incompatibility problems with any of my software, and my wife had already undertaken the upgrade successfully on her laptop at the first time of asking with the anti-virus programme that we both employ still running, so I thought there was fighting chance that the upgrade might go smoothly. I made a comprehensive set of backups, and set the upgrade going. It failed, giving me the rather cryptic error message 80070004-3000D. I soon discovered that , despite this being such a specific error number, there is no specific reason for failure associated with it. I spent many hours over the following four weeks trawling the net and reading a whole variety of advice from Microsoft and others about this error.

One of the first things I came across alerted me to potential problems with the SQL Express database that I was running. After further research I eliminated that as being a reason for the failure of the upgrade, but I did discover that Microsoft were not going to support the version I am running (2008R2) under Windows 10. I discussed this with my document management system supplier who advised that they had recently performed an upgrade to a later version for a client but that it hadn’t been entirely straightforward. They advised me to delay upgrading the database as long as possible. I checked the net again and found at least one entry saying that SQL Express 2008R2 was working under Windows 10, so I decide to set aside the SQL challenge for the time being.

I subsequently tried out a whole variety of suggestions I found on the net to overcome the error including removing superfluous user profiles; checking that folders such as Programme Files, Programme Data and Users are in the same directory as the OS; running scannow; checking I don’t have a proxy server; checking I have no empty folders in the Start Menu; checking that my computer name is not System or other reserved name and is more than 8 characters long; checking regedit to ensure that OS upgrades are allowed; performing the upgrade in Administrator mode; and creating a new Administrator role and upgrading from that. None of these worked across about 8 upgrade attempts, and each time I got the same 80070004-3000D error message.

Finally the deadline passed, and I was glad to be able to be able to stop the whole very time consuming and frustrating exercise. However, Microsoft was able to deliver a final sting from its very long and uncontrolled tail: I tried to write to them alerting them of my inability to find a solution to 80070004-3000D and asking them to confirm I would still be eligible for a free update if and when I did. I used a box on one of their ‘Contact us’ support screens which said something like ‘describe your problem here’ and which had a NEXT button underneath. I wrote out my problem, but, on pressing the NEXT button, another screen appeared which said ‘this page doesn’t exist’. Highly annoyed, I returned to the previous screen, copied my text, put it in a mail message to myself so it was properly date stamped, printed it out and sent it to the UK Microsoft HQ in Stockley Park. I do not expect to hear back from them.

For now I will continue using Windows 7, and the question of whether and when to upgrade to Windows 10 will become just another platform question that will need to be addressed in the Digital Preservation Planning exercise I intend to embark on for my document collection in the next six months or so.

DPC Webinar

The DPC webinar on ‘Preservation Planning for Personal Digital Archives’ took place last Wednesday (29th June), and I duly gave my talk to a small select audience of about a dozen people. I believe this included one person from the Bodleian Library, one from the UK Parliamentary archives and two separate groups from the UN Archives and Records group – one based in Long Island and the other in New York.  The Q&A at the end was interesting, but too short – I know I would have enjoyed spending more time talking about practical problems with these professionals. The two questions I can remember both came from the UN groups who are considering providing guidance to UN staff about how to preserve their digital files. The discussion highlighted that the Maintenance Plan I am proposing should eventually result in people not having very old unreadable files because the Maintenance Plan would be ensuring that they are regularly updated.

The full Webinar was recorded and is available via the DPC website at this link http://www.dpconline.org/index.php?option=com_content&view=article&id=1720:dpc-webinar-preservation-planning-for-personal-digital-archives-with-paul-wilson&catid=33:conference-reports NB. This link no longer works. The webinar is now at the following link – though permissions are required: https://www.dpconline.org/events/past-events/webinars/dpc-webinar-preservation-planning-for-personal-digital-archives

However you may just want to look at the Powerpoint slides that I used which have speaker notes included.

In both the DPC paper and the webinar, I made it clear that I was looking for collaborators to apply the Preservation Planning process to my document collection; and a repository for the collection. Now that I’ve been able to publicise these wants through these DPC activities, I’m hoping that I might hear from someone who is interested. However, whether or not any such people emerge, I’m aiming to start the Preservation Planning work on my document collection towards the end of this year or early next – that will be the next phase of my digital preservation adventure.

Webinar and Staging Posts

The DPC is running a webinar on the contents of my paper on 29th June, and yesterday I completed the slides for it. With that done, I am completely up to date with all of my Journey activities and this left me feeling unburdened and relaxed.

By chance, yesterday was also the day on which Richard Harper, a sociologist colleague from my CSCW days, dropped in for a chat. I’d come across Richard’s name in a paper I’d read in the course of my investigation into Digital Age Artefacts. The paper recounted insightful work into what people actually kept in their houses – highly relevant to stuff I’m doing – and I remember Richard as being a particularly interesting person to talk to. I looked him up on the web and discovered he had spent many years at the Microsoft Research Centre in Cambridge in the Socio-Digital Systems Group, investigating topics such as the myth of the paperless office and  communications in the digital age. I got to thinking that it would be great to talk to him to get a different take on what I’d been doing and what I might do next. I managed to reach him through his blog and we arranged for him to call in here in Lavendon on his way home from a trip to Chipping Norton (the scene of the three CSCW meetings which he and I attended in the early 90s). Before he arrived I spent an hour listening to four or five of his talks on YouTube, and then we had a very pleasant couple of hours discussing digitisation stuff over lunch.

It was good to see Richard again – and very kind of him to spend the time with me. As a result I have all sorts of new thoughts and perspectives rolling round my head which I know will take a few weeks to work through and take shape. Our conversation was the perfect opportunity to reassess what I’m doing before I set out on the next phases of these journeys. An immediate thought that shines through, though, is that perhaps I should treat my future ventures to make use of the digital artefacts I have collected, as though they were one of the treasure hunt type games that I have occasionally devised for my family. i.e. things that are occasional and intriguing and fun.

So, yesterday certainly felt like a memorable staging post in the things I have been doing. Oh, and by the way, as I write this I’m discovering that this morning appears to be a staging post in the UK’s journey – we appear to have voted to leave the European Union…

DPC Press Release

The DPC press release announcing the availability of my paper on it’s website, was issued today. It’s contents are below:

‘Preservation Planning for Personal Digital Collections’ Case Note and Toolset by Paul Wilson is now available on the DPC website.

Paul Wilson, formerly of the Office Systems Division at The National Computing Centre, has contributed a new addition to the Case Notes now available on the Digital Preservation Coalition (DPC) website.

In this new Case Note, Paul narrates his attempts to create a preservation plan for a small personal collection. In the fuller article (which can be downloaded as a PDF), he outlines his experiences to provide insights into the practical outcomes of using published guidelines and tools for preservation planning. Since he could find no preservation planning process appropriate to individuals, Paul obtained a slide set detailing a simple preservation workflow from the Digital Preservation Coalition, and used that as a foundation on which to establish an approach to the work.

This general approach and accompanying documentation was tested and refined on two of his personal digital collections (one of 800 mementos and the other of 17,000 photos).

“I recounted my PDF experiences not to alert others to specifics about PDF (about which I know very little) or the eCopy software (which I am generally very pleased with),” he explains, “but to illustrate how complicated and time-consuming work on file formats can be.”

The detailed account of his research and preliminary trials provides a set of guidance for any individual or institution looking to preserve their own small, digital collection. Paul has also provided the documents he created from scoping to maintaining his collection, along with blank template versions that can be easily used and adapted by others. All of the documents, as well as blank templates, are available to download as a Toolset.

This case note also appears in the DPC’s Technology Watch Report Personal Digital Archiving by Gabriela Redwine

*Apologies for cross posting*

Sarah Middleton, Head of Communications and Advocacy, Digital Preservation Coalition, 37 Tanner Row, York, YO1 6WP

Paper published by the DPC

Over the last few weeks I’ve been working with Sara Thomson in the Digital Preservation Coalition (DPC), to get my paper revised and on to the DPC web site. That work was duly completed last Monday and the paper is now accessible on the DPC website in the Publications/Case Studies section at http://www.dpconline.org/advice/case-notes. Publishing the paper on a website is much better than having it in a conventional journal because the web publication makes it easy to provide the template documents as downloadable attachments that people can use. Let’s hope there are some takers. I’ve also been able to add a section at the end explaining that I am seeking a permanent repository for my PAWDOC collection and/or callaborators to apply the digital preservation process described in the paper, to the PAWDOC collection.

The DPC will be sending out a press release about the paper in the next few days to various mailing lists; and, beyond that, I believe the DPC want to arrange a webinar sometime in the next few months to air the contents of the paper. I’m hoping that all this publicity may spark some interest in the PAWDOC collection.

Reflections on Letter Keeping

Having been through most of the personal letters I’ve received over the last 50 years or so, digitised them, kept a few and torn up the rest, it’s a good moment to reflect on what letter keeping is all about.

It seems I started collecting letters in my mid-teens, though I can’t really remember why. Perhaps, as the numbers started to grow, they acquired the status of a collection, and from that point there was no turning back. Anyway, I know that later on in life – around my thirties perhaps – as life became more hectic with family and work, I perceived that I could refer to the letters to refresh my memory of what people had told me about their lives, and when we had last communicated. Indeed when I started getting newsy emails from people, I specifically stored them with file titles which included a date and a short summary of the most significant information they contained. I had a notion that this would enable me to quickly glance down the file titles to refresh my memory of children’s names, what jobs people had etc.. I still believe that is useful, and, now that I’ve converted the whole collection to be primarily digital, I shall digitise all the physical missives I get and allocate file names accordingly; and I’ll also continue to store some of the more interesting emails in the same folders. As time goes by I’ll see if the file names prove useful or not.

As I ploughed through the exercise of digitising some 1900 letters and cards, I realised it was going to take just too long to have a separate file for each item. Instead, I scanned all the letters from one individual into a single PDF file. This has the advantage that it makes it very easy to quickly leaf through a whole set of letters – a fact I can vouch for because I went through each PDF to make sure the scans were the right way round, in the right order etc.. In fact, it’s left me with a warm feeling knowing that all these personal communications from my friends are just a few keystrokes away. Furthermore, I know from my previous experience with mementos, that when I move them onto the iPad, they’re going to be even easier, quicker and more enjoyable to get at and browse through. When the collection was in concertina files in the loft, it was an effort to go and find a letter and then read it – so much so that it was really impractical unless there was a particular necessity for doing so. Now, I can get at most of the letters I have ever received in my life within a few seconds and read them at my leisure. Of course, it’s not something I’m going to be doing very often – but when I do want to refer to something, it’s quite an extraordinary capability to have.

Of course most people simply won’t have a letter collection to digitise in the first place and probably won’t want to be bothered to start building one up. However, that’s not the main reason why such collections these days may be quite unusual. The fact is that we are sending and receiving far fewer hardcopy missives than we used to. Instead, people are sending emails and texts, and are talking to each other in social media sites. Furthermore, the messages they are sending are shorter and more focused. The long discursive communication covering a variety of topics is becoming rarer.

Since the newer systems are already digital, one would think it would be easier to collect the messages and retrieve them at will. That is true to some extent. However, it only really applies within a single system and not across multiple systems, because to keep on top of exporting the volume of messages individuals get today to a single unitary store would be impractical, and, even if you got them all into single store, some may lose their formatting and readability. Even being able to access very old messages in a single system relies on you staying with a particular service provider instead of moving around; and on that service staying in business over the long term. This hasn’t been the case in the past when old systems have disappeared and new systems have emerged. Whether the systems around today (such as Facebook, for example) will possess such stability, has yet to be seen. In principle moving from one service to another shouldn’t mean that you lose your old missives, but it is often impractical to transfer material from old to new. For all these reasons, maintaining a unitary store of all one’s written communication today is far more difficult than just putting a letter into a concertina file!

The digital environment has one other distinct disadvantage – electronic files are far more likely to become unreadable than paper. To mitigate against obsolete hardware and software and general system malfunction, a rigorous backup and digital preservation regime has to be put in place and adhered to reliably over the years.

With all these thoughts in mind, it appears that my lifetime collection of letters is not just unusual but perhaps something that future generations will not even have the opportunity to possess. The technology that is allowing me to browse at will through my collection of letters is the very same technology that has destroyed the practice of letter writing. The teenagers of today will be able to easily retrieve their messages from the systems they are using, but they will be of such a volume and on such narrow topics that they may have no desire to collect them or browse through them.  As to collecting all their communications from all the systems they have used across a 50 year time scale – well, that seems not only unlikely but hardly worth the effort.

The numbers

The job of putting the letters into folders got finished last night. I’d previously used plastic concertina files but found them difficult to see into a slot to select letters from a particular individual and to get groups of letters in and out of the slot. In the light of this experience, I decided to use plastic display books with 40 pockets in each (about £1.40 each from Wilkos), and I’m finding these to be a much better storage vehicle for letters and cards. They do take a up a little more shelf space than concertina files – but not very much more; and that disadvantage is more than outweighed by the fact that they make it just so much easier to see and read the missives.

Now for some numbers: the approximate total number of non-email items I’ve kept over the last 50 years or so is about 1900 from about 145 people. Of these, about 760 were letters, 800 were cards, 100 were postcards, 81 were Xmas round robins, 16 were wedding invites or birth announcements, 28 were change of address or phone number cards, 20 were batches of photos, and 70 were sundry other documents. Of course I didn’t keep everything so these figures represent only a subset of the overall communications received.

When it came to deciding which of the items to keep after scanning and which to tear up and throw away, I initially destroyed about 1400 of the 1900 items. Of the remaining 500, I destroyed a further 90 in the course of trying to decide a set of reasons for keeping particular items. Hence, I have kept just over 400 physical items. Of these a substantial number (about 80) are airmail letters from my parents from when they were abroad when I was in my late teens / early 20s; and a further 130 are from my wife.

Excluding the above two major sets of items (airmails and from my wife), there were about 1660 items to start with (from about 145 people), of which about 260 were initially retained; and 200 made the final cut and were stored in folders.

Since the 1990s, some of the communications from my friends have come by email. I’ve left those numbers out of the statistics above because the figures I have are very inaccurate.  I have copied and saved particularly informative emails, and these amount to about 520 across about 45 individuals – but they are not all I received by any means. Interestingly, I also received and saved over 1500 emails from my wife when I was working – but this is atypical: I receive a daily Word-of-the Day email, and, when I was working and leaving home very early in the morning, I would forward it to her when I first checked my email at work with any salient message about that day’s events, and she would reply. It was an effective and reliable communication channel when I was putting in long hours or working away. However, that experience can’t really inform our knowledge about the impact of email on personal communications. On that question, I have not done the ‘date received’ analysis on all the material I have that would be necessary to draw any conclusions. However, my experience seems to match the anecdotal evidence – that we now receive far fewer written communications than we used to. It’s clear that the teenagers of today won’t have letter collections of the sort described here, in 50 years time.

Reasons for keeping the physical missives

After going through all the items I had retained, categorising the reasons why I had kept each one, and then refining the reasons, the following 12 categories of reasons for keeping physical missives emerged:

  • Amusing content
  • Interesting information
  • Last missive before losing touch
  • Last missive from a dead friend
  • Photo or picture of interest
  • Prestigious person, connection or event
  • Pride in child’s development
  • Reminder of something
  • Significant event in my life
  • Significant event in the life of the writer
  • Unusual construction
  • Unusual or special content

Of course this isn’t a definitive list since it is based only on a single individual’s very quick analysis of a relatively small sample of letters. However, it is indicative.

I have previously identified reasons for keeping the physical versions of work items, though I didn’t consult that list in this exercise and had forgotten its detailed content. So, now is the time to compare the two – I suspect they are going to be very different. The other list is as follows:

  • Digitisation to be performed later
  • Items to be put to work in their original form
  • Items for which only the originals confirm their validity
  • Trophy items to be collected and enjoyed in the future
  • Large documents which have particular qualities of impact and integrity
  • Publications with fixed spine bindings and/or special papers
  • Publications which mention friends, colleagues or the Owner
  • Items published by an organisation or programme that the Owner works/worked for
  • Items that the Owner has written, produced, assembled or made a significant contribution to
  • Physical features which make it difficult to digitise the item and/or to reconstruct it from the digital copy
  • Items illustrating a physical form due to a development in technology
  • Age that provides a quality of uniqueness
  • Aesthetic or artistic quality including photos
  • For use in exhibits
  • Items that the Owner wants to keep as mementos of his and her life
  • For easy access and showing to others
  • Does not belong to the Owner
  • Other – specify reason

It looks like the only items which are directly comparable are ‘Aesthetic or artistic quality including photos’ and the letter keeping reason ‘Photo or picture of interest’. There may also be some similarity between ‘Trophy items to be collected and enjoyed in the future’ and the letter keeping reason ‘Prestigious person, connection or event’. Apart from that though, the lists seem very different which is probably no great surprise since they are dealing with two completely different kinds of artefact: personal letters are all about the relationship between two individuals, whilst work documents are focused on rather more impersonal business activities.  There are, of course, personal relationships in business but, in general, that is not the main thrust of business documents.

Now that I’ve completed this ‘reasons’ for keeping’ exercise, I just need to get on and finish putting the letters I’ve kept into their storage folders. After that it will be time to reflect on what I’ve learnt about letter keeping in the digital age

Having friends at your fingertips is amazing

I’m now half way through trying to identify reasons for why I’m keeping some of the original letters and cards. I’ve listed the items I’ve not destroyed, given each of them a short description, and outlined in a few words why I’ve kept each item. Now I’m trying to categorise the reasons.

This part of the exercise has been illuminating. As I’ve been going through the items I’ve retained, I’ve needed to refer to the full set of scanned documents to identify relative dates and activities that have come before and after. This has made me realise just how good it is to have such easy access to all one’s friends over all these years. Their writings are all there, in full technicolour and expanded detail, at the touch of a few keys. It really is amazing.

The task of categorisation is really a rote one: you need to make a first pass through and then adjust a few times to settle on the most appropriate categories which overlap as little as possible. I’m only halfway through right now so can’t provide any categorisation at present. However, I can say that I’m doing this analysis over 265 items sent by 59 individuals. I have a feeling that the reasons for keeping are going to be significantly different from the categories identified from the analysis of documents saved from work documents and mementos.

There is one significant issue that has already reared its head in this reasons-for-keeping work. It seems that the question of who is going to look at this material is affecting the judgements I’m making. For example, if it was only going to be me looking at these missives, I believe that the collection of items I would retain would be different from the collection I would retain if others were to be looking at it. The possible categories of other people could be: family, friends of the people who wrote the missives; any of my friends who don’t know the individual who wrote the missive. I have yet to understand the impact of this insight. It’s possible I may need to be clear about who will see the collection of originals and adjust the originals I keep accordingly.