How the technology escaped us

It was back in 2008 that I started to digitise our tapes and remaining LPs. Now we’re on the final leg of this digitising journey and soon will be up to date with the technology after we’ve finished arranging Alexa’s marriage. But I’m getting ahead of myself. First let me describe how we got started.

Like everybody else, we were left with large collections of LPs and cassette tapes when CDs started to make their mark. We replaced those which had Compact Disc versions and which we liked best, with their CD counterparts. However, by 2008 we still had some left, as well as a reel-to-reel tape and a number of cassettes with recordings of events, family and friends. It was clear that unless they were digitised we would eventually have no equipment to play them on. So, I acquired a Numark TTUSB turntable with a USB audio interface, downloaded the free open-source Audacity recording and editing software, plugged in an old ghetto blaster cassette deck, and set about digitising the remaining LPs and cassettes. It wasn’t particularly difficult – though it did take a while to establish how to set the most appropriate recording levels, and to become familiar with Audacity’s editing functionality.

The 9 inch reel-to-reel tape was a different kettle of fish. I had no such equipment of my own and didn’t know anyone who had one. However, I did have a friend who used to work in BBC radio and she put me on to an ex-BBC sound engineer who retrieved the contents and put them onto a CD for me for a small fee (which my friend very kindly paid – thank you, Vanessa!).

It was about a year after this that my daughter gave me an iPod Nano for Christmas and that was the spur for me to rip all the CDs in my study (as opposed to the household’s collection of CDs downstairs) and to download them, as well as all the other music and spoken word material I had previously dealt with, onto the tiny device. I took great pleasure in being able to bring all this material to life by having the ipod play random selections using its ‘shuffle’ feature whenever I turned my laptop on in my study.

In the meantime, our main household music collection was now held entirely on CDs and was played on either the TV’s DVD box in the lounge or on a wall mounted CD player in the conservatory.  The main CD collection was held in a separate downstairs room, and a small subset of CDs was kept on the conservatory window ledge. This wasn’t really a satisfactory arrangement since a) we didn’t use the TV’s CD player capability very much at all; and the main CD collection was stored well away from our only CD player; but it worked for when we needed to play some music.

Meanwhile, the world was storming away with new hand-held devices designed to, among other things, play music; with new music services like the Apple Store; and with new (quite expensive) digital music systems, such as Sonos, designed to store digital music and play it on dedicated speakers throughout the house. In 2012, I acquired an iPhone and put some music onto it – though I can’t say I listened to it a great deal. I also set my laptop up to act as media server and acquired a dongle for our lounge TV so that we could select music residing on my laptop and play it through the TV. Again, we only used that capability infrequently for parties and the like because, apart from having to ensure the laptop was switched on and not in sleep mode, the search and retrieval facilities through our TV are very cumbersome).  There was no further change in our household music situation until we moved house in 2015 and moved the CD player into our kitchen-diner room – though the CD collection was still held separately.

For the last couple of years I’ve been hearing more and more about Spotify – mainly from my son-in-law and daughter who use it as their main music source. They seem to have done away with the notion of a music collection and just call up whatever they want to listen to. I’ve been impressed by what you can call up, but not enough to actually decide to sign up for such a service and to install the necessary speaker systems in the house.

In actual fact, we’ve just been left behind by a series of technology changes that we don’t fully appreciate or understand. We started out in our youth by listening to our favourite LPs over and over again on music centres which also played cassettes and the radio; and, despite all the technology advances, we now listen to music much less often – and probably watch more TV than we used to. I suspect it’s not an uncommon story. If we’d had lots of spare money, I would have been inclined to just install a Sonos-type system throughout the house; but we haven’t got unlimited funds and somehow music has never been at the top of the priority list while we’ve been able to play what we want to listen to in some way or other.

However, everything changed for us towards the end of last year when Alexa arrived….. to be continued….

Collaborators sought – and found!

I started digital preservation work on my pawdoc document collection by first recruiting my son, Matt Fox-Wilson, to help with the project. Matt is the co-owner/developer of the ArtRage natural painting software package, and his experience as a software engineer is likely to be of use in the work. I then sent out the following request to other potential collaborators via the JISC Digital Preservation email list:

————————————————————————————————————

From: Digital-Preservation Announcement and Information List [mailto:DIGITAL-PRESERVATION@JISCMAIL.AC.UK] On Behalf Of Paul Wilson
Sent: Wednesday, 7 December 2016 5:53 a.m.
To: DIGITAL-PRESERVATION@JISCMAIL.AC.UK
Subject: Learning opportunity for digital preservation in document management systems

Collaborators are sought for a digital preservation project on a collection of some 40,000 documents stored in a document management system. This will be an ideal opportunity to gain practical experience of a variety of digital preservation challenges in an informal, small scale environment, unfettered by organisational constraints.

The project will apply the preservation planning methodology developed by Paul Wilson and published by the Digital Preservation Coalition in May 2016 – see http://dpconline.org/component/docman/doc_download/1509-casenotepwilsonpreservationplanningver2

The project will start early in 2017 and is likely to last for between one and two years. Collaborators will be expected, as a minimum, to familiarise themselves with the background and high level contents of the collection in question, to comment on the preservation planning documents that are produced, and to participate in the project meetings at which decisions are taken. Such participation need only be remote and will probably take up about one day a month excluding the time spent on familiarisation. However, it is hoped that participants will wish to benefit from the project in more substantive ways; they will be encouraged to play a full part in the decision making that will be required and in the detailed preservation work itself. Such involvement will be determined in the course of the project. It is anticipated that the learnings from the project will be written up and submitted for publication.

The project is likely to be of particular interest to collaborators who have experience of managing collections of Personal Archives, or who work in organisations that own such collections. Location is not a constraint for participation, however people and organisations from the UK and New Zealand are particularly encouraged to get in touch. Interested parties should contact Paul Wilson at pwilsonofc@btinternet.com

————————————————————————————————–

I had two responses and am currently confirming the involvement of the people concerned. Things are looking good for commencement of the project in January 2017.

Survey Findings

I’m glad to be able to write my final entry on this subject as I’ve found it a rather tortuous and boring exercise. In fact, to keep pushing me along, I’ve had to keep reminding myself that I embarked on this survey because Household files are such an integral part of the domestic information landscape. The results do, indeed, reflect that. I discovered over 9,800 documents residing in 113 files placed in 15 separate locations – and bear in mind that these were purely household related files and did not include personal correspondence or specialist professional-type material. True, 71% of these were in email folders – but that simply reflects the importance of email in today’s information landscape. Even when emails were excluded, 31% of the remainder were still in electronic format.

The 15 locations were many and varied – a wooden chest, 3 study drawers, a study bookcase, a study window ledge, 2 email accounts, 2 laptop computers, 1 iPhone, a kitchen drawer, a utility room cupboard, a garage drawer and a shed drawer. There was also a great deal of variety in the type of containers that the files were held in: cardboard folders, poly folders, plastic folders, plastic pockets, plastic button wallets, a plastic zip-up wallet, 10-pocket plastic pages, presentation folders, email folders, electronic folders, an iPhone app, ring binders, a plastic bag, a manila envelope and a box.

Four fifths of the documents addressed nine main topics – Local Community activities (17%); Sport-Related Clubs, Associations & Activities (16%); Orders & Receipts (11%); Non-Sport-Related Clubs, Associations & Activities (10%); House Sale and Purchase and Renovation Work (7%); Banks & Credit Cards & Money Saving Advice (6%); Loyalty Accounts (Shops) (6%); Loyalty Accounts (Airlines & Hotels) (5%); Service contracts & Bills (Gas, Electricity, TV, Phone, Broadband, TV, etc) (3%). The remaining fifth deal with Holidays, Year Files (mementos and sundry docs for possible future ref), Pensions, Tax & Benefits, Healthcare, Legal Documents, Recipes, Instructions/Guides/Guarantees, Cars, Insurances, Budgeting, Local Community Information, Garden, Investments, Mortgage, Service Leaflets/Business Cards/Vouchers, Retirement, Key info about relatives,  Death related documents, and Inventory of items in the loft.

In the course of the exercise, I threw out about 1,980 documents and this just confirms what is common knowledge – people don’t prune their files very often. In the case of hardcopy files, it is often only the shortage of available space that prompts the pruning activity. However, for email files there may be no such prompt – in this survey large amounts of free storage were available in the email system. Two other reasons were also identified for not pruning the email files – first, the fact that the large amounts of material arriving via the email system are too great to be able to easily undertake additional filing work on them; and, second, the email archive can be searched at will to find email addresses or specific content.

Overall, the survey clearly shows that digitisation has had an impact in four distinct ways on these particular household files:

  • much information is coming in by email and the email system itself is being used as a primary storage repository for household files;
  • some household files are being generated on the home computer;
  • some household information which arrives in hardcopy format is being immediately scanned and stored only in digital form;
  • some old hardcopy household files are being scanned and archived in digital form.

However, the survey also highlighted the fact that hardcopy may be a more appropriate format for material which needs to be used by both partners when a shared electronic filing system is not available.

Of course, because this survey has looked at only one household, it cannot be used to reach general conclusions. As with most of the other investigations recorded in these OFC pages, it shows only what can be done, NOT what everybody is doing. As such its findings and conclusions must only be used only as a starting point for further thinking and investigation.

Expanding the Textbook of Text Books

I was thinking it would be good to be able to specify a particular piece of music or sound to be played when a particular piece of text was being read in a book. Then I realised that ebooks on tablets  make that feasible. In fact why stop at sound – there could be pictures or video associated with particular pieces of text. It would just be a matter of being able to specify the exact location of a piece of text on the screen when such additions start and stop or appear and disappear. Whether this would be a useful adjunct to reading is something that would have to be explored, as, no doubt, somewhere, somebody has done or is already doing – some ideas (like google glass) are just too interesting to some people to not find out they don’t work.

Sorting Electronic Files is tedious….

This week we’ve been travelling away from home so I havn’t been able to complete work on the physical household files. Instead, I’ve been using my periods of free time to go through the household files on my laptop. And what a tedious business it is. At least with paper files you can use your hands and arms to pick up papers and move them around; you can turn your neck to look at papers here and over there; and you can completely change your position to get comfy. But with a screen you’re locked-in with eyes fixed, head in one place, and body stationary staring at an unending stream of similar looking files. Anyway, I‘ve nearly finished now, and it’s clear that, just as with paper files, it’s easy for electronic files to just pile up over the years. The difference being that with paper files you can see individual folders expanding and no longer fitting into the physical space they are in; whereas with electronic files, its only when you start to run out of space on the entire hard disk that you realise you have too much material to cope with.

First observations

After getting through the first 11 folders, I’ve eventually settled on collecting the following information for this exercise: Ref #, Location, Container Type, Container Name, Document Descriptions, # of Docs, # of Docs scanned, # of Hardcopy kept, # of hardcopy thrown away (calculation = #Docs – #HardcopyKept), New Electronic Folder created for Scan Y or N, Location of Scan in Laptop, Rationale for Action and Notes.

I’ve also noticed a couple of characteristics that have already emerged from this small subset of material. First, for several of the files, only a proportion of the documents originally filed were deemed to be worthwhile keeping for the long term. For example, car insurance policy documents usually include the full small print pages and handbook; however only the pages showing the details of the policy and its cost were considered worth scanning and retaining (in electronic form only).

The second characteristic concerns the naming of the files of scanned  documents. I’ve taken to including key information in the file names such that a list of the files in a folder in Windows Explorer becomes a very visible database. For example, in the case of scans of the documents related to cars I have owned, I’ve recorded the period of years I owned the car, its registration number, and the make and model, in the file name, so, when looking at the list of file names, one can see a full record of car ownership over the years.

Of course, both these points have emerged from observing an environment in which hard copy files built up over the years are being digitised; they may no longer apply when documents originate in electronic form (such as those arriving by email) or are digitised immediately they arrive. I will reflect on all this as I work through this exercise.

What and Where?

I have one final set of files that I haven’t looked into yet and that comprise an important part of an individual’s ability to maintain Order in the face of Chaos.That is all the documents associated with the ongoing management of one’s house and activities.

By their very nature, the types of household files and the way they are dealt with and stored will vary from household to household. However, it is probably true to say that the emergence of office technology, the internet and email have had a significant impact on what documents come into every household and on everybody’s perception of what it is necessary to keep. In this respect our own household files have undoubtedly changed and slimmed down over the last 20 years or so – though in a somewhat piecemeal manner. This exercise will take a more focused approach to trying to identify ways in which digitisation can help to keep our household files in order.

The files currently reside in either a big old chest, in my or my wife’s desk drawers, in a kitchen cupboard (that’s the recipes), in email folders, or in file folders on my laptop; and I believe that the material falls broadly into the  following categories: finance; legal; products and services; organisations; and practical information. I shall tackle the chest first.

A Simplified Spec

The lack of entries here for three years tells the story that my 2013 Roundsheet specification did not inspire anyone to start building a prototype. In fact, I only showed it to a couple of people, but neither were particularly complimentary. Re-reading the 2013 spec now, I can understand why. In trying to extend the concept to a three dimensional ball, it had all got too complicated. So, I’ve gone back to the basic idea of being able to break circles (Rounds) down into segments (Slices), and being able to collect the Rounds together into a cylinder (Roll). I’ll see what my colleagues think of the revised, simplified spec.

The Watering Pot

It would be very useful to have an indoor plant pot that could store a lot of water and release it slowly, as well as letting you know when the water was running out. I’m sure there are such devices/systems out there. However, I wonder if anyone has constructed a plant pot which has a substantial gap between the outside and the inside of the pot which would act as a water reservoir; and an internet connection which would alert you when the water is running low.

First feelings for the Grok app

The new loft system is now in place with all Items, Containers and Positions recorded in the Grok Discover2 iphone app. Particular advantages of the app over the laptop-based database I used previously, are a) the ipad and iphone are much easier to carry around and use in the loft than the laptop; and b) the ability to take a photo with the iphone, have it seamlessly copied to the ipad, and then to be able to almost immediately pick it up from within the Grok app, made the task of inserting photos into the Grok database vastly easier than when I was using a windows-based database.

However, there were a few areas in which the app lacked functionality which the windows-based database had: a) today’s date can’t be auto-entered into the ‘Date this record created’ field that I had set up; b) the next available Serial No can’t be auto-entered; c) it is not possible to specify that a field should be populated with what was input for that field in the previous record (very useful for a field like ‘Date this record created’); d) the images that are input for each record can only be displayed, even on the ipad, at a maximum size of 3 x 3 cm – and these images, frustratingly, cannot be expanded using the standard ipad two finger screen expansion action (and users should note that photos need to be taken in the iphone ‘square’ mode otherwise the app will truncate the images); e) Only two fields are presented for each of the records selected in a search – annoying if you want to compare the values of another field across all the selected records; f) it is not possible to sort the records selected in a search.

Although these are shortcomings, I’m currently feeling they are a small price to pay for free, ready-built software which has been designed to work seamlessly with the RFID reader. Furthermore, the ability to share it via the Grok cloud, is another huge bonus. The ease with which this can be done was demonstrated last Sunday when I sat across the room from my son-in-law and suggested he search for Grok in the app store; and then, when he had it loaded it, I told him what the username and password were. He started exploring the app and soon found the items we are storing for him and our daughter. This was all accomplished without me moving from my seat or helping him in any other way.

No doubt, I’ll find out more about the utility of the Grok app over the coming months as we take items out of the loft and put new items in. However, the really interesting experience will be when I obtain the Grok reader and attach RFID tags to every item. Watch this space.