Category Archives: JOURNEYS IN PROGRESS

HandBrake Conversions

Posted on by
Reply

The obvious way to dispose of physical DVDs and yet still have them available to view is to convert them to digital format and to store them on a PC or hard drive. In theory, they could then not only be copied to and viewed on any device (such as a tablet or phone), but also viewed on a large screen TV via the domestic wi-fi network. To explore these possibilities, I downloaded the free open-source HandBrake video converter tool (as recommended in issue 664 of the UK ComputerActive magazine).

HandBrake complies with Digital Rights Management (DRM) legislation and so is not able to circumvent standard copy protection measures built into most movie DVDs. However, a separate piece of open-source software called libdvdcss-2.dll is freely available to overcome this problem.  This is effectively a plug-in to HandBrake and simply needs to be placed into the HandBrake program folder. I duly installed both HandBrake and libdvdcss-2.dll and set about trying to convert some DVDs.

I had a minor problem getting started as, after completing my first conversion, Handbrake seemed to be unable to read a large number of the DVDs. I eventually found that the problem was something to do with pointing to the correct file for HandBrake to inspect: I’d been selecting the “D: DVD name” entry in the Source Selection menu, and this was producing a screen announcing “No valid source or titles found”. The problem was rectified by choosing the Folder option in the Source Selection menu and then selecting the “D:DVD name” that appeared in the Windows Explorer menu. I don’t really understand why this made a difference – but everything worked fine doing it that way….

Overall, I found ndBrake very easy and effective to use. It was able to read all but one of the 54 DVDs in my collection. The one that it couldn’t handle was designed to enable the downloading of a copy of the film ‘Minority Report’ so there was actually no film on the disk for HandBrake to identify. I was unable to even try to convert any of the four Blu-Ray titles in my collection as my DVD player simply won’t read them. In the course of the exercise, I successfully converted 19 of the 54 DVDs to MP4 using the standard presets advised by HandBrake, and encountered no problems in doing so with each conversion generally taking between 20 minutes and half an hour. I shall comment on the quality of converted files later on in this process after I’ve tested viewing them on my TV.

I decided to limit the number of DVD conversions at this stage because of the time required to undertake the conversion, and because of the large file sizes being generated. The films I have converted are either ones I created to get me started with HandBrake; or ones I definitely know I want to keep; or ones that I want to see before deciding what to keep. The 19 titles I converted take up some 18.5 Gigabytes and play for a total of about 40 hours. I shall return to the question of what converted DVDs I want to keep after I’ve investigated some related issues such as whether they can be easily obtained through streaming services, whether the converted files play successfully on the TV via wi-fi; and whether the quality of the converted files is good enough.

One final note on the converting experience: I’ve had to handle the DVDs a lot during the process and this has definitely induced a sense of appreciation of their characteristics. No doubt this is partly due to the stirring of good memories of some of the films; but its not just that. These products with their different designs – triple fold overs, slip cases, multiple DVD holders, metallic casings, eye-catching graphics, special editions, and the odd booklet – do have their own kind of kudos. But I must restrain myself… we’ve decided to dispose of these physical goods and that’s that…..

Hardware considerations

Posted on by
Reply

A few days ago, I tried using the external DVD player that I bought to go with my laptop, to play a film on my Smart LG TV. I discovered that the DVD player only has a USB interface and that films on DVDs won’t play without an HDMI interface. So, to be able to play any of our collection of DVDs , we would have to buy an HDMI-capable DVD player which a quick search of the net determined would cost in the region of £30 – £50. Unlike my current very compact and easy-to-store external DVD drive (measuring some 14x14x1.5 cm), such beasts are larger, may employ a pop-up lid as opposed to a sliding drawer, and require an external power source. These are all factors which would affect the aesthetics of the piece of furniture on which our TV sits: it would mean accommodating an extra big black box with two lots of additional wiring for a facility that might be only rarely used – and this after having been pleased to get rid of our previous very large DVD recorder box. I guess it could be kept in a drawer and just installed temporarily when needed – but setting it up wouldn’t be easy because there is little space to get behind the 65inch TV screen to access HDMI ports and power points. Of course, such a device could also be used on my laptop – but I don’t really think I’d want to watch films on my laptop screen or even the 27-inch screen on my study desk. In fact, I wouldn’t want to watch films in my study: movie-watching is more of a relaxing lounge activity.

Many of the above factors are the reasons why we decided to dispense with a video recorder and the physical DVDs in the first place; so, I’m not really envisaging going down that route again. Nevertheless, it will be useful to have a clear understanding of all the possibilities and constraints when I get down to deciding which films, if any, I particularly want to keep and in what format.

Musings about video collections

Posted on by
Reply

When I saw my first movies in the late 1950s, there was no way of keeping a copy of the one’s you especially enjoyed to view again at some time in the future. This was in contrast to some of the first books which I really enjoyed in the early 1960s – such as Coral Island and Greenmantle – and which have resided on my bookshelves to this very day, available for dipping into or re-reading at will (though, truth be told, this hasn’t happened much). All this changed in the 1970s with the emergence of the domestic video recorder, and movies could be rented, and eventually purchased, on video tapes. In the 1980s, you could have a collection of films in your bookcase along with your favourite books.

Unfortunately, there was – and still is – a significant distinction between the two media: books don’t require anything else to be able to read them, whereas video films need equipment to play them on – equipment that keeps changing as the technology develops. So, my collection of films on VHS video had to be swapped into DVDs; and last year we got a new TV streaming box which doesn’t have a DVD player at all.

However, leaving aside this pesky technology problem, I’m wondering if the introduction of films to our bookshelves has truly made a difference. As I hinted above, I don’t reread books very often; and yet having them on my shelves does make a difference. I guess their presence acts as a reminder of the impressions they made on me; and their physical presence does afford me rereading opportunity, whilst their absence might fuel a desire to obtain them. Is the same true of films? Well, I think in my case – yes! The visuality and motion in films undoubtedly make them seem more attractive than a book, and may be more likely to inspire a second viewing; nevertheless, as with my books, I don’t seem to have  taken much advantage of their availability. But I would, in principle, like to have a collection of my favourite films, even if only to know what they are.

Of course, films are not the only video material that we encounter today: we also watch huge amounts of TV, some of which we really enjoy and regard as memorable. Some people recorded and had collections of such material – and then encountered the changing technology problem. In the face of today’s streaming services, only the dedicated will have managed to retain such collections in a form that Is still accessible. My wife and I, thankfully, never went down that particular rabbit hole.

There are two other types of video material that I do have collections of. One is about a dozen pieces relating to office technology developments that were relevant to my job as an IT consultant. These were included in my work filing system, converted to digital files several years ago, and continue to be maintained within the filing system under its digital preservation maintenance plan. I feel no need to have these items displayed anywhere: they are accessible via the filing system’s index in just the same way as all the other 25,000+ items in the collection. The other type is the family’s collection of cine films from the 1950s onwards, and more recent videos taken on video recorders and then on mobile phones. These are included in the family’s photo collection, and maintained under that collection’s digital preservation plan. Interestingly, we do have these items on DVDs in very thin cases and on display in our living room bookcase, so the fact that we no longer have a DVD player attached to our TV does affect the accessibility of these family records as well.

While there are numerous similarities in the motivations and practicalities associated with collecting these three different types of videos – films/TV, work, and family, I nevertheless feel that I’ve collected the work and family videos for very specific reasons, whereas the collection of film/TV videos is much more like collecting books – it is based on very subjective appreciations of the content and, importantly, whether you own the item in the first place: if you really enjoyed a book you borrowed from a library would you be likely to go out and buy a copy just to put it on your bookshelf?

This last point is critical in todays streaming world, and it applies not just to video but also to music and books. The lack of physical media when films/TV, music, and e-books are consumed mean that there is nothing physical to go on our physical bookshelves; and in the case of films/TV and music, there is not even a digital file to store on your local device. This simple fact is probably the most significant factor in our decisions about collecting films/TV and music in today’s streaming environment. It also highlights the point that most physical collections of books and films/tv exist simply because the media was purchased in order to consume it – not because you wanted to build a collection. The collection was just a by-product of the process. I shall carry this thought with me as I set about deciding what to do with my DVDs.

DVD Dilemmas

Posted on by
Reply

Last summer we boxed up our DVDs when we had our lounge redecorated, and there they have remained because we no longer have a video recorder to play them on. The box is taking up space in my study so the time has come when I need to something with them.


Of course, I could just take the whole lot down to a local charity shop – but it’s not going to be as easy as that. You see, mixed in among the movies that we just bought and enjoyed (like the Bourne series) are long time favourites that I’ve collected on VHF Video Tapes and then replaced with DVDs (like 2001); and some event DVDS that I’ve promised myself an enjoyable reliving at some unspecified time in the future (like the 2012 Olympics). I do want to keep some of these to enjoy them in the future, so I guess I’m going to have to go through the whole collection to choose which ones to keep a copy of and which ones to get rid of; and then I’ll have to figure out how to convert the ones I’m keeping to a more long-lived format. I’m anticipating that these decisions may also be affected by the sizes of the files that the conversions will produce: I’m not used to handling loads of gigabit-sized files.

The Spreadsheet – an OFC Superstar

Posted on by
Reply

Since my last post here, over 7 months ago, we’ve completed first substantial drafts of all 10 chapters of the book on Collecting in the IT era. The literature survey has made a substantial contribution to the material; and the use of an Excel spreadsheet enabled the process. This is just another example of the massive contribution that the humble spreadsheet has made to modern life since its inception in 1979. Designed ostensibly for manipulating numbers, it has proved equally useful for organising text.

In my first foray into writing books at the National Computing Centre in the 1980s, I tried recording key points that I read or discovered about a subject, in a Word document, and then rearranging them into separate chapters. It was a pretty effective method – but only worked for fairly concise units of text and relatively few of them. For this book I have used a spreadsheet to assemble more than 3,400 chunks of relevant points from over 300 books, papers and other sources; many of the chunks consisting of part-paragraphs of over 80 words of text either copied from digital texts or hand-typed-in. Against each chunk are columns of reference details and allocations to particular chapters. The ability to apply consistent organisation over such a large volume of material, and to be able to search and filter every column, provides a huge advancement in capability over my 1980’s efforts; a capability to identify key points, to assess differing views, and to construct new thoughts and ideas around a particular topic.

The simplicity and power of its structures across both numbers and text, makes the spreadsheet a premier performer in creating order from chaos; it is the hammer and wheel for 21st century individuals.

Deep Roots for Modern Britain

Posted on by
Reply

Mentions about the Viking, Roman or Norman invasions of Britain make me wonder if my family or any of my friends originate from those peoples. I’m also intrigued by the way recent work using DNA analysis can build up an overall lineage of modern people which originates in a small group of individuals in Africa around 200,000 years ago. So, I got to thinking that it would be an interesting TV programme to track down the origins of a whole bunch of our very diverse British population using modern DNA analysis. We might all be surprised about how foreign we all are and yet how closely we are all related.

Evolving Suspicions

Posted on by
Reply

I’ve become intrigued by how we’ve managed to evolve the complexity of the human being, particularly after reading the following: “The inner ear is where the receptors for hearing (and balance) are contained. Specifically, the cochlea is a liquid filled (snail-like) spiral structure that internally widens in the middle such that different vibration frequencies will have heightened energy at different (specific) locations along the structure that cause the membranes to be displaced. Inside the cochlea, liquid filled tubes (scala) are separated by membranes, one of which (the basilar membrane) contains rows of hairs (the stereocilia) that cause neural activity when the membrane is displaced nearby.”

I thought it would be interesting to do a rough calculation of how long it would take for us to get from our originating bacteria to where we are today based on my top-of-the-head estimates of the number of mutations required and how many entities were contributing to them.

W: Number of mutations required: 10 million – 610 million: average 310,000,000

X: Number of generations required for a successful mutation on top of a previously successful mutation: 10,000 – 210,000: average 110,000

Y: Number of entities/couples contributing to generations: 1 – 100,000,000: average 50,000,000

Z: Number of years between generations: 0.01 – 20: average 10

Using the averages:

For W mutations to occur, taking X generations for each one, would take 310,000,000 x 110,000 generations

If there were Y contributing entities/couples, this would take (310,000,000 x 110,000)/50,000,000 generations

If there were an average of Z number of years per generation, the overall process would take     [(310,000,000 x 110,000)/50,000,000)] x 10 years = 6,820,000 years

Despite this being a possible result (considering the earth is apparently 4.5 billion years old), it is clearly wrong since the earliest microbes found in rocks are estimated to be 3.7 billion years old. Anyway, I’m feeling distinctly uncomfortable about all the assumptions I’ve made in the above calculations – essentially every element is totally flawed and the whole calculation is worthless. In any case, I’m still left with the feeling that, to have evolved such a huge set of such very highly complex and interworking physical mechanisms, completely by chance, seems to be highly unlikely. So, I’m left with a lurking suspicion that somewhere in the originating DNA, or early equivalent, was a programme of instructions….

POSTSCRIPT: Quite by chance I watched part of “Attenborough: 60 years in the wild” on the BBC this morning – the day after I posted the above material. The programme is highly relevant and I recommend it.

Google Scholaring

Posted on by
Reply

The book on Collecting in the IT era, is coming on; we now have rough drafts for all the chapters. So, over the last couple of months I’ve been doing a literature survey – and discovered that things are a bit different from when I last did something like this about 40 years ago. If I remember rightly, I got the corporate library to interrogate some online databases for me, selected various items from the resulting printouts, and requested the papers and books that I wanted through the inter-library loan system.

These days it’s a little simpler: you do a search of Google Scholar which produces loads of hits presented as a series of abstracts. You click on the items you’re interested in, and, if you’re lucky, the paper will appear either in your PDF reader or in a web page. If the full version isn’t immediately available, a further search of the net may turn up a copy. Failing that, if you have institutional membership of a publisher’s archive, that may give you access; or else you may be able to pay a fee to get a copy. For books, and for papers which you cannot obtain by any of these options, then it’s back to the inter-library loan system (well that’s what it’s called here in the UK – I assume other countries have similar services). In this case, I found versions of all but 8 papers, on the net; and my co-author was able to obtain 7 of the remainder through his institutional memberships. Of the 22 books I needed, I already had 3, I bought 7 on eBay for less than £5 each (and free postage), and I ordered the remainder through inter-library loans via my local library in Bedford.

Now, I don’t know what percentage of the overall canon of human scientific works is included in Google Scholar’s database; but my initial searches gave me some confidence that it was enough to be very useful. For example, a search for the word ‘Collecting’ in the title, identified 80,900 results. I duly conducted a variety of searches and identified some 270 papers and books, of which about 130 proved useful enough to include in the literature survey. From those items, I identified about a further 15 or 20 papers and books to add to the list.

The process of actually reading and assessing the material, was, of course, hard work; but the mechanics of actually conducting the searches and getting the material was extremely quick and easy – much, much easier than I experienced 40 years ago. And, while Google Scholar may not include everything, it’s likely that any key material missing from Google Scholar will be referenced in the material initially identified. I haven’t spoken to anyone other than my co-author about Google Scholar, so this short overview cannot be considered in any way a thorough assessment. However, for what it’s worth, I think it’s been very effective for my purposes, and I’d certainly use it again.

Practice Hierarchy writings

Posted on by
Reply

About a year ago I reported that my colleague, Peter Tolmie, and I were working on a book about digitisation’s impact on collecting, based upon all the investigations and writings already described in this blog, as well as auto-ethnographic investigations of a variety of collections that Peter and myself have been associated with. The book will expand many of the notions put forward in the OFC tutorial, and therefore I shall continue to provide updates on our progress on the book, within this Order From Chaos journey.

Since my last report, we have moved on from the auto-ethnographic investigations and derived a draft Practice Hierarchy for collecting, which has eight upper levels – Initiating, Equipping, Acquiring, Depositing, Using, Revealing, Maintaining, and Disposing. We are now in the process of fully verifying, describing and illustrating all the elements. Having done that we plan to analyse and describe how digitisation has affected all these practices – though it may take us several months to get to that next stage.

Placing PAWDOC

Posted on by
Reply

Construction of the book on collecting that I’m writing with Peter Tolmie, is now well underway. However, this Personal Document Management section of the OFC website doesn’t seem an appropriate place to report on the development of such a wide-ranging text. Instead, I shall record details of our progress in the Order from Chaos section of this blog.

This journey on Personal Document Management has nearly run it’s 40 year+ course. I summarised my findings on that extended trial in some entries a few years ago; and there is only one remaining aspect that I am actively investigating – to find a permanent repository for the PAWDOC collection. Its going to be challenging: despite contacting several possible institutions over the last seven years, and publicising my goal in various forums, I’ve had no success so far. Just to be clear, this is what I’m offering:

  1. The PAWDOC digital collection of 31,000 documents dating mainly from 1972 to the present day, fully labelled, and documented in 17,300 index entries; and all of them in Windows folders under the control of an established Digital Preservation maintenance regime.
  2. Two archive boxes of some 330 PAWDOC items that were judged worthy of keeping in hardcopy form, and for which the reasons for keeping were recorded in a spreadsheet and described in the unpublished journal paper ‘IV in PIM: The applicability of Intrinsic Value in Personal Information Management’.

  3. A few other associated documents that could be included with the collection, such as a leather-bound volume of 63 reports of visits to UK, European and US organisations during the period 1979 -1982;  a bound copy of the organisational documents, proceedings of, and delegates to, the first European CSCW conference in 1989; a bound copy of reports on, proceedings of, and delegates to, the first US CSCW conference in 1986; a signed and bound copy of ‘The Network Nation’ by Hiltz & Turoff annotated with notes for the 1983 book ‘Introducing the Electronic Mailbox’; and copies of the books ‘Sorties into the IT Hurricane’ and ‘Meteor: a story of stamp collecting in the eye of the IT hurricane’.

Anyone interested should get in touch with me.