The Deliverator – Wannabee

So open minded, my thoughts fell out…

Archive for the 'General' Category

Dharma / Maya – A New Virtualization Platform for Silverfir to Replace Minimus

Posted by Deliverator on 22nd March 2014

Back in 2009, most of’s services were migrated from an aging behemoth of a Compaq server named Frankenputin onto what was hoped would be a much more manageable platform which I christened Minimus. Minimus was designed to be a server that could run contentedly in a closet for year’s on end. It was based around a dual core atom motherboard which sipped power and featured completely passive cooling and used a solid state drive as its boot drive for greater reliability. The host OS was Windows 7 running VMware Server 1.x to host a Ubuntu Linux virtual machine. Eventually VMware stopped supporting the free VMware Server 1.x line and we were forced to upgrade to VMware Server 2.x, which featured a barely functional web based management interface.

Several months ago, Silverfir started experiencing unexplained lockups every few days that required the virtual machine to be rebooted. This became annoying (especially for a box-in-the-closet) and very inconvenient for both Ryan and I. Eventually, the VM failed to boot entirely and the chunk of Silverfir hosted by Minimus was down entirely. This coincided with an extended trip by me to Rarotonga, an island in the middle of the pacific ocean with very minimal internet access. While Ryan and I were jointly remotely investigating the causes of this misbehavior, we found several VM metadata files that were 0 bytes and backup copies of these files were zero bytes as well. I reinstalled VMware Server and Ryan recreated the VM definition files from scratch. During this process, the web interface was very difficult to work with, as it wasn’t working properly in modern versions of IE and Firefox. Eventually, Ryan was able to get everything working again, and took the opportunity to upgrade from Ubuntu 9.04 to the current Long Term Support edition of Ubuntu, 12.04. Unfortunately, this did not solve the problem with the VM locking up every couple days. I decided it was time to modernize Minimus.

After spending a week experimenting with a number of modern hardware assisted hypervisors, I eventually decided to use Xenserver 6.2 Xenserver is a free (in multiple senses of the word) minimal footprint hypervisor similar to VMware ESXi. Unlike VMWare Server, which required a full fledge host OS be installed, Xenserver’s host footprint is very minimal, leaving more of the system’s resources (especially ram) free to be allocated to guest virtual machines. Because Xenserver relies on hardware level support for virtualization (a cpu feature called VT-x), guest virtual machines run much closer to the “bare metal” and feel a lot snappier as a result. Xenserver also has support for another newer hardware virtualization feature called VT-d which allows for hardware devices to be directly shared with guest VMs. This allows for devices like GPUs to be directly accessible to virtual machines. Citrix likes to show off this feature by running demanding, modern games like Skyrim in a VM and playing the game through a thin client device like an Ipad. Neat, but not very relevant to our particular use case.

The main things that I liked about Xenserver were:

  1. Free in multiple senses of the word. Based around an open source project, Xen, with widespread adoption both within the OS community and among major commercial users such as Amazon. Xenserver stores its VM metadata in standardized formats that are directly importable into other virtualization environments. Because of this, I have some confidence that I am not going to be bitten by a product discontinuation or lack of an easy forward migration path as occurred with VMware Server.
  2. After a week of hammering at it, Xenserver feels very mature. I only experienced one bug, relating to migrating VMs with associated snapshots, in a week of testing oddball cases. The windows based management tool, called Citrix Xencenter, is a pleasure to use.
  3. Xenserver allows me to create redundancy “pools,” clusters of  Xenserver hosts and shared storage resources that allow for guest virtual machines to be moved back and forth between multiple physical servers without needing to be taken offline. It is VERY cool to have a server being run off one physical box one moment and 30 seconds later having it be running off a different server with less than a single second’s network downtime. This should allow for Silverfir to stay online while hardware maintenance is being performed, something that wasn’t possible under the previous VMware Server environment.
  4. Xenserver allows for easy snapshot backups of running VMs, allowing backups to be created while the server is in use. With VMware Server, the guest had to be shutdown to backup the virtual disks, a process which took hours even using an eSATA based external backup drive.

Migrating Minimus to Xenserver was a fairly straightforward process. I was able to import the primary Minimus VMware virtual disk .vmdk file directly into a newly created VM guest in Xenserver. I had to edit grub, fstab and network interfaces to get the VM working in Xenserver and also had to add an remove a few kernel modules and install the old VMware tools, but all told I probably spent less than 2 hours getting Minimus running happily under Xenserver. What wasn’t so painless was getting the second data volume .vmdk to import. This second .vmdk stored all of Silverfir’s websites, photo galleries, etc…you know…the things that people actually care about. I received errors trying to import this file using a wide variety of virtual disk management/manipulation tools. I think this vmdk file had been created in an earlier version of VMware and probably used an older version of the .vmdk format. Eventually, after almost a whole day of trying to import this file I threw up my arms in disgust. As a workaround, I put both the old Minimus virtual machine and the new Xenserver virtual machine, which I am calling Maya, on the same network segment and created a new virtual disk container in Xenserver. Ryan then copied the data from the old virtual server to the new using the magic of rsync. This took quite a while, as almost 500 GB of data needed to be copied over at 100 mbit speeds. After almost a full day of copying and some adjusting of permissions, Maya was substantially complete and took over hosting duties from Minimus. Maya has been happily hosting Silverfir without incident for over a week.

In the near future, I plan to decommission Minimus entirely and replace it entirely. Maya’s current primary Xenserver host is a Core 2 Duo with 7 GB of ram. I plan on using most of the guts of Minimus to create a new server based around an Intel Avoton C2750 motherboard. This new system, which I am calling Dharma will be the primary Xenserver host for Maya, with the current Core 2 Duo host serving as a high availability backup server. Hosting of Maya’s data volumes will be via a Readynas Ultra 6 with a 12 TB Raid 6 array. Hopefully this new setup will allow for greater reliability and fault tolerance than what was  achieved with Minimus and Maya can continue serving Silverfir’s users for years to come.

Posted in Blogging, Emulation and Virtualization, General, Linux, Operating Systems, Tech Stuff | No Comments »

At SIFF, The Movies Watch You!

Posted by Deliverator on 6th June 2013

I’ve been attending the Seattle International Film Festival for close to a decade. Recently, an issue which affects all festival attendees came to light and I feel an obligation to document it here, as SIFF has said little publicly on the matter.

This year, SIFF has included a uniquely identifying barcode on all passes and tickets and mandated that these barcodes must be scanned for entry. When asked about the barcodes and their purpose at press screenings prior to the start of the festival, members were told that the barcodes were for headcount and validation purposes only and that no data was being collected. It quickly became apparent through the My SIFF feature on the SIFF website that this was not the case. A permanent record of the screening attendance of every pass-holder was being created and stored. A heated debated quickly emerged on the passholder mailing list, called Fool Serious. Some passholders liked the idea of being able to track what films they had seen, but many expressed grave concerns about their movie attendance being tracked and to ill defined purpose. I found the situation extremely troubling, both due to the denials that this was taking place, but also due to the lack of any statement of how this data was being stored and used both directly by SIFF and potentially by third parties. At the time, SIFF had NO stated privacy policy, which is exceptional for an organization of its size in this era.

There was no notice that data collection would be taking place as a condition of entry at the time I purchased my pass or at the time the pass was issued to me and the terms printed on the pass itself don’t seem to require it as a condition of entry. I made multiple attempts to engage SIFF leadership, both via email and also via SIFF board members. I sent no fewer than 4 emails to a half dozen top SIFF employees asking that my pass be refunded or that I be allowed entry without being tracked, as I considered the tracking to be a term of execution added after purchase and issuance of the pass. I was told by sources within SIFF that the issue had been brought before directors (specifically named to me) and they had dismissed the issue rather cavalierly and hoped it would go away. SIFF finally responded (minimally, in a way that said next to nothing) almost two weeks after the beginning of the furor and made claims to have not heard of the issue prior to then, which I believe to be untrue.

I was finally contacted by SIFF’s managing director Mary Bacarella and Carl Spence and after a half hour phone conversation was offered to exchange my pass for 50 vouchers that I was assured would be issued anonymously. At no time was I offered the refund I had requested or entry without scanning. I feel I was forced into giving up the significant benefits of a pass including attendance at press screening, priority entry and seating and unlimited attendance, but didn’t feel they were willing to offer more. When I attempted to “cash in” my anonymous vouchers, I was asked repeatedly for my name and had to spend close to 10 minutes explaining that I didn’t want to provide my name. I asked why they needed my name and was told it was only to notify me of venue changes and the like. When I asked if the data was being used for any other purpose, I was told no. I repeated that I wanted to exchange them anonymously and had been given permission to do so by SIFF’s directors and the volunteer finally relented after I handed him Mary Bacarella’s business card and told him to take it up with her.

I’m willing to share many types of data. I don’t really care that my grocery store knows what sort of peanut butter I like. I care a great deal however about having my viewing habits, web browsing habits, reading habits, etc. logged in a uniquely identifying way. Unlike inconsequential data such as peanut butter preferences, what we listen to, read and watch tells people a great deal about who we are as individuals. Such data can also be misconstrued in a variety of ways that have real and unanticipated consequences. While many young people today are pretty blithe about what and with whom they share their information, I’ve seen the repercussions of over-sharing, identity theft, etc. first hand as part of my work and as such, try to maintain a high degree of separation between my public and private lives. I can imagine a lot of ways in which information such as this could be used in ways I would not approve, but it is the unanticipated ramifications that I find scariest.

SIFF finally posted a privacy policy to its website, and I find the terms and conditions layed out in it to be deeply suspect. SIFF does little to draw attention to this document and has made no public press statement on the matter. One provision in the privacy policy allows for members to request that their tracking data be deleted. I made such a request and shortly thereafter found that my SIFF account AND MEMBERSHIP had been outright deleted. When I’ve presented my membership card (which has a clear “valid until” date printed on it) at SIFF venues, I’ve been told they can find no record of my membership and have been further denied the benefits of the membership for which I paid. This whole situation has increasingly grown to resemble a play by either Kafka or Heller and I find this situation deeply ironic given that this year’s festival contains a film called “Terms & Conditions.”

Attendees should be told upfront in a forthright way by SIFF that they are being tracked and not have that data hidden in 6 pt type. They should be given the chance to opt-out in a meaningful and non-punitive way. SIFF has thus far failed utterly to do so. I hope that SIFF will reconsider their position and work with the people who have raised objections to develop a policy that better addresses the concerns raised by many of their most supportive members.

Posted in General, Movies, Rants and Raves | 2 Comments »

The Hobbit in HFR (High Frame Rate) 3D

Posted by Deliverator on 16th December 2012

I caught a 2D screening at one of the least modern mainstream theaters in the Seattle area, Factoria Cinemas a couple days back and then saw it again in HFR 3D today at Cinerama.

To me, the effect of HFR was similar to the transition to high def, in that the HFR seems to increase the apparent detail. There were some scenes, such as Bilbo walking through Bag End lit only by a single candle, the light glinting off the sword Sting when he pulls it from the scabbard, the moonlight shining through the waterfall in Rivendell, the eagles back-lit by the sun, etc. that really popped out at me in HFR that made no impression on me the first time around. At the same time, there were a large number of times where I found the HFR distracting/detracting and I am not sure I liked the effect overall. It is hard to put my finger on it, but here is what I came up with:

With lower frame rates, sudden movements simply blur. With HFR, the sudden movements instead tear/judder.

It is almost as if reality stuttered for a moment. It reminds me a bit like when you are playing a video game and you turn a corner onto a scene with significantly more complex geometry/detail and your graphics card can’t keep up and the framerate drops from 60 to 10ish fps. The illusion of continuous motion is broken. To me, psychologically, this is somewhat similar to the so-called uncanny valley effect when animation tries for realism and doesn’t quite get there.

I wonder if I would have a better response to HFR if the frame rate were significantly higher, such as 96 fps. It wasn’t the smoothness that bothered me, but the smoothness occasionally being broken by jerkiness. It breaks the illusion that you are in the reality of the movie and suddenly you are just sitting in your seat for a moment. I am not sure if all this is an artifact of the filming or production process, or a problem with the digital projection systems not having quite the pixel refresh rate yet. I would be curious to see a HFR digital download version of this movie on a fast refresh rate monitor that is able to sync precisely to the frame changes, but I suspect we will only see a downsampled standard framerate version as Blu-ray isn’t able to handle it. Still, one can hope.

Posted in General, Movies | No Comments »

Social media integration for long winded posts.

Posted by Deliverator on 18th November 2012

I’ve been forsaking the WordPress blog here for quite some time. Most of my ruminations seem to be too short for me to be bothered with writing a blog entry, so I’ve largely shifted to using my Twitter account. At the same time, I’m also finding Twitter’s 140 character limit a bit too limiting. I am often writing 3 or 4 back to back tweets on a subject, which I am sure does not endear me to followers uninterested in said subject.

There do exist 3rd party services like TwitLonger that work around Twitter’s forced brevity problem/feature, but I like to keep my data in-house to avoid many of the snafus that are part and parcel of using cloud services. Having lost or lost control of data important to me in the past, I don’t like trusting my content/making myself dependent on companies whose operational procedures are opaque to me and whose terms of service, business model, etc. might change with the blowing of the wind. It is one of the chief reasons I’ve yet to join Facebook, Google+, etc.

I am going to start testing various plugins for WordPress that allow me to automatically cross-post to Twitter as well as archive my tweets here in case Twitter’s business model becomes too onerous (the promoted tweets are already getting obnoxious).

Posted in Blogging, General, Mobile Blogging, Rants and Raves | No Comments »

SIFF Film Micro Reviews

Posted by Deliverator on 11th June 2012

Here is a brief list of films I saw at SIFF this year to be followed with a micro-review:

The Intouchables – Very funny and touching story of a rich, cultured, but deeply unhappy quadriplegic who regains his joie de vivre after the unlikely hiring of a Senegalese immigrant as his full-time helper. A little bit mainstream, but a huge crowd pleaser. Highest grossing French film in the country’s box office history. Showing at several theaters in Seattle now. Highly recommended.

Citadel – A newly widowed and agoraphobic father has to defend his infant daughter from sub-human packs of fear sensing mutant hoodlums inhabiting a nearly abandoned area of England set for urban renewal “any day now.” One of a number of British horror films in recent years with social messages/themes just beneath the surface. I found the actor playing the father to be nearly as creepy as the fear-mutants. Not for everyone, but hardcore horror fans might like.

Fat Kid Rules the World – Mildly enjoyable film about a fat kid who is drawn out of the emotional cave of despair he has built for himself by a charismatic drug using guitar player who saves him from committing suicide and declares the fat kid to be his newest band member. Both parties are using each other and they both know it but pretend otherwise. Gradually a genuine and deep friendship emerges from the relationship and maybe they are exactly what the other person needs.

Sleepwalk With Me – Mike Birbiglia, with the assistance of the oh so beautiful Lauren Ambrose, brings the story of his emergence as a professional comedian to the big screen. I’ve admired his comedy for years on the radio, but it was nice to see it again in expanded form on the big screen. I liked how this was as much of a movie about how you can transform personal pain into something you and an audience can laugh at together as the final product. I think in so many fields there is a long period of time in which a new practitioner will be just plain bad and the emotional fortitude  to keep at it while enduring years of rebukes while honing you craft is really what separates out the cream of the crop.

God Bless America – This is essentially a dark comedic vehicle for Bobcat Goldthwait to take us and The U.S. to task for everything that is wrong in our culture and politics. I agree with most of his points, but the movie develops a somewhat monotonous tone. This is an idea stretched a bit too far to remain funny for the duration. Mild recommendation.

Polisse – Follows the lives of the officers of a child protection unit of the police in Paris over the course of a year as their work is documented by a government photographer. The anecdotes collected feel more like the recollections collected over the course of a long and brutal career in public service rather than a year. I liked how the film showed all the personal and emotional destruction in the lives of the officers as they deal with a unending unspeakable evil on a daily basis coupled with a lack of resources, appreciation and a bureaucracy that repeatedly fails to be flexible enough to help the ones it is supposed to protect. A difficult film to watch and the narrative arc is pretty weak, but the anecdotes are interesting if you can stand to bear witness to some of the deepest and most recurrent evils perpetrated by the human animal.

Bel Ami – Not a lot to redeem this weakly characterized story of a handsome, newly discharged French soldier’s rise to wealth through the seduction and marriage to some of the wealthiest women in Paris. About all that Robert Pattinson brings to the main role are his good looks. Some nice costumes/sets and a good supporting cast, but really not enough there to recommend it to anyone.

The Do-Deca Pentathalon – Mostly enjoyed this film from the dynamic duo of Mark and Jay Duplass about two ultra-competitive brothers mending a deep rift that started long ago over a series of “if teenagers invent the olympics” events called the Do-Deca Pentathalon. Watching the two adult brothers sneak out of the house to compete at lasertag, ping pong, etc. was pretty fun. Would have loved this film if it was a bit tighter and the two brothers had been named Belushi. Mild recommendation.

Found Memories – LOVED this poetic, deeply layered film about a young, woman photographer who walks into a changeless, tiny town inhabited solely by the elderly and through patience and consideration gradually gets the inhabitant to open up to her about their lives and pains. The performances are understated and of the highest quality and the slow pacing perfectly suited to the film’s material. There is something of a French or Russian play to this film in its staging, theming and structure. HIGHLY HIGHLY RECOMMEND.

The Lost Years – A documentary about generations of Chinese immigration to Canada, US, Australia and New Zealand  and their struggles for identity in cultures that presented them with a great deal of societal prejudice and racist legal codes. Some of the material was interesting, but was lacking in overall structure and unified vision.

Lola Versus – I really like Greta Gerwig, but I had a hard time relating to or liking her character. Lola is just too obviously the source of her own unhappiness and I find the idea of someone who is writing a thesis on stillness and silence frenetically packing all of life’s misadventures into a single year to be just a bit too contrived.

Game of Werewolves – I found the old school wolfman costuming and effects to be refreshing and the bit with the fingers was freaking hilarious, but there ultimately wasn’t enough funny there overall for me. The bit with how nobody knows how curses quite work but seem certain of their own opinions could have driven the plot of the movie to great comic effect. It could have made the movie, but the director instead spent more time on a lowbrow joke about villagers and sheep. Can’t really recommend unless you have bottomed out your Netflix queue and are looking for some late night werewolf camp to stream to fill the wee hours of the morning. Would love to rent one of their 40+ wolfman costumes (made with the hair from cash poor, newly shorn Chinese villagers!) for next Halloween, however.

The Painting – Enjoyed the lush and varied styles of “painted” animation in this film which has the half completed characters inhabiting the paintings in a French artist’s studio coming to life and escaping into the real world in order to find their maker and be completed. I loved the animation but found the pacing a bit too slow and ponderous for the audience for which this film was intended. I am not sure what your average 4-8 year old American kid would make of it. The French in the last decade have put out a series of visually and stylistically unique films that are almost a genre onto themselves. The most notable of these are probably Persepolis, The Illusionist, The Triplets of Belleville and A Cat in Paris. Add The Painting to this list.

John Dies At The End – I’m a big fan of the book, but I remember thinking to myself while reading it that this would make an absolute mess of a movie. I enjoyed watching the film, but it was definitely a big mess of a film. I am not sure people who hadn’t read the book would get much out of it. I spent most of the car ride home trying to explain various aspects of the film to my very confused father. An extended cut might help in some ways but would likely cause the film to drag and become even more unfocused. I look forward to the book’s sequel whose title is, I kid you not, THIS BOOK IS FULL OF SPIDERS.

360 – A series of lives are connected through their decisions to act/not act on various aspects of their sexuality.  In some cases their lives are made better, in some much much worse. The movie repeatedly talks about how when life presents you with a choice you are ultimately going to have to pick a path, but never really asserts which is the better path to follow. The movie ends back where it began, which may be the source of the title and speaks to the universality of sexuality as a driver of human happiness/unhappiness. I enjoyed the performances, but none of the vignettes really struck me as terribly original or thought provoking. The stories are almost too universal. I felt like I’d seen them all before too many times.

Eliminate: Archie Cookson – Archie Cookson is a ex-spy who has been sidelined to a desk and has settled into life as a hapless, drunken has-been in a department transcribing foreign language intercepts. When a tape (highly incriminating his paymasters) lands on his desk, they send an assassin to liquidate his entire department. Archie escapes but realizes his days are numbered. His ambivilance about going out gracefully or striking back fills most of the rest of the movie. I found the movie quite funny, although I found Archie’s kid just plain bizarre. A nice change of pace from most spy films.

The Crown Jewels – A meandering adult fairy tail that is too dark for too long. Didn’t enjoy, save for an appreciation of some cinematography that made scenes looked filmed through water. I did like the bit about the gay figure skater becoming a NHL hockey player, but that was about it. Can’t recommend.

4 Days in May – Follows a small group of Russian soldiers (lead by a just and fair man) encamped in an orphanage and a larger group of Nazis encamped on the seashore nearby hoping to escape to Denmark to surrender to the British as they both attempt to survive the war’s end. The thought that surrendering to the Russians would be akin to a death sentence is never spoken, but is omnipresent. The Russians and Nazis do their best to not confront each other. Both sides have seen enough blood and want to ensure no more is spilled, especially their own unless absolutely necessary. What does honor and their humanity demand of them? Eventually the two sides form an unlikely alliance as the children of the orphanage become threatened.  I really liked this WWII film which found something fresh to say in a genre where everything has already been said.

True Wolf – I strongly disliked this documentary about a couple who raise and socialize a wolf (seemingly for the sole, unexpressed purpose of propagandizing the wolf reintroduction movement). The interviews during the movie got extremely repetitive. The phrase “we are here to dispel myths about wolves” gets repeated frequently, yet during the movie very few facts or statistics about wolves and their behavior are introduced. The film comes out heavily in favor of wolf reintroduction and doesn’t really acknowledge that sane, rational people might have a differing viewpoint. Virtually the only footage/interviews of people against wolf reintroduction were of wild eyed loonies frothing at the mouth while saying stuff like “the bible says wolves are the devil’s creature.” Setting up a straw man does little to strengthen your argument. As someone who has read a few books on the evolutionary history of wolves and dogs and their differing psychologies, I found it interesting to see footage of a socialized wolf reacting to people and dogs as you only really ever see footage of wolves in their natural habitat on nature shows, but that opportunity is about the only redeeming quality for this one sided piece of propaganda masquerading as a documentary.

The Ambassador – I loved this extremely gutsy piece of film making by Mads Brügger which exposes (in a surprisingly funny way) the trading of diplomatic credentials to those seeking to smuggle Blood Diamonds and other illicit business dealings through the use of hidden cameras. Mads plays the role of an affable, naive corrupt businessman to the hilt in a performance that is every bit as funny as Sacha Baron Cohen and utterly convincing. One gets the impression that almost any of his many unaware subjects would have put a bullet in the back of his head had his performance not been convincing or had they been aware of the filming. One of the people interviewed several times during the film does in fact get assassinated during the making of the film. This film would get high marks from me by simple virtue of its sheer audacity, but is funny and revealing to boot.

Earthbound – I disliked this overly saccharine, cutesy story of a man who may or may not be the exiled heir of an alien empire, Zalaxon. The whole “is he a space alien or just delusional” concept has been done to death numerous times on numerous TV shows. About the only new thing this film adds to the mix is that he is looking to find a mate. I did enjoy seeing curly haired doll-faced Jenn Murray as the chosen object of genetic compatibility. I last recall seeing her in the excellent BBC series The Fades as a revenant ghost slowly gaining solidity through the consumption of human flesh.

People Like US – I liked this story of a deeply indebted, manipulative, fast talking man who receives an unwanted bequest from his estranged father in the form of $150,000 and the task of delivering it to a half-sister he (and his mother) never knew existed. The movie plays around with the idea of him taking the money for himself, but “selfish bastard steals money from family without guilt” doesn’t play very well in theaters, so of course the movie runs down the feel-good “selfish bastard isn’t really a selfish bastard and finds meaning to his life through connection with others” track. The people in this movie are a bit too beautiful (Chris Pine, Elizabeth Banks, Olivia Wilde and Michelle Pfeiffer in the same movie is just total overkill) and the dialogue is at times a little too sharp and unnaturally delivered, but on the whole I liked the concept and execution.

Moonrise Kingdom – Watching this movie is a bit like taking the oddest people you’ve ever met, packing them around a campfire and having them spill out the oddest real events from their lives after one too many beers, then distilling all those people and events into a plot that takes place over the course of a weekend. Whimsical in the extreme with a singular visual and audio aesthetic that is pure Wes Anderson. One of his best, imo.

Brave – I liked the way this latest Pixar film started out (but not how it ended) with Merida as a strong willed young woman refusing to submit to the narrowly defined traditional role and appropriate behavior of a highborn lady, as defined by her mother the Queen. Instead, she wields a bow with great skill, rides her horse with reckless abandon and climbs waterfalls. When her parents force her into a marriage for the good of the realm, she runs away from home and I wish she had stayed there. I wanted this to be the story of Merida setting forth on a great adventure, battling vikings marauder, becoming a war-leader against the British, etc. and uniting the clans through her unrelenting bravery. Instead, the film switches to something that is a lot more formulaic Disney than Pixar, with witches and spells to be undone and with Merida in a burst of filial piety ultimately accepting that she is overly prideful. At the end, the various claimants to her hand go home in their ships temporarily mollified, with the wedding forestalled. The choice of whom to marry is now hers, but the movie seems to never question that the eventual path of her life is going to be marrying one of the other clan’s louts. At the very least, they should have let her kill the evil bear with an arrow through the eye!

I am sure this film is going to make ridiculous $ at the box office and it is not a BAD film per se, but it isn’t what I’ve come to expect from Pixar and I think will be ultimately counted as one of their weakest films, at least by adults who have come to expect lots of in-jokes and layers of meaning. I also question the mixed messages this film sends to young girls.

The Exorcist – Much emulated horror classic that makes almost everyone’s short list for best horror movie of all time. I still get the chills every time I see it. Every time I see it, I become a convert to the idea that Evil is a palpable, deliberate actor held somewhere in the viscera of the world and every once in a while finds an opportunity to torment us. William Friedkin spoke engagingly to a rapt audience for the better part of 45 minutes prior to the film. One of the highlights of the festival for me. Went out and rented a number of his other films that were not shown as part of his retrospective. Would have REALLY liked to have been able to see a print of Sorcerer, which is unfortunately only currently available in a 4:3 pan and scan format.

Carrie – Another perfectly crafted horror classic that doesn’t need to be remade, but is getting the reboot treatment anyways. Sure, the hairstyles, makeup are dated, but the catty, insidious and meticulous conceived torments of teenage girls against other teenage girls are eternal. Same goes for the ruffled, rented suits worn to prom…

Diaz: Don’t Clean Up This Blood – Extremely difficult to watch dramatization about an incident of extreme police brutality in the wake of protests of the G8 summit. A good chunk of the movie is watching hundreds of police in full riot gear moving through a school and repeatedly bludgeoning every person they find over and over again. Almost every person they beat is shown to be fully compliant and peaceful. A dozen or more people left this film during the screening I was at due to the level of violence. I have a problem watching dramatizations of real events. I would have liked to know more about the sourcing of the facts portrayed in the film and to what extent the film was based on consensus views. I would have almost preferred the narrative film had been intermixed with interviews with the people portrayed/effected. This is an important film, in its way, in that I feel it is important for people to serve as unflinching witnesses to history and the evil men do, but I had a harder time watching this than many of the holocaust films I’ve seen. NOT FOR THE FAINT OF HEART.

Elena – I liked the concept and structure of this film, but not the execution. I found myself thinking about the themes explored in the film a great deal even weeks after seeing it. There were a few unnecessary scenes that I didn’t feel added much. The pacing was too slow. I highly disliked the single song (a philip glass piece, I think) soundtrack that was used over and over whenever they needed to queue up some dramatic tension. This would have been a masterpiece of a Hitchcock film.

The Fourth State – This is nominally a thriller, but the whole plot and journey of the main character is really just a narrative vehicle used by the creators to take Russia to task for its many ills including intimidation and murder of journalists, everything surrounding Chechnya, the creation of ultra-nationalist partisan youth groups, political corruption, etc. Another movie goes with whom I spoke afterwards said something to the effect “That movie really worked as a thriller as long as I ignored all the major major plot holes.” Unfortunately, I couldn’t. Thumbs down from me.

King Curling – This movie struck me as cheap Wes Anderson knock-off. Filled with bizarre characters doing bizarre things. This movie felt to me like someone had taken a conventional sports film plot and given it the mad-libs treatment. I just didn’t find it nearly as funny as most of the audience.

Las Acacias – I liked this film about a grizzled, hardened truck driver whose shell begins to gradually crack while transporting a single mother and her baby. The actor who plays the truck driver, Germán de Silva, delivers a memorable performance. He has an incredibly expressive face that does most of the acting in this quiet, understated film. The baby is likely the cutest one you will see on film this year.

The Most Fun I’ve Ever Had With My Pants On – This movie was not the most fun I’ve had with my pants on by a long shot. I went to see this movie largely on the strength of the trailer. The movie does have some amazing cinematic moments, but you can get most of those from the trailer. This is the sort of personal story that is hard to make resonate with others precisely because it is so personal. Dealing with grief is a highly personal process and it is hard to relate to what is going on in someone else’s head due to experiences and emotions accumulated over a lifetime. Drew Denny’s ever smiling face is just too much a mask and her chaotic actions too much a shield. Grief comes out in funny ways and with a logic that only ever make sense to the griever. I never really felt myself wanting to know what was going on inside her pretty head.

Queen of Versailles –


We Are Legion: The Story of the Hacktivists

Future Lasts Forever

Woman in the Fifth –

By my account, that is ~40 films at SIFF. This doesn’t sound like a lot, but I also saw several dozen mainstream films of late and rented a lot of various directors/actors back catalogs when I liked their SIFF film. All told, I estimate I saw ~60 films over this past month. After speaking with passholders, checking out the results of SIFF’s unofficial pass holder group Fool Serious and the awards from SIFF’s official balloting, I would still like to see the following:

Any Day Now
Beasts of the Southern Wild
Chasing Ice
Coal Miner’s Daughter
The Details
The Imposter
The Other Dream Team
Safety Not Guaranteed
The Standbys
Winter Nomads

Posted in Movies | No Comments »

SIFF 2012 – Random Thoughts

Posted by Deliverator on 11th June 2012

Here are some random thoughts about SIFF 2012:

  • I’ve been going to SIFF for the better part of a decade now, but in the past I’ve always gone as a ticket holder. I’ve usually seen twenty some-odd movies. This year, for the first time, I decided to get a full series pass instead.
  • To make the pass worthwhile economically, you need to see a LOT of movies. While I probably didn’t see enough films to quite make it worth while, I did end up seeing a LOT more movies than I usually have in the past and I enjoyed the flexibility of being able to show up at any random screening and have a good chance of getting in. I also liked the camaraderie among pass holders. I had a lot of fun talking to other pass holders in lines, at coffee houses and restaurants about what films they liked and disliked during the festival and film in the abstract. Some of my favorite films this year were recommended to me in this fashion and equally I was steered away from some real turkeys.
  • This year SIFF introduced the concept of queue cards. The idea behind queue cards is that a volunteer starts handing out numbered tickets to pass holders starting an hour before each screening. This queue card is supposed to guarantee your place in line up to the point they start admitting pass holders and guarantee that you will be at least admitted up to 10 minutes before the start of the screening. The theory behind the system is that you can grab your queue card and go off and catch dinner or coffee between screenings and not spend the whole day waiting in line. Also, by only admitting pass holders with a queue card, they can more accurately count the number of pass holders inside, so that they don’t oversell the venue.  This would be a nice system (in some ways) if it was rigidly enforced, but collection of and admittance by queue card was unevenly enforced at best.
  • The major negative to the queue card system is they stopped doing back-to-back passes for pass holders.  The back to back card lets someone seeing two or movies in a row at the same theater get readmitted without having to go stand back in line. A lot of pass holders like to go for sheer volume rather than picking and choosing. These people basically camp out all day at the theater and see as many movies as possible using their pass. I spoke to several people that saw over 100 films over the course of the festival. In case you aren’t proficient at grade school math, that is seeing 4 movies a day for 25 straight days! With the queue card system in place, the only way to ensure admission at the second screening was to leave the film in progress an hour before the start of the next film to collect a queue card and  re-enter the theater (having missed some of your movie) . This resulted in a lot of people holding up their watches and cell phones to check the time during films, getting back up and returning to their seats. It frankly annoyed the crap out of me, but I don’t blame the marathon pass holders for doing it. I blame SIFF for creating such a crappy system with predictably disruptive consequences.
  • All the pre-film stuff was outright annoying. Watching the same stupid bumper dozens and dozens of times really grated on my nerves. A little variety would have been nice. Oh, it isn’t helpful to anyone to show trailers for films whose screening dates have already passed. Given how little time there is between screenings, especially if you have to rush off to a theater across town, it would have been nice if they kept the pre-film crap to an absolute minimum. This became especially annoying when going to films that were already running 20 or more minutes late. I attended at least 3 films which started a half an hour or more late, 1 film that was 40 minutes late and probably dozens in the 15-20 minutes late range.
  • SIFF should run shuttle buses between festival venues. This would have been especially helpful between Pacific Place, Egyptian and Harvard Exit, which are all relatively close together but in areas with limited parking and are far enough away to make walking between theaters in the time between films difficult.
  • I don’t think SIFF needs to have to make sure all movies appeal to a mainstream audience, but I heard of at least 3 screenings this year where large percentages of the audience were offended, grossed out or upset and walked out. I think it would be a good idea to place some degree of warning on these films listings in the catalog (and no I don’t think it is that hard to figure out which these might be).
  • I disliked the number of movies that SIFF screened that already had secured a wider box office release or were already available on DVD prior to the start of the festival. I come to SIFF to see the movies I can’t see elsewhere.
  • I wish SIFF would go more for quality than simply sheer quantity. I saw a large number of frankly mediocre efforts this year. I would rather SIFF go in the direction of greater curation coupled with more screenings. TIFF for example runs just a little over a week, but I can scarce recall seeing any outright turds there. SIFF usually only runs 2 screenings of most films and screening are usually only a couple dates apart. This makes it hard to make choices on what films to see based on positive or negative buzz from early screenings.
  • SIFF should reserve time at the end of the festival to screen films which were sold out or proved to be audience favorites. This is separate from the existing “Best of SIFF” which runs several weeks after the end of festival and incurs a separate cost. Films like Safety Not Guaranteed were significantly oversold and they probably could have used an extra 300 seats for the Moonrise Kingdom screening at the Egyptian (450 seat capacity). SIFF’s audience attendance has quite frankly outgrown its small boutique theaters. They either need to bring additional venues on board, do additional screenings (my preference) or move the whole festival into a single metroplex like Pacific Place.
  • SIFF did a much better job in terms of presentation quality this year. Last year was a cavalcade of minor disasters where the films kept breaking, sound kept cutting out, hollow sound, out of focus etc. Did notice some oddly rounded edges on a number of films projected at Uptown. Don’t think this was actually keystone distortion, but something similar. A projectionist told me this might have been a result of using the wrong lens in conjunction with a curved screen.  Also noticed some audio hum at Egyptian. Might be the result of a ground loop. This can occasionally be physically dangerous, so it would be a good idea to get this checked out.

Posted in General, Movies | No Comments »

The perpetually sucky state of non-destructive book scanning

Posted by Deliverator on 7th February 2012

Every few years I find myself in the unenviable position of unavoidably needing to non-destructively scan a book. Every few years I pray that someone has come up with an affordable, reasonably quick way of doing this that produces good quality results. Every few years I burn an evening researching the state of the field. Every few years I come away disappointed. Here are my observations from this go around:


Sheet Feeders – If you can afford to destroy the book, you can cut off the binding with a fine toothed band-saw or other power tool of your choice and feed the pages through a sheet-feeder style scanner. Sheet feeders like the popular Fujitsu ScanSnap series can scan both sides of each pages at something like 20 pages per minute at 600ish DPI. This is mighty impressive as it cuts the actual scanning time for a book down to something like a half hour. Unfortunately, when I find myself in the position of needing to scan a book, it is usually some rare tome it took me 2 years and $300 to find on AbeBooks. For my purposes, solutions requiring a band-saw need not apply. Also, many of the better scanners cost $400+, which is pushing what I would consider affordable.

Commercial Copy Stands range from simple single overhead camera rigs to more complex dual camera rigs with adjustable cradles to support the book without damaging it, re-positionable lighting, non-reflective glass to hold the pages flat, automatic page flippers, etc. Commercial, off-the-shelf solutions from companies like Atiz can run $14k+ without even factoring in the cost of cameras (typically high end Canon DSLRs). Great, if you are a university library spending grant money, sucky if you are a book nerd on a budget.

DIY Copy Stands – A substantial percentage of the functionality, speed and quality of these rigs can be replicated for under $1000 by building your own dual camera copy stand following one of the several increasingly standardized designs from the DIY Book Scanner project. This is still more time and money than I want to spend and probably more space than I want to waste for a device I would only very seldom use. When a full, well documented/supported, single evening kit is available for under $300 plus the cost of cameras, I will probably be interested. The BookLiberator looked to commercially produce kits that would meet all my requirements, but efforts to produce the units fell apart after Ion Audio announced its similar sub-$200 BookSaver product at CES 2011. Ion has since VERY quietly pulled the plug on the BookSaver without ever selling any, but their initial product announcement was enough to send most small, independent efforts to produce a similar device scurrying for someplace small and dark.

Flatbed scanners are an inexpensive, mature, widely used technology which suck at scanning books in a wide variety of ways. First, most flatbeds tend to be optimized for high quality scans of things like photos, not for speed. Secondly, most scanners have a significant bezel around the scanning platen, meaning the only way to scan a book is to significantly bend/distort the spin in order to get the pages to lie flat against the glass. Even mashed against the glass, you usually get significant page distortion near the binding resulting in curving text and uneven illumination.

Several years ago I purchased a Plustek OpticBook 3600 plus, a flatbed scanner specially optimized for scanning books. The OpticBook has a very thin bezel along one edge of the platen which lets you open a book to a 90 degree angle and have one page flat against the glass while the other hangs freely over the side. This lets you produce an undistorted scan of a page without significantly bending the spine. The “DigiBook” software included with the scanner has an automatic page rotation feature, so that every other page gets rotated 180 degrees. This lets you scan a page, flip the book over to scan the opposite page and have everything automatically rotated the right way. There are giant over-sized buttons on the scanner that let you trigger a scan in B&W, greyscale or color. The actual scan takes 5-8 seconds, as the scanner is optimized for speed, rather than highest possible DPI.

The OpticBook concept is very nice in theory, but the implementation leaves something to be desired. Even with the scanner bezel as thin as it is, the scanning element doesn’t get close enough to the binding to scan most paperbacks. It works fine for hard covers like textbooks, where the content doesn’t start as close to the binding. The software is also very crash prone and the work-flow somewhat less than ideal, with the operator having to hit a “transfer” button in the software after each page to write the image out to disk, despite the over-sized buttons on the scanner itself. Anything that adds 5-10 extra seconds to the work-flow gets multiplied tremendously over a 500+ page book. These scanners are also very poorly sealed, with significant dust accumulating on the interior of the glass plate with no easy way to clean it short of disassembly. There doesn’t appear to be a way to adjust the lamp brightness, so you tend to get a bit of bleed through from text on the other side of pages you are scanning. Many users also complain of short bulb life, although my unit is still functional. From reviews I’ve read, I am not convinced that Plustek has learned much from their mistakes in successive models in this series.

Handheld Scanners – I’ve never been impressed with the quality of the results from hand-held “wand” scanners. I haven’t personally checked out any of these devices in years, as I’ve largely consigned the whole category into Sharper Image / SkyMall crap-gadget territory. If someone wants to tell me that X device can quickly and accurately scan a paperback, I may look into these in the future.


Post Processing – While hardware has seen little improvement since my last review, there have been some improvements on the software side of things. The DIY Book Scanner project has yielded a plethora of scripts, tools, etc. for packaging up scans into various digital book formats. Of these, I have found a tool called Scan Tailor to be the most polished, easy to install, and to use. Scan Tailor will take a directory filled with scanned images and will straighten, deskew, remove background and bleed through (to give you black text on a pure white background), set a constant page size/margin, etc. Scan Tailor will work almost completely auto-magically through each step of the process and if it does make a mistake, it is easy for the user to intervene and apply a manual correction. Scan Tailor cut my workflow from previous years of 6-8 programs and scripts (each with fussy dependencies on libraries and frameworks) down to 3. I still do some post processing of scans in irfanView and Scan Tailor doesn’t do the final bundling of images into PDFs, DJVU, etc. or do OCR, but other than that it is pretty much a one stop shop for post scan image processing.

Binding – Once you have a directory full of post processed images, what are you going to do with them? I am still using Presto Pagemanager 7.10 for assembling my post processed TIFF images into PDFs. It isn’t ideal in many ways, but has the virtue of not costing me anything more and working consistently, if in somewhat of a hurky-jerky liable to temporarily freeze Explorer kinda way. I played around with a half dozen PDF/DJVU binder scripts/programs recommended by the book scanning forums and basically concluded that the free options all royally sucked in one way or another, not the least of which is requiring me to install 5 different programming frameworks just to try them out. Scan Tailor is a lovely, consistent, unified application that is easy to install and use. The DIY Book Scanner community could really use something as well done for the binding stage of the process. As it is, one is left to fend with a gobbledygook of unmanageable python scripts, ruby scripts, feeding various Unix command line utilities and throwing an undocumented fit anytime it finds something not to its liking. The situation is marginally improved if you want to output DjVu files rather than PDFs, but only marginally.

OCR – So, you want to turn those post processed scans into a re-flowable format like .epub for easy reading on your ebook reader device? You are kidding me, right? OCR is one of those things that has been around since the dawn of scanning and despite a lot of protestations seems to have changed little. If you asked me about the state of OCR 5 or 10 years ago I would have told you there is Omnipage & Abbyy Fine Reader & everything else. Today, that still seems to be the state of the industry. I tried a half dozen of the everything else variety including OpenOCR (Cuneiform), VietOCR and TiffDjvuOCR. Most of the free solutions seem to use Tesseract, an open source OCR engine from Google. Across 3 books with straightforward, single column formatting and commonly used fonts, I found the free OCR packages basically good enough to create a rough keyword index for searching books, but nothing near the accuracy to create a readable, reflowable ebook without significant time spent correcting errors. I concluded I might actually be able to retype a book faster and more accurately than if I tried to correct all the strange and easily unspotted errors committed by OCR. I would be curious to try the commercial packages at some point, as a lot of book scanners seem to swear by recent versions of Abbyy Fine Reader, but I’m not really in the mood to spend $150+ to fart around with either of the commercial offerings.

Posted in Books, General, Rants and Raves, Tech Stuff | 2 Comments »

Inexpensive/Disposable Video Cameras

Posted by Deliverator on 16th March 2011

Five and a half years ago I started fooling around with “disposable” video cameras being sold through the CVS pharmacy chain. These video cameras were meant to be one time use equivalents of the cardboard box disposable still cameras still sold at many stores throughout the world. The idea was you would pay around $30 for the camera, go out and take some footage and then bring the camera back and they would give you a DVD with your video on it, but keep the camera. The pharmacy would then wipe your unit and sell it again to someone else. The CVS cameras were small, built robustly and powered by simple AA’s and inexpensive. Naturally, the hacker community went to work on the cameras and quickly figured out how to download the video without the pharmacy’s help, making them reusable. These were great cameras for use in places you wouldn’t want to risk a “real” camera. People attached them to model rockets, helicopters, planes, placed them next to hot things, explody things, etc. They were cheap enough that you wouldn’t think twice about risking the camera on the off chance of capturing some cool footage. Naturally, I bought half a dozen.

Over the years, I’ve attached them to robots, glued fisheye lenses on them, put them in zip-lock bags and used them underwater. I’ve captured some real fun footage because I was no longer risk adverse about risking the camera. In the process I’ve destroyed two cameras outright, permanently modified two for niche uses and one is good for only spare parts. Only two escaped my abuse entirely unscathed. Today, I threw them all away.


Quite simply, the magic economic equations surrounding gadgets + mass market demand + capitalism + time has rendered the old CVS cameras obsolete. For under $50 I can now buy a camera from Kodak that is quite a bit smaller, holds more video and at higher quality than the CVS cameras, and is mildly hardened for rugged and underwater use. If you shop around, you can get this camera for more like $40 at stores like Best Buy, but I just got mine at Amazon. There are similar form factor cameras from other makers, but most are significantly more expensive HD capable units that are designed more for people wanting a cheap, small, everyday camcorder or for technophobic people looking for a very easy to operate video camera. These units (Flip for example) tend to be more like $100.

Tomorrow, I am going to strap one onto a robot and watch things go crunch. If the camera survives, great! If it doesn’t, the camera’s Micro-SDHC card is small enough that I can find it intact in the twisted, shattered remains and I probably got some great footage for $50. Photography and videography is at its most interesting when people are willing to push boundaries and experiment. The technology has finally gotten cheap enough that “that would be really cool but I don’t want to break this expensive piece of equipment” is no longer part of the equation.

Some thoughts on the Kodak Mini Video Camera:

-Captures at 640×480 at 30 fps as an AVI file using an MJPEG video codec and 16 bit PCM audio at 11khz. At this setting you can fit about an hour’s video on the included 2 GB Micro-SDHC card. You can also do QVGA at 60hz and take stills as well. There doesn’t appear to be any image stabilization, but what can you (currently) expect from a camera that is under $50. Give it a few years though…

-The camera has a built in rechargeable battery. The unit has a pop out full sized type A USB connector that pops out of the side for charging. You will need to use a USB extension cable (not included) to plug it into a PC to charge. My unit did not show up as a USB mass storage device when I plugged it into a computer running the 64 bit version of Windows 7. Other users report it coming up as a drive letter and forcibly installing (without prompting) some piece of software called Arcsoft Mediaimpression SE which also seizes control of most video/photo file extensions. I was glad this was not the case with my unit.

-Because my unit doesn’t show up as a USB mass storage device, I had to pop the Micro-SDHC card out of the bottom of the unit. I had to use itty-bitty tweezers (thanks Tweezerman!) to grab onto the card as there is no ejection mechanism for the card. A 2 GB card was included with mine, but this camera is sometimes sold without a card.

-The camera is exceedingly easy to use, with just an on/off button, 4 way arrow buttons and center selector and a “settings menu” button. The simple control scheme should make this a good camera for micro-controller driven operation, if someone wants to strip it down to just the circuit board for use on a rocket, kite, balloon or something.

-The whole unit is smaller than a pack of cards.

-I am not sure if I would entirely trust the built in waterproofing on the camera. The only point of entry for water is through the base, which hinges open to reveal the USB connector and card slot and potentially around the membrane rubber buttons. The base does have some rubbery gasket material to seal against water, but it is pretty minimal. I would recommend coating the area with a thick grease/vaseline, etc. before submersion in water beyond a few feet.


Posted in Photography, Portable Computing/Gadgets | 1 Comment »

My take on Ipad 2

Posted by Deliverator on 2nd March 2011

I own an original model Ipad and use it daily. Today, Apple announced Ipad 2. Here are my thoughts on it and whether it is enough for me to upgrade:


-Ipad 2 is thinner and a little lighter than the original, while retaining the same general width x height and screen size of the original. The slight reduction in weight will be nice for those who use it as an book reader, as arm fatigue was a definite factor with the original.

-Ipad 2 has dual cameras. I’ve never seen video conferencing as much of a killer app, but I know some people that were really dieing for this with the Ipad 1.

-Ipad 2 has a new, faster dual core processor with what is being described as “9x” faster graphics. I am all for increased performance, but it is up in the air whether many app makers will write applications that make use of the faster subsystems for risk of alienating the large Ipad 1 user base.

-Magnetic screen cover system is a big plus in my view, as it lets you protect the Ipad’s screen when putting it in a bag or (in my case) large pocket, while adding little to the dimensions of the unit. Most cases for the Ipad 1 greatly increased the unit’s apparent bulk.

-3G models available for Verizon and not just AT&T.

-Has some extra motion sensing capability (3 axis gyro) compared to Ipad 1, which should be nice for gaming.

-One of the big pluses in my view is the new HDMI video output adapter, which works for ALL applications. This is a big change from Ipad 1 where applications had to be specially coded AND approved for TV output use. Think Hulu+, games, etc.

-Pricing is being kept competitive or slightly lower than similar Android devices


-No built in SD slot for downloading photos. This should have been do-able even with the thinner bezel of Ipad 2. The lack of a SD slot was a consistent minus cited by many Ipad 1 users/reviewers. I hate that Apple tries to make their devices aesthetically clutter free at the expense of needing to buy and carry a lot of easily lost adapters & dongles.

-No USB port. Nuff said. Wasn’t a big issue with me, but I know a lot of people wanted it.

-The Ipad 2 apparently still has only 256 MB of ram. I’ve bumped up against this consistently in my everyday use of the Ipad 1, which has the same amount, especially when doing tabbed browsing.

-Still requires an external power brick for charging versus being able to charge via USB on most computers, even if it takes significantly longer.

-Still no syncing over WiFi.


-Apple is beginning to enforce much harsher terms on 3rd parties wishing to supply content to Ipad users. They are essentially requiring any content being provided to users to also be available for purchase through their own content stores at the same price, so that they can get a (sizeable) cut of the pie. This will apparently apply even when the purchase is made “off site” and not as an in-app purchase. This will effectively make it impossible / not cost effective for competitors like Kindle, Nook and Sony to offer eBooks to Ipad users and will likely broadly apply to other types of content as well. I find this move to be incredibly anti-competitive and is a HUGE minus for me. One of the things which has made Ipad such a compelling part of my daily life is its ability to consume media from a variety of sources, whether that is news, books, music, podcasts or video. By constraining my choices to what Apple itself offers, they have greatly limited the appeal of the whole platform to me. If it wasn’t for this single thing, I would probably buy an Ipad 2. As is, if these changes take effect, I may sell my existing Ipad 1 in favor of an Android alternative.

Posted in General, iOS, Rants and Raves, Tech Stuff | No Comments »

Some thoughts on Western Digital My Book Essential 3TB USB 3.0 External Hard Drive

Posted by Deliverator on 25th February 2011

I recently found myself spending so much time juggling how I was storing my data in order to get it to fit on a combination of a 2 TB and a 1.5 TB external hard drive, that I thought it might be worthwhile to revisit getting a 3 TB external drive for backup. I decided against getting a 3 TB drive when they first came out, in part due to AnandTech’s unfavorable review of the only 3 TB drive on the market at the time, Seagate’s GoFlex Desk 3TB. The big turn offs for me were the poorly designed enclosure resulting in very high temperatures, high $/GB ratio and a host of compatibility issues. Since that time, both Western Digital and Hitachi have gotten in on the game as well with 3 TB offerings of their own. I opted for the My Book Essential 3TB, since it seemed to have the best designed enclosure of the bunch, offered the cheapest $/GB ratio of any of the 3 TB drives on the market at $165 via Newegg and gave me a chance to try out my USB 3.0 port on my Asus P6X58D motherboard.

Installation of this drive was decidedly NOT a breeze. I ended up having to update my motherboard’s bios, USB 3.0 controller sub-firmware and USB 3.0 drivers  just to get the drive to be recognized and then had to install and then update Western Digital’s included Smartware software in order to update the drive’s firmware in order to get it working properly. I wouldn’t recommend this to clients as a “just plug it in to gain 3 TB of storage” device, but once I got it working it has behaved like any other external hard disk drive and has stayed comfortably cool via strictly passive ventilation and worked reliably through multi Terabyte initial data copying and subsequent daily backups.

Western Digital doesn’t exactly go out of their way to advertise it, but this drive spins at something below 6000 RPM (hence the assorted eco-branding). Even with the fast USB 3.0 interface, this drive performs considerably below any 1.5 or 2 TB drive I’ve owned, even with those drives being in USB 2.0 enclosures. This drive is decidedly for bulk data storage purposes only.

One other thing Western Digital doesn’t advertise is that the drive used in the enclosure is the same WD30EZRS series drive which they sell for ~$35 MORE as a bare OEM drive sans enclosure. Popping the drive out of its enclosure is relatively straightforward, although you are likely to pop a couple plastic clips in the process, voiding your warranty. Still, if you are looking for a 3TB internal drive on the cheap and don’t mind potentially voiding your warranty coverage, this is about as cheap as you can get one.

I ended up picking up a second unit to use as an internal drive. I kept it in its enclosure long enough to update it to the most recent drive firmware and then popped it open. I am keeping the enclosure in case I ever need to apply another firmware update. It has functioned like any other non-boot drive in my system, save for that the performance characteristics are such that if you have more than a few apps contending for I/O attention from the drive, throughput drops enough that HD video streams start breaking up. This can be problematic if you are trying to watch a movie and a backup job starts in the background, for instance. To reiterate, this drive whether used externally or internally should be used for bulk data storage only.

Posted in General, Rants and Raves, Reviews, Storage, Tech Stuff | No Comments »