Polarizing Filter

Up to now I've mostly been concerned with interchangeable lenses for my digital SLR (Canon 20D), for different amounts of zoom and wide-angle. The only filters I have are UV filters that I leave on the lenses all the time, more for scratch protection than anything to do with the pictures themselves.

I've been spending a lot of time cleaning up landscape shots by darkening the sky and/or lightening the ground though. Sometimes mashing together 2 or 3 auto-bracketed shots to get decent contrast in bright outdoor situations. I finally got a polarizing filter, and I can see that the editing time will be much reduced!

Despite what you might think from the name, a polarizing filter has nothing to do with Joe Lieberman. It acts like sunglasses for your camera -- reducing glare, increasing colour saturation, reducing blown-out highlights. It reduces the overall amount of light that comes in, but a camera like a DSLR that meters "through the lens" (TTL) can automatically compensate. Camera mavens consider a polarizing filter the #1 most important filter for photographic effects. (They'll advise you not to skimp based on price. In this case at least, I'll concur with that advice.)

There are 2 types of polarizing filters, circular and linear. DSLRs require a circular polarizer, whose effect increases and then decreases again as you spin its front element around. This fact triggers several interesting consequences. A circular polarizer would be useless if zooming or auto-focusing actually caused the lens element itself to rotate, because you could never rely on the polarizer to stay at the rotation where you left it. Cameras that do rotate their front lens elements must therefore need a linear polarizer, which I won't mention again. Because the circular polarizer has two pieces, the back that stays steady and the front that you spin around, it has the potential to be relatively thick. You can pay extra for a "slim profile" filter. (I did.) Now the DSLR owner has three things to spin around on their lens: the zoom ring, manual focus ring if you want, and the polarizer. Luckily, once you get into a bright situation with refections and glare, you can spin the polarizer to the setting you want and then leave it there the rest of the time.

Although a DSLR like the Canon 20D does compensate for the decreased light coming in, that's at the expense of shutter speed. Be prepared to boost your ISO value by a couple of steps -- 400 where you might usually use 100, 800 the moment the daylight is anything less than bright.

The polarizing effect doesn't apply equally in all directions, and its amount depends on the angle you are shooting vis-a-vis the angle of the sun overhead. You can predict where the effect will be strongest by pointing at the sun and tracing an arc directly perpendicular to it; the usual advice is to make a "gun" shape out of your index finger and thumb, aim your index finger at the sun, and rotate your wrist (or imagine doing so) and your thumb traces out a path that points at all the places where the filter will have the most effect. But I only find that useful for figuring out where to look as I turned the ring to gauge the effect. Looking towards reflective water, I could actually see texture appear and glare fade as I adjusted the filter.

I've always been annoyed that Canon DSLRs by default produce photos with low saturation. I've actually got a Photoshop action set up to boost saturation, that I run practically all shots with. (In pictures with bright reds, sometimes the right adjustment is boosting saturation for blue and green, but leaving it unchanged for red.) However, now with the polarizing filter, I can see that this dull-looking default leaves room for the natural increase in saturation you get with a polarizer.

Net result: My pictures taken against the sky or ocean came out much better than usual -- no burn out, good cloud definition, even correct exposure for an eagle in flight instead of the usual black silhouette. I had to boost exposure time and ISO maybe more than I'd like for a set of fireworks pictures, but those pictures had good colour that required less adjustment and saturation-boosting than normal.

One other tip for shooting with a polarizer. Because the darkening effect on the sky varies depending on the direction, you might want to leave the filter off when shooting multiple shots for a wide panorama, to avoid uneven brightness in the sky.

Dining for the Birthday Week

Recently I celebrated a birthday in high style. Because it was inconvenient to dine out on the actual birthday date, my wife and I spent the whole week treating ourselves at some top Berkeley restaurants. And by coincidence, I also got to dine at one of the top San Francisco restaurants the same week. Watch for a meal-by-meal account on my food blog.

Hot Town, Summer in the City

Played a tennis match over the weekend, mid-day in high '80s temperatures. The court was so hot, my opponent's inner tube exploded while we were sitting down on a changeover. Straight set win for me.

When I was a skinny teenager, the heat was my nemesis. Now it seems like I specialize in winning on the most scorching days. I've learned... well, let's not give it all away here! One thing I notice, is that whatever things I bring to beat the heat, I've got more of 'em than the other guy.

Among the Weeds

Woke up extra-early this morning. Felt like going for a row at Aquatic Park, which was my first time in a while. The bulletin board had a diagram showing a new course around the lake, to avoid patches of weeds. Well, I'm still learning the basic contours of the shore, so naturally I kept getting tangled in the weeds. Just like the Sargasso Sea! I finally happened upon a trick for untangling the oars, getting a little bit of speed and then spinning the oars entirely around while dragging them in the water. Not sure if that's the approved method!

Grateful Dead keyboardist dies

Here's the story from the San Francisco Chronicle. Keyboardist Vince Welnick was the last member to be added to the band. Playing keyboards for the Dead seems dangerous on the scale of playing drums for Spinal Tap. Welnick was also a member of The Tubes, who I vaguely knew but didn't know that they were also a Bay Area band.

First Look: Canon Powershot S3

Well, it's my first look anyway. My neighbours asked for some advice about cameras. After I laid out all the considerations, they asked what I would get if I was buying a new camera of such-and-such size and capabilities. The Canon Powershot S3 sez I. So that's what they got. I like the 12x optical zoom, familiar Canon controls, and how compact and light it is. (More even than the G3 I think.) Review to follow.

I'm Gonna Git You, Socca

Today browsed around a little bit at the Epicurious Garden, a new gourmet food court in Berkeley's "gourmet ghetto", steps from the famous Chez Panisse. I had tried the gelato place before. This time I got one of the chickpea-flour mini-pizzas from Socca Oven, something new from the owner of Gregoire's just up the street. No wheat, no dairy, vegetarian choices -- can't go wrong there. Nice little eggplant-covered treat.

Auto-Exposure Bracketing: An Idea Whose Time has Come

On this last trip to Yosemite, I finally tried out auto-exposure bracketing (AEB) on the Canon 20D. I had used this feature on earlier point-and-shoot digital cameras, but on an SLR it seemed a bit heretical. Aren't you supposed to fiddle with exposure and metering to get everything exactly right in one shot? Can't you slap on graduated neutral density filters and polarizing filters to keep sky detail from being blown out?

Well, it turns out there's nothing inherently wrong with using AEB on a good camera. I used it extensively to shoot landscapes, rushing rapids, waterfalls, and people in front of all of the above -- situations with a lot of dynamic range, or rapidly changing light, or unpredictable metering such as when you hand the camera to someone else to shoot a picture of you.

Along the way, I learned a lot about the 20D's advanced options for bracketing, and how to sort, choose, and combine the results in Photoshop. I'll turn these lessons into a series of articles on my new (yet-to-be-named) digital photography blog.

Prius: Tire Pressure and Gas Mileage

On our first trip to Yosemite National Park in the Prius, the average miles per gallon worked out to 48.0. But lately, commuting and puttering around town has been getting 46 and change. The only change car-wise is the addition of a bike hitch, which adds maybe 30-40 pounds total. That doesn't seem like enough to account for the difference.

I read that underinflated tires can lower MPG by about 2% for each pound of lost pressure. The Prius recommended pressure isn't written on the wheels, and it isn't listed on the door jamb or in the owner's manual. It's actually on a sticker on the inside of the glove compartment. Turns out the front and rear tires should be 35 and 33 PSI respectively, and they were about 2 pounds low according to the tire gauge.

Normally, a figure like "2% better gas mileage" is hard to get my head around. But with the Prius getting close to 50 MPG, that 2% is around 1 mile per gallon. Sure enough, inflating the tires an extra 2 pounds resulted in an extra 2 MPG for this trip, clocking in at exactly 50.0. (On arrival at Yosemite, we were actually up to 52.)

Birth of an iTuNation

To keep long music-related posts from overwhelming this personal blog, I've set up a new one strictly for posts related to iTunes, iPod, and music in general:

iTuNation

iTunes: iPod-Only Playlists

Anyone can enhance their iPod experience by making some iTunes playlists that are used exclusively on the iPod. In particular, iPod-only playlists are useful for:

• Trimming big playlists to fit onto a small iPod.
• Trimming huge playlists so that you have enough space for other things on a big iPod.
• Minimizing synching time for playlists that only need to hold enough for a specific trip (say, your daily commute).
• Simplifying the synching process for a multi-iPod household.
  
• Quick lookup for a particular song or artist, without navigating through several distracting layers of menus.

The Outline

I have a 4 gigabyte iPod Nano, which isn't nearly enough to hold all my songs. When I listen on the go, I want to have a wide selection, broken down into two main categories: favorite music, where the songs have high ratings and potentially appear in several different playlists, and unfamiliar music where the songs are unrated and/or have low play count.

I also have a 40 gigabyte iPod (pre-video), which often skirts the edge of being able to hold all the music I want to bring with me. It's easy to download several gigabytes at a time of South-By-Southwest indie rock, Grateful Dead concerts, then get an unpleasant surprise when a synch doesn't have enough room for all the songs, or when I try to use the iPod for file storage and discover there's almost no room left.

When listening in iTunes, I want the widest selection possible, so I have one Smart Playlist with all my 3-5 star songs, another with all my 4-5 star songs, another with all my unrated songs, another with
all the unrated songs with zero play count, and so on. (In addition to my standard playlists where I've picked out each song myself.)

The core technique for iPod-only playlists is to make Smart Playlist "clones" of some of these other playlists, varying the conditions a little so that they work better on the iPod than the original playlists.

With this technique, it's essential to choose the setting "Synch selected playlists" in Preferences > iPod. Each iPod has its own separate setting, so you'll pick different sets of playlists depending on which iPod is plugged in. If more than one is plugged in at the same time, choose the iPod name from the dropdown inside the Preferences > iPod dialog.

Space Savers

The key consideration with an iPod is, thou shalt not run out of space. You might think this is easy to guarantee if you have a big iPod with many gigabytes free, but things can change in a heartbeat:

• You can download a big song collection. These days, you're likely to find hundred of free songs all packaged together in a promotional download from the South-By-Southwest conference, or dozens of free full-length concerts from the Internet Archive.
• You can get a second, smaller iPod and find that your current system of playlists doesn't work for a 2-iPod setup.
• You can decide to use your big iPod for backing up critical files, and realize that you have to free up several gigabytes.

Thus, to save space with an iPod-only playlist:

1. Identify each playlist that has the potential to grow beyond what your iPod can comfortably hold (given that you might use the iPod to hold lots of other playlists and/or data files).
2. Identify each playlist used for unfamiliar music that holds more songs that you could listen to between synch sessions. For example, if you rate unfamiliar songs during your daily commute, and sych that iPod once a week, do a back-of-the-envelope calculation to figure out how much total time the playlist needs.
3. Make a folder in iTunes by selecting the Library icon in the Source list and choosing File > New Folder. Give the folder the same name as the iPod.
4. Inside this folder (i.e. select the folder before creating each playlist), create a new Smart Playlist for each of the original playlists you're cloning. Name the new playlists by concatenating the original playlist name and the iPod name, for example "My Top Rated - Joe's iPod".
5. Give each Smart Playlist a single condition, "Playlist is Name of Original Playlist". This creates a clone of that playlist.
6. Check the box that limits the size of the new playlist. Choose a measurement that makes sense in this context. For example, when dividing up space on my 4 GB Nano, I give each playlist a fixed number of megabytes so I can allocate or free specific amounts of space when the iPod is almost full. On a bigger iPod, I choose perhaps 100 songs selected by rating to get the "top 100", or a specified number of hours to last through a week-long trip away from the computer.
7. If the original playlist is a mix of good, bad, familiar, and unfamiliar songs, you can add an extra condition like "My rating is between **** and *****" or "Play count is greater than 0", so the iPod-specific playlist contains only your most familiar or favorite songs. For example, I might have a "Flamenco" playlist in iTunes, while its iPod-only clone only contains my favorite Flamenco songs.
   
8. Plug in the iPod, set it to synch only selected playlists, and choose the ones from the appropriate folder. Because the iPod preferences show playlists in a single big list, you'll need to give them distinctive names as above so that you can tell them apart from the original playlists.
   

Repeat the process for each iPod you have.

Time Savers

Do you ever get a craving for a particular song, artist, or album while listening to your iPod? If you're right in the middle of a playlist, satisfying that craving can be very disruptive -- keep pressing the menu button until you get to the main menu, then navigate down by song, artist, or album scroll through some very long lists, and maybe in the end you didn't really want every song from that artist or album, so you must navigate more menu levels and scroll through more lists. To top it all off, now you're out of the original playlist, even if you just wanted to listen to one song.

The trick here is to take advantage of a few subtle properties of iPod playlists:

• Once a song is on the iPod, there's really no penalty in including the same song in multiple playlists. So why not make variations of the same playlist?
• The iPod has a single global setting for Shuffle Play, unlike iTunes which lets you choose shuffle or sequential play for each playlist.
• Whatever order you sort a playlist in iTunes, the songs are listed in the same order when you bring up that playlist on the iPod.

Can you see where this is going? Using the same technique as in the last section, you can make Smart Playlists that are clones of other playlists:

1. Just use one condition, "Playlist is Name of Other Playlist".
2. Don't set any limit on the size.
3. Use a name that reflects the original playlist but adds some qualifying information. For example, I have playlists "My Top Rated (song)" and "My Top Rated (artist)". (I would have made the names a little longer, except that anything longer is truncated in the iPod listing.)
4. Sort the playlist by the appropriate column. Then never touch that playlist again! Use the original playlist for searching or fiddling with song info.
5. In iPod preferences, check that playlist so that it's automatically synched with the iPod, in addition to the original playlist.

Now, instead of listening to "My Top Rated" on the iPod, I listen to its clone, like "My Top Rated (song)". If I get a sudden craving for a particular song, I press the menu button once to get to the list of songs in this playlist, then scroll straight to that song because the names are listed in alphabetical order. If I want to zero in on a particular artist, I press the menu button twice to get to the list of playlists, move to the adjacent playlist to switch to the same list of songs arranged by artist, and scroll through the songs alphabetized by artist. As a bonus, I see in this playlist only the favorite songs from that artist, not all the others that might happen to be on the iPod.

The same technique applies any time you want to access the same list using different criteria. For example, you might have a playlist full of podcasts sorted by Date Added, so you could listen to episodes in order. But you might have another playlist with those same podcasts sorted in order of time, so that you could pick a long or short one to match the length of a drive.

Advanced Tip: Pseudo-Shuffle Playlists

I mentioned earlier how the iPod has only a single, global Shuffle setting. Again, this can lead to inconvenience if you're listening to songs in random order and want to quickly switch to sequential play, or vice versa. You have to navigate to the main menu, down into Settings, change the Shuffle setting, then come back up and go to Now Playing or navigate to some other playlist.

For example, in the case where you start jonesing for a certain band, you probably want to hear several songs in a row from that band. Even if you switch to a playlist arranged by Artist, that doesn't help if Shuffle Play is still turned on -- you can pick the next song, but iPod will jump randomly when it finishes.

There are enough instances when it's helpful to turn off Shuffle Play -- sequence of podcast episodes, that I sometimes leave it off for long stretches. As a shortcut, instead of turning Shuffle back on, I'll use even another playlist, like "My Top Rated (random)", where the songs are already in shuffled order.

Let's think about that a minute. Even if you don't go the extra step to create this final playlist, how would you get the songs in unpredictable order? You could sort by some other column like Time or Size, but then the songs at the start would be kind of weird (either very long or very short). Most other columns are largely blank; for example, sorting by Comment gives you the songs with Comment fields in order by that field, then all the ones with blank Comment fields in order by song name. No good there.

iTunes has a little-understood notion called "Play order", represented by the column of numbers on the left, with no column title. Click on the unnamed column title, and you'll see the essential order that iTunes thinks the songs should be in for that playlist. (Either ascending or descending, depending on the direction of the arrow in the column header.) With the playlist sorted by that column, click the Shuffle icon in the bottom-left (looks like two snakes having a good time), or option-click the icon if Shuffle is already turned on for that playlist. You'll get a whole new randomized order for that playlist, that you can utilize on the iPod to give you random play even if Shuffle Play is turned off.

Periodically, I'll get sick of always seeing the same first screen of songs every time I go into a particular iPod playlist. Reshuffling them in iTunes and synching again helps keep them fresh, and I could swear that even Shuffle Play turns up more interesting songs after a playlist is re-randomized like this!

Categories: itunes, ipod, music, mp3

iTunes: Music Backups for Music Collectors

In this article, I address a topic that's bugged me for years: how to back up your big and/or fast-changing music collection through iTunes.

Serious nerds don't feel the need to do anything special to back up their music, because they're already backing up their whole computer all the time. But that's cumbersome if you have a big music collection, or if your music library is spread across multiple drives, or if you frequently make changes to song info. (Any such change updates the MP3 file so the backup software backs it up again. Any change to the artist, album, or song title can cause the file to get renamed, messing up the way the backup software tries to track changes to the same file.)

The man on the street can burn a CD or DVD from iTunes every now and then. OneDigitalLife.com has a popular page showing how to do that. But that's cumbersome if you have a big music collection, or you keep a lot of songs unchecked but still want to back them up.

There must be a middle ground, a technique using iTunes but still flexible enough to handle extensive music libraries!

The Outline

As in the OneDigitalLife article, the core of this technique is a smart playlist that accumulates all your recently added songs. That is, it has a "Date Added" condition so that all music added since the last backup appears in the playlist automatically. At periodic intervals, or after the playlist grows big enough to make a backup worthwhile, you burn it to one or more CDs or DVDs. Then you reset the "Date Added" condition so the playlist becomes empty, and gradually fills up again as new music is added.

The Essential Smart Playlist

Let's call this Smart Playlist "Backup - Monthly", for lack of a better name. Later, we'll rename it temporarily while doing the actual backups.

We're actually going to go a bit farther than a single-condition playlist; we'll add some touches to make the process work better.

Use a between test for the "Data Added" condition. Make the second date be way off in the future. For example, right now my "Backup - Monthly" Smart Playlist has the condition "Date Added is in the range 4/30/06 to 12/31/06". For most backups, you'll leave the end date alone, but if something goes wrong with a multi-disc backup and it stretches over more than one day, you can set the end date to the date you started the backup process. If you import more songs or fix some typos in song info partway through the backup process, you want to save those songs for the next go-round.

Use a second condition, also with between and the same start and end dates, for "Date Modified". Changes to song info, such as the song name, track number, comments, year, and so on are all stored inside the song file. After you fill in blank fields or correct mistakes and typos, those song files need to be included in the next backup. ("Date Modified" is not changed when you add a rating.)

Before burning the playlist, change its title to something that makes a sensible CD title, since iTunes titles the CD the same as the playlist name. For example, most of the time my Smart Playlist is titled "Backup - Monthly", but before the most recent backup I temporarily changed its name to "Backup - April 2006", then back again after burning the discs.

Don't set a size limit on the playlist. If it's too big for a single data disc, iTunes automatically splits it across multiple discs. Under Preferences > Advanced > Burning, leave the Disc Format set to Data CD or DVD, which ensures that all the files in the playlist are burned to disc. (MP3 CDs omit AAC, MOV, PDF, or other filetypes that you can manage in iTunes.)

Leave the checkbox unchecked for "Match only checked songs". Even though iTunes leaves unchecked songs out when it burns discs, you want them in this playlist. You'll see why in a minute.

Do check the box for "Live updating", so that the playlist grows whenever you add or change a song. You can play games with this checkbox if something goes wrong during the backup and you need to restart it or remove things from the song list. But as a standard practice, leave it checked.

Leave the playlist sorted by either (Song) Name or Artist (or, rarely, Album). The sort column determines how the files are arranged on the burned discs. Sort by song name, and the files are all placed at the top level of the CD, with no directory structure. Sort by artist name, and the songs for each artist go into a directory named for the artist. Sort by album name, and the songs from each album go into a directory named for the album. In each case, an ascending sequence number is tacked on to each item in the root of the CD.

I prefer to sort by artist, because the artist names are easy to scan, and if I'm going to import the songs somewhere else I'll probably do that for all the songs by that artist. I don't sort by song name because I want the song files on disc to keep their original names without the leading 001 etc. If the files are renamed, it's harder to locate or compare against the original files, and I've had the sequence numbers show up in the song titles when I imported the renamed files on another computer. I don't sort by album name because it's hard to tell one "Greatest Hits" album from another without a lot of work fixing up album titles.

Leave the playlist sorted the way you want when you first create it, and doublecheck the sort order before each time you do a new backup.

The Supplemental Playlists

Here's where one of my pet peeves with iTunes comes in: there's not a whole lot you can do with unchecked songs.

I uncheck songs for lots of different reasons -- because I have the same song on both a regular and "Greatest Hits" album, because I've ripped the same CD or downloaded the same Grateful Dead concert at different bit rates, or to keep audio book and other long files out of certain playlists. (Yes, you can also set the "Skip when shuffling" setting for a song, and add extra conditions to Smart Playlists based on Length and Kind, but the checkbox is a convenient shortcut that works in all situations.)

However, I do frequently want to burn discs and include all the unchecked songs. Maybe I'm making a backup copy of a CD ripped at multiple quality settings; maybe I'm about to get rid of a bunch of 2-star songs, but want a backup of those songs in case I change my mind someday.

iTunes makes this process kind of roundabout. Skip to the next section if you don't care about unchecked songs. Otherwise, please bear with me!

What we'll do is use a standard playlist to hold a list of the unchecked songs. We'll turn on the checkboxes for all songs in this playlist, burn the disc(s), then uncheck them again.

Make a new Smart Playlist titled "Backup - Monthly - Checked". Give it one condition, "Playlist is Backup - Monthly" (or whatever name you gave to the Smart Playlist you're using to do backups). Don't check the Limit box, check the "Match only checked songs" and "Live updating" boxes. Now we have a playlist containing only the checked songs from our backup list. We'll use this playlist for no other purpose than to figure out what songs in the backup list are unchecked.

Make a new Smart Playlist titled "Backup - Monthly - Unchecked". Give this playlist two conditions, "Playlist is Backup - Monthly" and "Playlist is not Backup - Monthly - Checked" (or whatever names you used for the previous two playlists. Now you've got a list of all the songs whose checkboxes you must flip while making the backup.

Now make yet another playlist, a standard one this time, titled "Backup - Uncheck afterwards". When you're ready to do a backup, drag and drop the Smart Playlist "Backup - Monthly - Unchecked" onto it, so that it lists the same songs as that Smart Playlist. Select all the songs in this playlist, right-click over one of them, and choose "Check Selection" from the pop-up menu. The songs disappear from the "Backup - Monthly - Unchecked" playlist, but remain here so you can uncheck them later. Most importantly, they will now be included in your backup.

All these playlists, just for backups, can clutter up your Source list in iTunes. Here's where folders come in handy. Make a new folder by selecting the Library icon in the Source list and choosing File > New Folder. Call it, oh I dunno, Backups. Drag and drop each of the backup-related playlists in there. Now you can get at them all at once, and hide them in between backups.

Feel the Burn

OK, at this point, you're ready to actually do a backup. To include your whole library, edit the conditions in the "Backup - Monthly" Smart Playlist so that the start date is in the distant past, before you started with iTunes. Otherwise, take a look in your "Recently Added" Smart Playlist to see when you added your last big batch of songs.

• You've got the "Backup - Monthly" playlist sorted by the correct column to give the desired CD layout, right?
• You've renamed that playlist temporarily to include the date or some detail to help you remember why you're backing up this particular batch of songs, right?
• If any of the songs in the playlist are unchecked, you've set up the supplemental playlists as described above, then checked all the necessary songs, right?
• Your disc format in Preferences > Advanced > Burning is set to Data CD or DVD, right?
• You've looked at the total size of the playlist (at the bottom of the iTunes window, when the playlist is selected) to see whether you need a CD, a DVD, or multiple discs, right?

OK, select the playlist to burn, click the Burn icon in the upper-right corner of the iTunes window, and click Burn again after inserting a CD or DVD.

If your backup fits on a single disc, skip ahead to the "Aftermath" section. Otherwise, keep reading to learn the finer points of multi-disc backups.

Multi-Disc Backups

If the playlist is too big to fit onto a single disc, iTunes prompts you when the first disc is finished, then automatically continues burning a second, third, etc. disc until the whole playlist is done.

As each disc is burned, the status area at the bottom of the iTunes window shows how much is left to go. If you've already burned one or more DVDs, but the remaining songs would fit on a CD, you can pop in a CD and iTunes will happily use it for those last few songs.

As each disc is burned, iTunes also shows (with icons and grayed-out song names) which songs go on the current disc. Make a note of the first and last songs, on this disc, so that if something goes wrong you'll know where to pick up.

What could go wrong? During multi-disc backups, I've had (a) iTunes crash after finishing each disc, (b) iTunes error out while burning, creating a useless "coaster", (c) no power failure yet but I'm sure that's coming.

If your backup gets interrupted like this:

• Edit the conditions for your backup Smart Playlist to turn off live updating.
• Delete from the playlist all the songs successfully burned to disc.
• Start burning again with a new disc.
• Afterwards, turn live updating back on for the Smart Playlist.

Sometimes, these crashes occur while I've left a disc burning overnight, and maybe the next day I can't afford to tie it up burning more discs, or maybe I'm out of discs and need to make a trip to the office supply store. So the process stretches out over 2-3 days or even more. In cases like this, edit the two between conditions in the Smart Playlist so that the end date is the day you started the backup. That way, any songs added in the interim won't sneak in or be skipped over by mistake. You're deliberately leaving them until the next backup.

The Aftermath

Once you've completed a backup, potentially with multiple disks and temporarily checked songs, just a little cleanup makes things simpler for next time:

• Set the beginning date of your "Date Added" and "Date Modified" conditions to the day you did (or started) the backup.
• If you turned off live updating due to a failure partway through the process, turn it back on now.
• If you temporarily checked some songs, go back to the "Backup - Uncheck afterward" playlist, select all the songs, right-click, and choose "Uncheck selection" from the pop-up menu. Then remove all the songs from that playlist.
• It's not a bad idea to select the backup playlist, choose File > Export Song List and store a copy of the backup playlist somewhere for posterity. You can consult the list someday if you're looking for a song and the backup discs aren't easily accessible.
• Rename the backup Smart Playlist to a generic name like "Backup - Monthly".

Happy iTuning!

Frequently Asked Questions

Seriously, why not just use dedicated backup software?

I don't have a whole lot of room left on my hard drive(s) even for music, so backing up to another drive isn't practical, I need to burn discs.

If I need to recover a song, it's easier for me to get it from a clearly labelled disc with a folder structure arranged by artist, rather than browse through some months-old representation of my entire directory structure within a backup program.

When I pop in a disc burned by iTunes, I can browse it within iTunes, drag-and-drop songs straight into the library, and recover their original ratings. Recovering a song via backup software means recovering the file back to its original location, then finding that location and importing back into iTunes.

I'm not expecting to recover my entire library this way, more likely audio books or podcasts that I trashed due to lack of space, low-rated songs that I changed my mind about, and so on.

Backup software isn't smart when files move around or change names. With iTunes, I might split a music library across drives, consolidate all songs on a new bigger drive, or change the file path by editing the song name, artist, or album. iTunes knows which of these operations requires backing up the song again better than Retrospect or what have you.

Related Reading

OneDigitalLife article about iTunes backups


Categories: itunes, ipod, music, mp3

I Might Lose on Jeopardy, Baby

A few weeks ago, Jeopardy held their online tryouts for the west coast. I didn't do nearly as well as the time I auditioned in person in Los Angeles. The categories were a little bit vague, the questions a little more America-centric than is good for me. In cases where I had to guess, later when I checked my guesses, they turned out to be mostly wrong. (During the in-person audition I did a year and a half ago, even my complete wild guesses were mostly spot on.) To even be considered for further consideration, I needed to get at least 35/50 right, and later in looking up answers I wasn't sure of, I found about a dozen that were definitely wrong.

Since this test was for the whole west coast, I was extra nervous. There must be thousands of Silicon Valley geeks who would know their art history, American history, etc. better than me, who would take the test only because it was online. If too many people qualified, they might not let everyone audition, even if they qualified based on their score. About 2 weeks ago, I decided enough time had gone by that I hadn't made the cut.

Until today, when I got invited to an audition in San Francisco in June. Excellent!

Last time, I did great in the written test, great in the practice game, but didn't think I was that great in the practice interviews. This time, forget about cramming with trivia, it's all about being smooth in the interview!

iTunes Cleanup: "Rolling Stones" vs. "The Rolling Stones"

As a database nerd, I'm bothered by inconsistencies in iTunes song data that seem easy to fix, but are too time-consuming for a large library.

I'm using a combination of Perl & Applescript to simplify the process of cleaning up information that is similar but not identical across different songs and artists. I wrap everything in Perl, and call Applescript only when necessary. That way, people on Windows (or even Linux) systems could use the code to identify problems, even if the fixes required editing the song info by hand. And on the Mac, the relevant songs can be automatically put into a playlist for later editing or fixing via other Applescripts.

For example, here's a little snippet that identifies all the artists who are represented as both "something" and "The something". Copy and paste it into the Terminal to run it.

grep "Artist" ~/Music/iTunes/"iTunes Music Library.xml" |
sort -u |
sed -e 's/>The />/' |
sort -d |
perl -e '

while($line = <>)
{
 chomp $line;
 if ($line =~ /Artist<\/key><string>(.*?)<\/string>/)
 {
    $artist = $1;

    if ($artist eq $last_artist)
    {
       print "Inconsistent THE: [$artist] and [The $artist]\n";
    }
    $last_artist = $artist;
 }
}
'

What this does is get an alphabetical list of all the artist names, with the initial "The" stripped off. If two consecutive names are identical, the full list of artist names included both the "The" and "no-The" forms.

Advantages:

• All the songs for an artist will be filed under a single folder, rather than separate folders for "Beatles" and "The Beatles" and so on. Makes it easier to copy or transfer the files via the command line.
• When going through the iPod "Artists" menu, you'll be able to get to all of the songs by that artist, instead of having separate entries with different groups of songs.
• Having consistent names makes it easier to check for duplicate songs and weed out other sorts of problems.

Watch this space for more developments on this front!

Tags: iTunes, iPod, MP3

Six Months in a Leaky Boat

I've joined the Berkeley Paddling and Rowing Club, as a nearby place for both fresh air and fitness. My particular build responds very well to rowing, rather than running or heavy weights.

I've got rowing in my blood from a great-uncle, Martin Boland, who was part of a record-setting crew in Newfoundland. Not only a record, but a record-setting record! The St. John's Regatta is the oldest continuously held sporting event in North America. The record stood for 80 years, which I believe (citation needed) is some kind of record for athletic records.

Oracle XE in the news

Good review here of the free Oracle "Express Edition" (XE) database. I'm waiting (i.e. pushing) for a Mac version, and would like to see it offered by hosting providers.

Oracle XE: It's Not Your Typical Oracle

Regarding the GUI options... I've tried a lot of them, from various sources, and have never been impressed. But SQL Developer (formerly "Project Raptor") is growing on me!

Life in the Green Lane - New York Times

Some Prius-bashing in the NY Times op-eds today. The idea of Prius mileage "plummeting" on the highway strongly disagrees with my experience.

In our first major trip in the Prius, from the Bay Area to Yosemite, we averaged 48.1 MPG in hours of highway driving to and from the Sierras. A Prius owner soon learns that although you can get great mileage downhill, going up and down the same inclined stretch of road burns more gas than an equivalent flat stretch.

On days when I commute (an hour plus each way, all on the highway), I've noticed that I can increase my average MPG by 1-3, after a few days of purely around-town driving. If I reset the mileage figures at the start, I typically see 52 MPG for the highway commute, vs. around 46 for local driving.

I've always heard that the city driving done by auto magazines is a little unrealistic, that they're babying the cars more than you could in real life. If so, perhaps the reviewers need to pay attention to the Prius's real-time MPG readout; ease up on the gas just a tiny bit at the right time, and you can maintain the same speed (or 1 MPH less) without the gas engine at all. Yes, even at high speeds on the highway.

I didn't notice any URLs of online resources to bolster the article's claim of bad highway mileage. Hope the author isn't just trying for controversy to boost the sales of his magazine...

Another problem with the article is the total straw man position regarding carpool lanes. Laws are being passed allowing carpool lane use based on a combination of mileage and/or emissions specs. See here for the California rules:

ELIGIBLE VEHICLES - SINGLE OCCUPANT CARPOOL LANE USE STICKERS

It's completely bogus for the writer to act as if anything labelled "Hybrid" is getting special treatment. Some non-hybrid cars qualify, and some hybrids don't.

Tags: Prius, hybrid

Cookin' in the Kitchen

My recipe site has been languishing along with the rest of my personal site. Makes sense to spiff it up first, as it's near and dear to my heart for several reasons. So here goes...

John's Vegetarian Recipes

Oh What a Lucky Man

This article takes me back... or maybe brings me full circle!

Mac Geekery - Pretty-Print Manual Pages as PS, PDF, or HTML

Back in university, learning UNIX was something you had to do on your own time. Here are some commands, they're documented online in "man pages", you figure out the rest and don't be late with your assignment.

After university, it was on to IBM's documentation group for programming languages. Naturally, there was a lot of emphasis on online information. Programming languages lend themselves to hyperlinking to look up language keywords and API names.

When AIX first came out, it had an online hypertext viewer (InfoExplorer) with a whole set of rewritten UNIX documentation. But customers didn't care much for an X11 application just to look up the syntax of ls. They wanted man pages, but didn't find any. I believe the customers finally got their way.

On every UNIX-oriented project I've worked on since then, customers have griped that there weren't any man pages, or they couldn't be viewed from the desired context, or they weren't good enough. (Typically ignoring the whiz-bang online documentation tools that came with the product or OS.) I've had this gripe myself in Oracle's SQL*Plus, where 'help xyz' brings up man-style text help, but it hasn't always been installed.

Now OS X comes along, with BSD UNIX under the hood, so once again my home computer work involves periodic use of the man command. And this article is the coup de grace -- a way to get the man output into the most elaborate viewers yet, Firefox and Acrobat Reader!

To be fair, a lot of man pages are full of obvious flaws. There are some options and restrictions that were unclear when I read a man page 20 years ago... and now on OS X I see exactly the same murky text. 'man tar' and many others don't show enough examples. 'man rsync' puts the options too late on the page.

Berkeley Critical Mass ride

Last night was the first time I saw the Critical Mass ride in Berkeley, rolling down Solano Avenue at 7:30.

That couch looked pretty comfy!