All posts by ajohnson

lucene search up and running

Inspired by Sam Ruby, I got Lucene to search this site.. My search sample size is pretty small, but 10 milliseconds for a search on any site is pretty fast. How?

First, download the Lucene binaries.

Second, throw lucene-1.2.jar & lucene-demos-1.2.jar into your classpath or into your $siteroot/WEB-INF/lib folder.

Run a quick index of the html files you want indexed:

# java -classpath #InsertPathToAboveMentionedJars org.apache.lucene.demo.IndexHTML -create #InsertPathToFilesYouWantIndexed

And then you can run a query using the sample jsp provided w/ the Lucene download by changing the path to the index you created. Pretty simple!

Maybe someday I’ll polish up the scripts and add it to Moveable Type’s External Resources page.

full text search w/ lucene

Last week at work was slow.. I installed Jabber, put the finishing touches on, and worked on the linux desktop I have all day on Friday because I had to FTP about 3GB’s of data via a VPN connection, which completely tied up my Windows desktop machine. So Friday I installed and began working with Lucene, an open source full text searching api written entirely in Java. By sheer coincidence, Lucene was written by the same guy who wrote the V-Twin search capability in the Mac, which I mentioned yesterday (and found out about by reading Interface Culture, weird!). By the end of this coming week I hope to have a functional search for this site using Lucene. But for now.. links:

Lucene Tutorial

Javaworld Article on using Lucene

Lucene FAQ Home Page

Lucene Mailing List Archive

Finding Out About: A Cognitive Perspective on Search Engine Technology and the WWW (With CD-ROM)

infinity imagined

Finished Interface Culture by Steven Johnson today (it’s 93 outside and humid, which means it’s reading weather). I’ll leave it up to the reviewers on Amazon’s site to give you more information about the book…

I like books.. fiction, non fiction, but books that make you think… think about things to create, think about things as you’ve never thought about them before. Interface Culture was one of those books. His central premise (I think!) is that interface design is an art form, just like a Dickens novel or a Renaissance painting and because it is an art form, it has social and cultural impacts, some of which we can see with the naked eye, some of which we can discover and some that can only be seen in hindsight.

A second theme I found was the idea that emergent technologies, things like personal agents and Apple’s V-Twin search technology, while brilliant, most often end up being applied in areas never imagined by their creators. For instance, Thomas Edison created the phonograph in 1877. But get this: he thought the phonograph would be used mainly for recording phone conversations. These applications were explained as exaptations, which is my official word of the day. 🙂

Finally, though not an official theme, I found numerous mentions of the idea that some, if not all, radical and sometimes breakthrough inventions are initially rejected by popular and mainstream culture. The Mac, with it’s icons and graphical user interface, was seen as simple and labeled as cartoonish… it was not seen as a “serious business application”. Soon, the icons, trash bin and menu system took over the entire business world and every computer we use today uses the same metaphors that the original Mac did in the early 1980’s. Just goes to show that maybe the heated debate about technologies like Flash as an interface device or wireless devices might be the tip of an amazing iceberg… who knows?


I installed Jabber on my Linux server @ work yesterday. Took about 15 minutes to setup the server side, ‘nuther 15 to get a Linux client up and running and 15 to get a Windows client running and connected. Amazingly easy to do and I think Jabber could be very useful in a small office/department environment, if not an entire enterprise. Interally we use IM and email almost exclusively to communicate, even though we don’t have any cubes and sometimes you’re sitting right next to the person you’re talking w/. Anyway, here’s a fun article on using Jabber and bots.

book crossing

A friend sent me a link to… interesting concept. From their email:

“The website encourages people to Read, Register, and then Release their books “into the wild” and then track where they go and the lives they touch. Great concept… share your books and follow their progress forever.”