Tuesday, June 23, 2020

Friston and The Knowledge

It's 2020 for goodness' sake.  Those of you who read The Book of Dave remember Dave acquiring The Knowledge.
Friston first became a heroic figure in academia for devising many of the most important tools that have made human brains legible to science. In 1990 he invented statistical parametric mapping, a computational technique that helps—as one neuroscientist put it—“squash and squish” brain images into a consistent shape so that researchers can do apples-to-apples comparisons of activity within different crania. Out of statistical parametric mapping came a corollary called voxel-­based morphometry, an imaging technique that was used in one famous study to show that the rear side of the hippocampus of London taxi drivers grew as they learned “the knowledge.”
from a Wired article on Friston and the free energy principle.

 --Steve

Friday, January 2, 2015

The Capital-O of Stacking Blocks

It's 2015 for goodness sake.  Here's a new-to-me approach to an eerily familiar problem: how far over the edge of a table can a stack of identical frictionless blocks hang, as a function of the number of blocks?  The historic hegemony of harmonic hang-over makes way for a New Order-of.  https://math.dartmouth.edu/~pw/papers/maxover.pdf

Friday, October 4, 2013

Cybraphon: A 21st Century Player Piano

From language evolution pioneer Simon Kirby comes Cybraphon: The Autonomous and Emotional Robot Band. (More video on youtube). The New Haven he refers to is alas probably not ours. 

Tuesday, September 24, 2013

How I hacked the Brookstone Rover 2.0

In the spirit of our 26 October meeting on hacking, I wanted to share this hacking story with everyone.

I like writing APIs for inexpensive robot toys like the AR.Drone and the Neato XV-11.  In a recent undergraduate robotics class, a couple of students and I got found an open-source project for driving the Brookstone Rover from an Android device.  We bought a Rover 2.0, but we had no luck in getting this code to work with it.

Following the advice in Violent Python, I figured I'd try some wireless snooping to see what was in the messages being passed from the handheld device to the Rover.  I bought the recommended Hawking Technology Hi -Gain Wireless-150N USB Network Adapter, plugged it into my Ubuntu machine (actually, an iMac running Ubuntu under VMWare), and installed and ran scapy.  This showed some traffic, but it was difficult to work with.  Some googling revealed that Wireshark was the tool of choice for this sort of thing, so I installed it and set up a filter to look at messages to/from IP address 192.168.1.100 (the Rover's fixed network address.)   Looking at the items tagged "continuation or non-http traffic", I saw lots of traffic between this address and 192.168.1.X, where X was the ad-hoc address assigned to the handheld device by the rover -- 2, 3, 4, etc.) Most of these messages started with the string MO_O, as I expected from the code in RoverOpen.

Running the app a few times revealed a pattern where the handheld device would send the Rover a message starting with MO_O 0 ..., the Rover would reply with MO_O 1, the handheld would send back, MO_O 2 ..., and the Rover would reply with MO_O 3 ....  The 0 (first) message was always the same, but the 3 message ended in different bytes every time.  This looked like some kind of handshaking to me.  I knew that the Rover AC-13 (the predecessor of the 2.0) used an open password system (username = AC-13, password = AC-13), but this seemed like some kind of encryption.  Perhaps I needed a different strategy.

Looking at a teardown page for the Rover 2.0, I saw that it had a UART that might allow me to talk open a console to the Rover.  I bought a USB / UART adapter cable, soldered the wire ends to a three-pin female R/C connector, connected the Rover to my iMac, and turned on the Rover.  Sure enough, this revealed a new /dev/tty.* file.  I ran /usr/bin/screen on this file at the standard 115200 baud rate, and was able to see the Linux boot sequence for the Rover in my terminal window.  I was able to run a few Linux commands like ls and cd, but a quick glance around the file system failed to reveal any useful source code that would allow me to reverse-engineer the encryption  /handshaking.  There was also an annoying output of a single digit to the console once every second, which interfered with my typing into the console.  Based on the fact that this number eventually dropped to 1 before the batteries ran out, it must have been a single-digit representation of the battery level that you can retrieve from the Rover wirelessly -- perhaps a debugging printout left in the firmware.

I figured that a look at some more up-to-date source code running on the handheld device might reveal what was going on.  So I downloaded the free Rover 2.0 app from Google Play onto my Android device.  Then I  downloaded the free ES File Exporer app, which allowed me to save the .apk file for the Rover 2.0 app.  Plugging my Android device into a Windows 7 machine revealed a volume in which I could find the .apk file (it might have worked on OS X or Ubuntu, but I found it most reliable on Windows.)

So now I had the .apk file.  I turned it into a .jar file using dex2jar and started looking for a good Java decompiler.  After trying several, I found that the free online trial version from SecureTeam gave me the most legible Java source code (fewest labels, goto's, etc.)  Sure enough, the sensibly-named WifiCar.java was using Blowfish encryption to respond to the "challenge" from the Rover.  Curiously, the BlowFish class was using a P-array of all zeros instead of the digits of Pi, which I guess is still good enough to foil random key hacking.

By looking back-and-forth between the decompiled Java source and the Wireshark messages, I was able to write a little Java class to do some basic things on the Rover -- spin the treads, raise/lower the camera, and turn the lights on and off.  To understand the media (video, audio) messages coming back from the Rover (which begin with MO_V), it helped to look also at the documentation for the Foscam web camera that provides the core functionality of the Rover.

As expected, the video was coming in the form of JPEG bytes, which I could save to disk and then open using any image-viewing program.  At this point I translated my little Java classes  into Python and decided to try my luck with the audio messages.  These proved a little trickier.  Audio turned out to be encoded using ADPCM, at a rate of 8192 Hz (a standard rate used as the default in e.g. Matlab), sent in chunks of 160 samples, with some ADPCM parameters tagged on at the end.  Saving the audio samples to a file and playing them back in Matlab revealed audible signals with a strong low-frequency noise component.

With the full functionality of the Rover 2.0 at my disposal in Python, I wrote a little program that uses PyGame to drive it around via a PS3 controller and OpenCV to display the images.  You can download the whole set of files from here.  Of course, the real excitement of a Python API is the potential for autonomous behavior via machine vision, speech recognition, etc.  So although this hack proved to be a lot more work than we'd originally thought, I'm hoping that it will open the Rover 2.0 as an inexpensive platform for exploring robotics.

Wednesday, April 18, 2012

Complexity in Cognitive Science: The Debate Rages On

Having just renewed my membership in the Cognitive Science Society, I received this year's back issues of their journals, and was delighted to see that the Topics issue in January contained a lively discussion on the value of complexity theory (chaos, fractals, 1/f noise, etc.). The anti-complexity (or rather, anti-buzzword) side was championed by Chris Eliasmith, who (as a licensed electrical engineer with a Ph.D. in philosophy) has been doing some extraordinary work on the hardest problems in the field.

Thursday, March 22, 2012

Pirahã Recursion rererereredux


The Academic Controversy That Just Won't Die returns to the front page of the New York Times.

Update: It also appeared as a cover story in the Chronicle Review a few weeks ago.

Friday, September 16, 2011

Leadbelly vs. Robots

I guess the John Henry meme was inevitable. Otherwise, having a robot run the Ironman Triathlon is a pure publicity stunt. And if there are ever dance contests for robots, this version would probably work better, too.

Wednesday, September 7, 2011

IS Group met in New Haven on Sep. 3, 2011

The IS Group met on Saturday, September 3, 2011, in New Haven. The readings including James Gleick, The Information; Leonard Mlodinow, The Drunkard's Walk; Nigel Stepp and Michael T. Turvey, On strong anticipation; and China Miéville, The City & The City. It was a good meeting with an excellent turnout, spirited discussion of the readings, and the addition of some new participants, followed by Hobo With a Shotgun for the hardcore among us (thanks to Simon D. Levy for the suggestion?!).

NEXT MEETING -- TOPIC: Fiction in mind
The readings for the next meeting (date to be determined), include:

Brian Boyd, On the origin of stories: Evolution, cognition, and fiction.
(Thanks to Christina Spiesel for the suggestion!)

Lisa Zunshine, Why we read fiction: Theory of mind and the novel.

Additional reading:

Suzanne Keen, Empathy and the Novel.
(Thanks to Simon D. Levy for the suggestion.)

Future readings may include:

Brian Greene, The hidden reality: Parallel universes and the deep laws of the cosmos.
(Thanks to Gary Kopf for the suggestion!)

Olaf Sporns, Networks of the brain.

Date and location:

To be determined (see below).

Please note that I am having shoulder surgery on Friday, September 9, and may be out of work from between 1 to 6 weeks.

Be sure to check the IS Group webpage for up-to-date news on the IS Group. Also, please contribute to the IS Group Blog if you run across items of interest to the group, including, stories, books, films, games, comics, articles, etc. Click here for information on the entire IS Group Social Media Empire. Thanks!

Philip

Sunday, August 14, 2011

Take your stinking clause off me ...

The inimitable Geoff Pullum has just posted this Language Log piece on language-evolution themes in the latest, and apparently quite good, installation in the endless Planet of the Apes franchise. (Monkeys may be the primates with tails, but the Planet of the Apes meme has the longest long-tail temporal distribution Hollywood could hope for.) Though the film may have some amazing special effects (and apparently includes scenes, like the one shown here, filmed in the aftermath of a Yankees / Red Sox game), nothing can ever top the breathtaking final scene and hammy macho posturing of the 1968 original.

Wednesday, August 3, 2011

Robots you can wear: Fashion cybernetics

Stephen Ebert posted an article on August 3, 2011 in HUMANS iNVENT that discusses the new age of cybernetic fashion. One example is the HAL-5 robot suit developed by Cyberdyne, a Tokyo-based company. Of particular interest is a discussion of how such suits could potentially be of assistance to the disabled and the elderly. Thanks to Howard Iger and Carol Pollard for letting us know about this.

Person Pinball, A Stop-Motion Pinball Game Using Pedestrians

Person Pinball - 2011 Animation Block Party 'Outro' video, posted by Mark Frauenfelder on boingboing, Aug 2, 2011. Video link via laughing squid. This short stop-motion animation by Aaron Hughes was the outro video for the 8th Annual Animation Block Party in New York City. Thanks and a hat tip to Robert Remez for sharing this with us.

Tuesday, August 2, 2011

Wall Art

A small selection of my photographs is on display, for the month of August, at Cafe George by Paula, 300 George Street, New Haven, during normal business hours (M-F, until 3 PM). This group of photos is part of the "Wall Art" book project that is still in development and focuses on photographs of painted buildings. The photo shown here is a detail of a piece called Demolition and Sport by Peter Busa (1914-1985). The piece was painted on the exterior of the old Minnesota Varnishes building on the east side of downtown Minneapolis in 1974 and updated in 1982. This is one of the first monumental outdoor murals in the state of Minnesota. The buildings on this location are currently part of the Valspar Coporation, the sixth largest painting and coatings company in the world. The photo was taken by Philip Rubin on October 19, 2005.

Thursday, July 28, 2011

Facial Recognition System Causes Problems for Mass. Drivers

Facial recognition systems are starting to appear everywhere. All of the tech giants are staking out turf, including Apple, Facebook, Google, and Microsoft (click on each for a different recent news item). ieee spectrum has a recent (July 25, 2011) story by Robert Charette, called "Here's Looking at You, and You, and You ..." about some of the problems resulting from one of the first examples of use of such systems on a large scale. The Massachusetts Registry of Motor Vehicles is one of approximately 35 states using automated anti-terrorism facial recognition systems. One of the big problems is the false positives, and the individual's "burden" to clear his or her name when mistakes are made. Read the story to learn more.

High-stakes forensic linguistics

The wonderful Language Log blog has had some excellent recent discussion of the use of forensic linguistic to determine authorship, stylistics, etc. The original entry, "High-stakes forensic linguistics," July 25, 2011, by Mark Liberman, framed the discussion around the legal battle over ownership of Facebook (also discussed by Ben Zimmer, NY Times Sunday Review, July 23, 2011, "Decoding Your E-Mail Personality"). As Mark pointed out, it was nice to see comments on the Language Log story by Ron Butters, Larry Solan, and Carole Chaski. A follow-up entry on July 27, 2011, "Authors vs. Speakers: A Tale of Two Subfields," provides some historical context related to forensic speaker identification.

Tuesday, July 26, 2011

Why brains get creeped out by androids

And speaking of the brain, WIRED SCIENCE has a small story by Mark Brown that reports on a study thats attempt to use functional magnetic resonance imaging (fMRI) to help understand the "uncanny valley" effect. This is a term coined by robotics professor Masahiro Mori related to reports that as androids become more human in appearance there is a purported drop in "likeability" on the part of human observers. The study, led by Ayse Pinar Saygin of the University of California, San Diego, was an attempt to explore the underlying brain bases of this phenomenon. Check out the WIRED SCIENCE article to learn more. As usual, results like these appear to be much too preliminary to be more than speculation or amusement for the tech media and those that follow them, such as the IS Group blog and me.

Kurzweil still doesn't understand the brain

PZ Myers, a biologist and associate professor at the University of Minnesota, Morris, writing in his blog Pharyngula (Aug. 21, 2010) criticizes Ray Kurzweil and other futurists for their speculations on our ability to understand how the brain works. Kurzweil had responded to an earlier blog entry by Myers (Aug. 17, 2010) called "Ray Kurzweil does not understand the brain." (Thanks to RSC for reminding of this debate, which is related to other IS Group blog entries on the singularity, neuroscience and related matters.)

Thursday, July 21, 2011

The Space Shuttle: the end of an era

After 30 years, the US Space Shuttle program has ended. Here are some articles on the program:

• CBS News: Never forget the miracle and promise of space
• Neil deGrasse Tyson reflects on the space shuttle program, 1981-2011
• The end of an era: what the space shuttle means to Engadget
• NASA STST-135 Launch and Landing
• LA Times video: Final landing of NASA's space shuttle program

Image above: With space shuttle Atlantis in the background, the STS-135 astronauts are welcomed home from the final space shuttle mission. They are, from left, Mission Specialists Rex Walheim and Sandy Magnus, Pilot Doug Hurley and Commander Chris Ferguson. Image credit: NASA.

Robot Babies: Cute or Creepy?

IEEE Spectrum online (July 20, 2011) has a slideshow called "Robot Babies: Cute or Creepy?" Check out the recent proliferation of robot children. Let us know which you like best. If you find any others, please add them to the list.

The image at the left shows Telenoid R1, created at Osaka University, a telepresence robot that reproduces the voice and movements of a remote operator. Spectrum says, "It looks like an overgrown fetus or Casper the Friendly Ghost, depending on whom you ask."

(Photo: Osaka University and ATR Intelligent Robotics and Communications Laboratories)

Wednesday, July 20, 2011

When Will We Be Transhuman?

DISCOVER has an article called "When Will We Be Transhuman? Seven Conditions for Attaining Transhumanism" by Kyle Munkittrick (July 12, 2011). He lists the conditions that he feels are necessary but not sufficient for transhumanism to have been attained. These include:
* The arrival of prosthetics and implants for organs and limbs that are as good as or better than the original.
* Better brains: cognition is improved significantly using cognitive enhancing drugs, genetic engineering, or neuro-implants / prosthetic cyberbrains.
* Artificial Intelligence (AI) and Augmented Reality (AR) are integrated into personal, everyday behaviors.
* The average life span exceeds 120 years.
* When global births stabilize at replacement rates, assisted reproductive technologies are the preferred method of conception, and responsible child rearing is more highly valued than biological parenthood, we will be procreating as transhumans.

Check out the rest of the list here and leave comments or your thoughts on this topic.

John Ohno's zzstructure emulator

John Ohno's zzstructure operating system (iX) was featured in the Hack A Day blog on July 12, 2011. John is a student member of Yale's Technology & Ethics group and is a friend. According to Hack A Day, a zzstructure is both a hypertext and operating system unlike anything we have today -- Ted Nelson has a version called ZigZag. John has posted a YouTube demo of his project and put all the code online.