The Shure Stem Ecosystem helps to transform life stories into interactive biographies.
The Sydney Jewish Museum tagline, ‘Where history has a voice,’ encapsulates the Museum's origins and mission while also fitting perfectly with the newly installed feature exhibit Reverberations: A Future for Memory. The museum turned to Shure's(opens in new tab) Stem Ecosystem to bring historical perspectives to life through interactive displays.
The Museum was established three decades ago by Holocaust survivors who came to Australia. This new high-tech attraction shines a light on the humanity and life experiences of Holocaust survivors who, in recent years, have shared their stories in person with visitors. Created in collaboration with the USC Shoah-The Institute for Visual History and Education, the unique visitor experience uses the Shure Stem Ecosystem components to transform the life stories of Sydney-based Holocaust survivors into interactive, on-screen biographies capable of conversation with visitors.
“Our exhibition aims to provide an opportunity for future generations to have a conversation with a Holocaust survivor,” explained the Sydney Jewish Museum’s senior curator Shannon Biederman. “It’s really about keeping their memories alive for the time when, sadly, there will no longer be any living Holocaust survivors.”
USC Shoah Foundation, Steven Spielberg, and Shure
The broader project of collecting video testimonies from actual witnesses to the Holocaust owes much to Steven Spielberg. He was inspired to establish the USC Shoah Foundation after meeting survivors of the Holocaust who visited the set of his movie Schindler’s List in 1994. Since then, tens of thousands of their stories have been filmed and preserved for future generations in the Visual History Archive, the most extensive collection of genocide witness testimony in the world.
Building on this, the USC Shoah Foundation’s new initiative , Dimensions in Testimony was created to record and display testimony to enable dialogue between Holocaust survivors and visitors far into the future. With the aid of AI-based language processing computer systems and sophisticated beamforming microphones from Shure, visitors can ask a question to an on-screen, digital version of each survivor, and hear them respond in real time, as though it’s the real survivor sitting in front of you.
“We have a very close relationship with the USC Shoah Foundation,” explained Biederman. “We’ve had the Visual History Archive on site for about 15 years now, so we’ve been watching their Dimensions in Testimony project unfold over the years and we’ve always been keenly interested in joining it here.”
The opportunity arrived during the Covid pandemic when the recording of testimony in the United States had to be suspended. The complex recording system was brought to Australia and used to capture the intimate recollections of six Holocaust survivors from Sydney. Each survivor answered around 1000 questions about their experiences in the Holocaust, their lives, interests and hopes for the future, while being filmed within a specialized rig with 23 cameras. The many hours of footage from these interviews were then cataloged and processed, ready to be transformed into an interactive biography for the Reverberations exhibit.
With the editing of the video footage underway, the AV integrators Interactive Controls team came on board to install the technology for the Museum exhibit itself. The striking, minimalist design faces the visitor with a life-size image of a survivor waiting patiently on an 86-inch monitor screen, hung in portrait mode on the wall. There are no visible buttons or controls. All interaction with the AI controls is driven by voice, captured by a Shure Stem Ceiling microphone that hovers above.
The Shure Stem Ecosystem microphone connects across a digital network to a Stem Hub that interfaces via USB directly with the computer. The PC responds to visitor questions by instantly selecting the most appropriate answer from the hundreds of stored clips and sending the video to the monitor, and sound, via the Hub, to the Shure Stem Speaker mounted in the ceiling.
Shure Sparks Intelligent Conversation
From months spent training the voice recognition systems, Biederman understood only too well how crucial it was to accurately capture the visitor’s voice interactions—even on the sometimes noisy Museum floor. Having worked with the USC Shoah Foundation on the prototype technology, Shure US enrolled the assistance of Jands, as Shure’s distributor in Australia, to provide specialized advice and assistance in installing and programming the Shure components in the Sydney Jewish Museum system.
“The Stem Ceiling microphone requested by the USC Shoah Foundation was set up to operate in what’s called an ‘audio fencing’ mode,” Jands’ owner Christopher Ling explained. “Essentially audio fencing uses its built-in DSP and 100 separate microphone elements to create a conical pickup area directly under the microphone and reject audio from outside of that space.”
While initially devised for videoconferencing applications in meeting rooms, the unique intelligent beamforming capabilities of the microphone and the simple, elegant architecture of the entire Shure Stem Ecosystem work brilliantly to enable actual duplex conversation with the AI language processing system.
Biederman believes that the simplicity of voice interaction is an integral part of Reverberations. “What we find is that the technology quickly falls away for the visitor, creating a impactful and emotional experience,” she reflected. “Having Holocaust survivors tell this history makes it personal. It’s no longer dates, it’s not numbers. Having these stories with us into the future is really important in making history meaningful.”
Learn More: Shure and 1 beyond Camera tracking solution