Facebook buys startup building neural monitoring armband

Facebook is buying CTRL-labs, a NY-based startup building an armband that translates movement and the wearer’s neural impulses into digital input signals, a company spokesperson tells TechCrunch.

CTRL-labs raised million according to Crunchbase. The startup’s investors include GV, Lux Capital, Amazon’s Alexa Fund, Spark Capital and Founders Fund, Matrix Partners, Breyer Capital, among others. Facebook didn’t disclose how much they paid for the startup, but we’re digging around.

Update: Bloomberg pegs the deal between $500 million and $1 billion. A source close to the matter tells TechCrunch the same.

The acquisition, which has not yet closed, will bring the startup into the company’s Facebook Reality Labs division. CTRL-labs’ CEO and co-founder Thomas Reardon, a veteran technologist whose accolades include founding the team at Microsoft that built Internet Explorer, will be joining Facebook, while CTRL-labs’ employees will have the option to do the same, we are told.

Facebook has talked a lot about working on a non-invasive brain input device that can make things like text entry possible just by thinking. So far, most of the company’s progress on that project appears to be taking the form of university research that they’ve funded. With this acquisition, the company appears to be working more closely with technology that could one day be productized.

“We know there are more natural, intuitive ways to interact with devices and technology. And we want to build them,” Facebook AR/VR VP Andrew Bosworth wrote in a post announcing the deal. “It’s why we’ve agreed to acquire CTRL-labs. They will be joining our Facebook Reality Labs team where we hope to build this kind of technology, at scale, and get it into consumer products faster.”

CTRL-labs’ technology isn’t focused on text-entry as much as it is muscle movement, and hand movements specifically. The startup’s progress was most recently distilled in a developer kit that paired multiple types of sensors together to accurately determine the wearer’s hand position. The wrist-worn device offered developers an alternative to camera-based or glove-based hand-tracking solutions. The company has previously talked about AR and VR input as a clear use case for the kit. Facebook did not give details on what this acquisition means for developers currently using CTRL-labs’ kit.

This acquisition also brings to Facebook the armband patents of North (formerly Thalmic Labs). CTRL-labs purchased the patents related to the startup’s defunct Myo armband earlier this year for an undisclosed sum.

CTRL-labs’ acquisition brings more IP and talent under Facebook’s wings as competitors like Microsoft and Apple continue to build out augmented reality products. There is plenty of overlap between many of the technologies that Oculus is building for Facebook’s virtual reality products, like the Quest and Rift S, but CTRL-Labs’ tech can help the company build input devices that are less bulky, less conspicuous and more robust.

“There are some fundamental advantages that we have over really any camera-based technology — including Leap Motion or Kinect — because we’re directly on the body sensing the signal that’s going from the brain to the hand.” CTRL-labs’ head of R&D, Adam Berenzweig, told TechCrunch in an interview late last year. “There are no issues with occlusion or field-of-view problems — it doesn’t matter where your hands are, whether they’re in a glove or a spacesuit.”

Facebook is holding its Oculus Connect 6 developer conference later this week, where the company will be delivering updates on its AR/VR efforts.

Classic-Negative

Fujifilm’s upcoming X-Pro3 camera has a unique design sure to appeal to film photographers

Fujifilm is teasing its forthcoming X-Pro3, the successor to its popular digital rangefinder mirrorless camera, ahead of its official full introduction on October 23. During its X Summit event going on today, the company showed off the X-Pro3 in detailed images (via Fujirumors), revealing for the first time its innovative new rear-display design.

The X-Pro3 has an LCD on the back, as do most modern digital interchangeable-lens cameras, but it’s definitely unique: The screen is hidden in normal use, facing inward toward the camera back while the outward side of the rear door instead offers the photographer a small OLED “mini screen” that contains only basic info about shooting settings.

The rear display will show details like shutter speed, f-stop, ISO and film simulation and file size settings, and if you want to actually see a preview of the virtual viewfinder image, you’ll need to flip down the screen to reveal the color LCD. The downward flipping display is therefore ideal for doing things like shooting from a low angle, with the photographer looking down to check framing — just like you could do on classic film cameras with waist-level viewfinders.

The X-Pro3 still offers an electronic viewfinder, but that’s also more akin to film photography versus digital, since photographers using the camera will be much more likely to either use the viewfinder or shoot waist-level with the flip down screen — while also being able to check their various settings at a glance by quickly pulling the camera away from their eye and looking at the back.

Fujifilm’s lineup of APS-C digital interchangeable-lens cameras have already won many fans thanks to their film simulations, which mimic types of film the company offered previously. The X-Pro3 will focus even more on replicating a film-inspired experience backed by modern digital photographic technology, and will also include a new film simulation called “Classic Negative.”

Other details about the camera include titanium construction, which is going to make it a super durable but lightweight camera, and three different color options.

No pricing or availability info is out yet, but we’ll find that out, along with full details, on October 23.

Take cover, it’s a drone with a nail gun!

The FAA has warned against equipping your drone with weapons such as flamethrowers and handguns. But can a nail gun really be considered a weapon — that is, outside of Quake? Let’s hope not, because roboticists at the University of Michigan have made a roofing drone that uses that tool to autonomously nail shingles into place.

In a video shot in UM’s special drone testing habitat, the craft flies up, approaches its bit of roof, and gingerly applies the nail gun before backing off and doing it a couple more times.

It’s very much just a tech demonstration right now, with lots of room to improve. For one thing, the drone doesn’t use onboard cameras, but rather a system of static cameras and markers nearby that can tell exactly where the drone is and where it needs to go.

This is simpler to start with, but eventually such a drone should be able to use its own vision system to find the point where to touch down. Compared with a lot of the computer vision tasks being accomplished out there, finding the corner of a roof tile is pretty tame.

Currently the drone is also free flying and uses an electric nail gun; this limits its flight time to about 10 minutes and a few dozen nails. It would be better for it to use a tether carrying power and air cables, so it could stay aloft indefinitely and use a more powerful pneumatic nail gun.

Drones are already used for lots of industrial applications, from inspecting buildings to planting trees, and this experiment shows one more area where they could be put to work. Roofing can be both dull and dangerous, and rote work like attaching shingles may as well be done by a drone overseen by an expert as by that experts’ own hands.

The drone is the subject of a paper (“Nailed it: Autonomous Roofing with a Nailgun-Equipped Octocopter”) by UM’s Matthew Romano and others, submitted for the International Conference on Robotics and Automation later this year.

Ricoh-Theta-Z1-7

Ricoh’s Theta Z1 is the first truly premium consumer 360 camera

Ricoh has a well-earned good reputation when it comes to building smart, technically excellent photographic equipment — including the almost legendary Ricoh GR series of pocketable APS-C cameras, which are a favorite among street photographers everywhere. Earlier this year, the company released the Ricoh Theta Z1, which builds on its success with its pioneering Theta line of 360-degree cameras and delivers a step-up in terms of image quality and build that will feel at home in the hands of enthusiasts and pro photographers.

North now offers Focals smart glasses fittings and purchases via app

North’s Focals smart glasses are the first in the category to even approach mainstream appeal, but to date, the only way to get a pair has been to go into a physical North showroom and get a custom fitting, then return once they’re ready for a pickup and final adjustment. Now, North has released its Showroom app, which makes Focals available across the U.S. and Canada without an in-person appointment.

This approach reduces considerable friction, and it’s able to do so thanks to technology available on board the iPhone X or later — essentially the same tech that makes Face ID possible. People can go through the sizing and fitting process using these later model iPhones (and you can borrow a friend’s if you’re on Android or an older iOS device) and then North takes those measurements and can produce either prescription or non-prescription Focals, shipped directly to your door after a few weeks.

The Showroom app also includes an AR-powered virtual try-on feature for making sure you like the look of the frames, and for picking out your favorite color. Once the Focals show up at your door, the final fitting process is also something you can do at home, guided by the app’s directions for getting the fit just right.

Should you still want to hit an actual physical showroom, North’s still going to be operating its Brooklyn and Toronto storefronts, and will be operating pop-ups across North America as well.

Focals began shipping earlier this year, bringing practical smart notification, guidance and other software experiences to your field of view via a tiny projector and in-lens transparent display. North, which previously existed as Thalmic Labs and created the Myo gesture control armband, recognized that they were building control devices optimized for exactly this kind of application, but also found that no one was yet getting wearable tech like smart glasses right. Last year, Thalmic Labs pivoted to become North and focus on Focals as a result.

Since launching its smart glasses to consumers, it’s been iterating the software to consistently add new features, and making them more accessible to customers. An early price drop significantly lessened sticker shock, and now removing the requirement to actually visit a location in person to both order and collect the glasses should help expand their customer base further still.