Friday, August 23, 2019

Hyperledger's Brian Behlendorf on starting Apache, foundations, and blockchain

Brian Behlendorf has a long history in open source going back to his co-founding of Apache. Today, he's the executive director of the Hyperledger Foundation. In this podcast, Brian takes us through some of his motivations in the early days of Apache, the tension between pragmatism and idealism in free and open source software, and why he's excited about distributed ledgers.

[Photo: Used with permission of the Linux Foundation.]

Show notes:


Podcast:


Transcript:


Gordon Haff:   I'm particularly excited to have with me today Brian Behlendorf, who is the executive director of the Hyperledger Foundation, but also has a rather illustrious history in open source.
Many people in this call probably know who you are, Brian, but could you give us the Reader's Digest version, assuming talking Reader's Digest isn’t a complete anachronism at this point.
Brian Behlendorf:  [laughs] I'm old enough to get the reference, but I'm sure many people won't,  so Brian Behlendorf, as you mentioned, Executive Director of Hyperledger which is actually part of the Linux Foundation.
The Linux Foundation has its own illustrious history of...I've only joined it about three years ago to do this project, but obviously it's been around since 2000 trying to serve the needs of the Linux ecosystem, both the developers and the companies around it.
Then starting about six, seven years ago expanding into a whole bunch of related technology domains, cloud computing, software‑defined networking and with Hyperledger blockchain technology.
My background, I have done a bunch of different things, I'm perhaps most known for being one of the cofounders of the Apache Project, which became the Apache Software Foundation, then serving as its president for the first couple years.
That was always a night gig. It was never a paid gig. As it's true for almost everybody involved with Apache. It's an entirely volunteer gig.
My day job has varied from starting one of the first website design companies called Organic. Starting a company called CollabNet, which you could think of as maybe GitHub, but perhaps two or three generations too early. [laughs]
We did kick out the Subversion project and get that started up and brought that over into Apache. I've also served as CTO for the World Economic Forum for a couple years. That was based in Geneva. That was a very fun and very different kind of organization.
I worked in the White House for about a year, and then the Department of Health and Human Services for a year. Mostly been either starting companies or working for open source foundations in one form or another. Usually volunteer.
The Linux Foundation is the first time I've actually worked for a paycheck for an open source organization, and it's really fun, so lots of different things.
I guess I put the first ad banner online and I've been apologizing ever since. Please don't hold it against me. I've had a lot of fun in my career.
Gordon:  Brian, I tend to let the topics in these podcasts wander where they want to go. I do try and stay somewhat centered in this new podcast as it intersects the innovation and open source. To what degree did inventing new and better things influence you early on with Apache versus user freedoms, having an alternative to big vendors, and that kind of thing?
Brian:  The Internet culture in the 1990s was definitely one of...First off, most people didn't know about it, didn't know what it was going to be. I think there's, among people who are online, a real conviction that this is bigger than AOL, this is bigger than CompuServe, this is bigger than telephones even. This is something that will be the substrate for a society in the long term.
There may have been different opinions on how quickly that would arrive, but probably not that much difference of opinion on if it would arrive. There's this real deep conviction that we're on to something and it was going to be big, but a lot of concern at the same time because the desktop computing world at that time was maybe 96 percent Microsoft Windows.
We might have had a more beneficent view of technology companies at that moment. We still thought of them as leading the fight for individual empowerment, the whole Apple "Think Different" campaign. We kind of saw tech companies as the good guys, so to speak.
I think there was still a concern that, as the web grew, it would lose its character and its soul as this kind of funky domain, very flat space, supportive of freedoms of speech, freedoms of thought, freedoms of association that were completely novel to us at the time, but now we take for granted or even we have found weaponized against us. [laughs]
What I think drove the founders of Apache early on was two things. One, a very pragmatic base, I was working at Wired magazine building this web company, Organic, and we simply needed a better web server, and iteratively improving upon the NCSA web server was just easier and certainly a lot cheaper than buying Netscape's commercial web server or thinking about IIS or any of the other commercial options at the time.
There is this pragmatic thing which was, this is just simpler. This feels easier. It's nice to have other people out there who can review my code and work together with, but none of us really wanted to be full‑time web server developers. That seemed boring in a way. We were having much more fun building cool websites.
The second was this idealistic notion that tapped into that zeitgeist in the '90s but it was a bit of, this is a printing press. We can help people publish their own blogs, help people publish their own websites and get as much content liberated as possible, and digitized as possible, by getting this out there.
That was kind of the web movement, but, in particular, we felt it would be important to make sure that the printing presses remained in the hands of the people. That everybody could use this stuff for free, and that it didn't become a single‑vendor web, the way that it felt like the desktop had kind of collapsed to a single vendor.
That dual mentality, the pragmatic and the idealistic, I think was a driver for Apache. I don't know that there was a same kind of driver for the Free Software Foundation. That was more Stallman's moral, the indignity of having his code proprietarized in the mid '80s and going, "Never again."
I'm certainly sympathetic to the moral worldview, that when you have software inside of every car, every doorknob, every thermostat, that pretty soon access to source code, and the ability to modify it, starts verge on a human right.
I totally get that worldview. I think there were more pragmatic and more operational kind of benefits that were key to Apache growing, and I'd say arguably the rest of the open source world. I carry that forward to today.
With Hyperledger, one thing that pulled me in and got me excited, was this notion that there are some really important problems we can solve with distributed systems, with distributed Ledgers, and smart contract techniques.
It wasn't programmable money, it wasn't regulatory arbitrage. It wasn't many of the things people associate with crypto currencies that was the driver here. It was the sense that the digitalization of society had led to a future that looked a lot more like big central systems.
Everyone loves to make fun of them but Uber and PayPal and that sort of thing ‑‑ not that they're the boogeyman, necessarily ‑‑ but like that architecture of all of us going through central services to connect with each other. It was a very un‑Internet kind of worldview, but it seemed to be the trend line we were on.
Blockchain technology seemed urgent to get involved in that lined up with these idealistic and pragmatic impulses that I've had, and I think other people in open source have had. That's kind of why I've dedicated the last three years of my life to it.
Gordon:  I will talk more about Blockchain in just a second, but right before that I'd like to talk a little bit about foundations. Foundations are a big thing these days in the open‑source world. Some will argue maybe they're too big a thing in the open source world.
What was your thinking with the Apache Software Foundation initially, in terms of what your priorities were, and how you've seen the foundation landscape evolve over the years?
Brian:  In 1998, Apache had been around for three years. In those three years, it had grown by ‑‑ Netcraft, the company that does this survey of the web once a month ‑‑ Netcraft's measure to be something like 70 percent market share.
Which seems weird to use air quotes around market share, because no one was paying any money for Apache, but in terms of installed base, that's 70 percent of the web is running on top of Apache HTTPD, which was pretty awesome.
It was still being built by a group of people whose only connection to each other was that they were all on an email mailing list. All had commit to a CVS repository. All had shell on a Unix box that I maintained off of Wired's Internet connection, [laughs] and otherwise had no formalism between us.
In a way that was liberating, in a way, we were like, "Yeah, you know, we don't need overhead, we don't need stuffy bureaucrats." We do want process, and we had developed kind of a sense of how to work together, because we want the efficiency that comes from not having to rehash the same arguments over and over.
Having lack of clarity about who does what. It was fundamentally about transparency and an open door to anybody to get involved in. I think there was a healthy degree of skepticism that a foundation, or any sort of corporate structure, would have the same advantage.
Certainly, we didn't want to incorporate as a for‑profit company, because then you get into thorny questions of, "How much do you pay people? How much equity share do they have?" all that kind of stuff when we all had our own agendas and startup businesses anyways. It was when we started seeing more and more people using it, asking harder and harder questions.
We'd always defer to other people to provide support. There were these thorny questions around, "What happens if somebody who owned a patent decided to file a patent lawsuit against the developers of Apache and wanted something as simple and modest as a dollar per copy?"
If they won, and given patent laws, they certainly could win, they'd seek those tens, or hundreds of millions of dollars from the Apache developers. For that crime of giving away free software, we could lose our homes. There was no corporate shield to protect the activities of the developers involved in Apache.
If somebody said, "I've got a patent claim against something, and you have to remove it." The laws are the laws. We might fight it if we felt it was a weak patent. If it wasn't a weak patent then what else can you do?
Without any sort of corporate shield around our activities, we all stood the risk of losing our homes or losing financial cushions or other things that just would have sucked.
That was one motivation creating it. The second was, the project had grown beyond being just about the web server. Pretty early on, there is a module to do Perl, a module to do Java, Tomcat which was a Jakarta kind of...We're coming in these where whole new Java code bases.
Coming from Sun and other participants asking to get involved in a way that causes us to ask, "What are we really doing that's scalable?" or, "Have we tapped into something here?" or, "Beyond the individual heroics of the people involved, is there something repeatable that's worth trying to take to more and more software projects?"
The answer was kind of yes. I didn't think we were too full of ourselves to say we had actually found something that was a happy medium between the idealism of the free software movement, and the pragmatism of getting code built and then embedded inside of large companies' projects.
In fact, we didn't even mind the idea of somebody like a Microsoft or an IBM or a Sun ingesting our code and putting it into their commercial products, as long as they didn't abuse our brand by calling it Apache plus plus or Apache prime or anything like that, as long as they didn't try to shuffle their support request queue just down upon us.
As long as they followed the license we were actually enthusiastic about the idea of those vendors coming in on the presumption that it would mean additional development resources, as well. That it would help the idealistic side.
If you could really get not just the rebels and the indie operators, but the actual establishment to use open‑source code then maybe you get faster to a world where everybody's got printing presses, everybody has that freedoms that we all consider essential.
When thinking about this, we realized that having some sort of corporate structure around us, that was nonprofit in nature… That was benign, beneficent, universally recognized as a way to be protective, rather than exploitative would be the right thing.
That's where started forming as a 501(c)(3) charity made sense, and forming it specifically as something that was very much a membership‑based organization. That's not the only way to do it. There are other approaches.
The Linux Foundation for one is more of an industrial consortium than a membership‑based charity. Mozilla also is a charity, the Mozilla Foundation, but it also does most of its operations through a for‑profit wholly‑owned subsidiary called the Mozilla Corporation.
There's all these different models out there. It's been great to see those grow. In general, if you're doing anything meaningful in open‑source software your activities should be parked somewhere where there is a protective structure around it that helps answer the questions and the needs of the broader‑user community.
I'm pretty happy with that approach, also happy at the same time to see quite a few foundations out there and new ones showing up overtime.
Gordon:  I do still want to get to blockchain and open source, but as a way of getting there as we fast‑forward today. The Hyperledger Foundation, you've mentioned it, I'm obviously very familiar with it just having been in Tokyo with you. Can you tell our listeners what it is and what its goals are? Because I think there is sometimes some confusion there.
Brian:  Three years ago, I jumped on this project. It had been announced actually about six months earlier, like December 2015. The first code drop was February 2016. I joined it in May of 2016.
Hyperledger was announced at a time when the Ethereum community was just getting launched as well, when Bitcoin was just before its big run‑up in price, when there was a lot of excitement in the blockchain and cryptocurrency space.
The emergence of a set of use cases beyond programmable money that can jump across borders easily. That really started to speak to some things that were much harder to otherwise do. I think the one that pulled me in was land titles and emerging markets.
Where a distributed database that was not just “Here is a master MySQL node and slaves that hang off of it,” was not just a multi multi-write kind of system, but one that actually supported consensus, one that actually had the network enforcing rules about valid transactions versus invalid transactions. One that was programmable, with smart contracts on top.
This started to make sense to me, and was something that was appealing to me in a way that financial instruments and proof-of-work was not. Hyperledger was announced by a set of large companies, along with the Linux Foundation to try to research this space further, and try to figure out the enterprise applications of these technologies.
What's possible and start, let's start coming up with code that would meet those needs. Let's think about, what are the different architectures required. It was bootstrapped with a couple of different pieces of code that came, one piece internally that had been developed by IBM and other that have been internally developed at Intel.
When I came in, I said, "We should try to decide do we want to be about a single architecture?" kind of in the way that the Linux kernel is about a single architecture. "Do we want to be about a basically a portfolio approach of different architectures, different approaches, to threading this needle, to solving these use cases, and let the market decide?"
Over time, if we have multiple winning solutions, we just kind of weaved them together in some The community came back and said, "We want the latter." From that point forward, the mission of Hyperledger has been, be a home for a portfolio of technologies of software that implements distributed ledger and smart contract functionality.
Kind of like Apache we have an open door to new projects coming in. Have a more of a thematic focus on this domain. Put more intentional effort into weaving these solutions together over the course of time. That's what Hyperledger is.
Sometimes it can seem confusing, because we have right now 14 different technology initiatives, some of them very mature, like Hyperledger Fabric. Some of them still emerging and starting to use in production environments like Sawtooth and Iroha and Indy and Burrow.
Some of them just very supportive as tooling, like Explorer and Composer, and some of them still very young. It's the portfolio overall that is the Hyperledger community that's the Hyperledger code‑base.
Actually innovative open‑source community has this spectrum of different technologies under their wing. It's, I think, ultimately, the right approach.
Our goal, long‑term, is if anyone is building distributed ledger systems, they're probably using one or more, or perhaps all [laughs] of the technologies coming up from Hyperledger.
Gordon:  I was at the event run by "The Economist" magazine a little while back. At that event's keynote, there was this distinction drawn by invention in the sense of new technology, na ew open‑source project, for example.
Innovation is something broader that can involve things like collaboration, new practices, new types of ecosystems, and so forth. My observation would be that blockchain, of course, does require technology but also requires a lot of that latter type of innovation.
Brian:  Open‑source software has shown that you can't really separate the code from the people behind it and you can't really separate the code from the zeitgeist of its movement. Today, whether we trust using Linux, Apache or any of these pieces, sometimes it just comes from pure market share. If everyone else is using it, then it can't suck too badly.
For that first wave of users and the early adopters to later adopters, knowing that there is individuals and organizations committed to a body of code is pretty important to deciding whether to use it or not. A software product isn't just some fixed point of flag‑in‑the‑ground that says, "Here's where we are. Get used to it." Software is more like a stream.
You might decide to use a version of software based not just on what it does today, but on its likelihood of meeting your needs in the future. You'd probably do.
When people look at using code, they want to see that there is this active community around it that is making regular software releases, that is pushing forward on something ambitious, but also answering the very pragmatic and prosaic needs of its end‑users, that has this this vector to it, that has this this momentum.
There are lots of companies out there that are today actually building their own products and services on top of Hyperledger Fabric and other pieces of Hyperledger. Showing people that there is this living, breathing core to these projects, this fountain of functionality and bug fixes, and how they can plug into that, is essential to getting that broader adoption.
We think it's equally important to be innovative in terms of new features as it is to actually be showing here's the community processes, and being an open‑source project actually lends to itself to better quality code and to real people's needs being met and the entire market place actually being effectively deserved.
Gordon:  Of course, if we talk about blockchains specifically, it is also interesting that these permissioned distributed ledger systems need these new ecosystems of companies cooperating and working together and giving up some level of ownership really, and there's lot of good lessons from open source generally in why you have to do that and how you can benefit from doing that.
Brian:  That's right. Certainly one of these blockchains that works, that people are setting up, for them to actually have any point to using blockchain technology wants them to be decentralized at some point. They want them to not just be based at a single vendor's cloud to maybe want to actually have nodes that are on different clouds.
Probably also nodes that are being run by different technology partners or even in some cases nodes being run by end‑user organizations themselves, because otherwise, why not just use a central database run by a single vendor or a single technology partner.
We've been trying to do a lot to work with the cloud community. Right now, there are pretty much every major cloud provider offers Fabric as a managed service which was a nice little milestone to hit this past year.
In doing that, it helped us establish Fabric as standard in the space, but it's also important that when you bootstrap a Fabric network that on day one, you're able to add nodes from other cloud providers or other places.
We are running a certification process for cloud providers this year that will help to guarantee to end users that degree of decentralization, that degree of flexibility around the deployment, because we think that's important to get out there.
Really, this is just the network services equivalent of the same degree of transposability and flexibility and anti‑vendor lock‑in that people expect when they use open source solutions, as well. It requires the same degree of thinking amongst the technology vendors of how do I reassure my customers that I'm not going to trap them in something vendor specific.
Yet, I will still be able to sell them some additional value that keeps them as a customer. Something that Red Hat has been extremely good at in the last 20 years. That Red Hat has been in existence at 25 years at this point and I think they are certainly a big part of what Red Hat will be bringing to IBM. It's something that every IT vendor, every enterprise software vendor, has to get really good at in this era.
Gordon:  One last topic I'd like to touch on. We look at blockchain generally, essentially everything is open source. We're seeing this in other places, too. Cloud Native Computing Foundation, also under the Linux Foundation, pretty much has all of the innovation happening in Cloud Native Computing, at least all the innovation outside of the big cloud providers, but then they're using the software internally.
What do you think the characteristics of these new ecosystems are, these new combinations of technologies, and projects, and companies, that are so defined by open source. There's not just an open‑source alternative to proprietary software, but really everything happening in those spaces being open source. Why has this happened?
Brian:  I first want us to be cognizant that it might feel like open source has won. [laughs] It might feel like Linux has won. That Apache has won. Linux is still not the dominant operative system out there.
It may be by device. If you count lots of IoT devices running embedded Linux, but the mobile phone market and the laptop computer market, and others that are still very rife with proprietary software, which is fine.
You might take the moral point of view like Stallman does, that it is a problem. Or you can take the pragmatic point of view, which says as long as we have critical mass, then an open‑source solution is likely to emerge and is likely to provide benefits.
It's been very reassuring to see that argument playing out, not just in operating systems and web servers and databases, but now playing out at the level of...or cloud containerizations, which is where Kubernetes and the Cloud Native Computer Foundation has really set its mark.
Increasingly in machine learning, in AI tools, increasingly in fields as conservative as automotive, or Telco, open‑source options have started to become at the very least industry competitive in the same way Linux is industry competitive.
In some cases just as dominant as say Kubernetes is now with cloud containers. That doesn't mean that Tesla is going to wake up one day and open source all of their automated driving software, or their end‑user interfaces. Nor do I think that's necessarily a goal for anyone, except Tesla car hackers, and the Tesla user community I think would love that.
If Tesla were to use more the Automotive Grade Linux as a project at the Linux Foundation for their software for underlying communications bus with third‑party part suppliers, more of the nav system and voice control stuff that AGL is emerging with, that would certainly complement what I'm sure is a ton of other open‑source software that Tesla is already using inside their vehicles.
Maybe make it cheaper for Tesla, maybe as a result, make it so Tesla cars are less expensive, and other electric vehicles are less expensive. At the end of the day I think this is about companies deciding there are things that are simply table stakes.
Things that we all need to do to be able to be in this industry together. It's much more efficient for us to work on those common bits of plumbing, so that we can spend more money, or balance more of our investment at the levels above that, and creating stuff that is truly feature full for end users and differentiated.
I think it's an entirely rationale, non‑idealistic business argument for why we're seeing more and more companies, even the ones we traditionally associated with very proprietary business models, be it Microsoft, be it Uber, be it Facebook, actually recognizing open‑source is strategically interesting to them.
That feels like this continuation of the same thinking on our minds 20 years ago at the Apache Software Foundation, that hey if we just involve some of these parties in our projects and kept to our core principles of how to build software, of how our licenses work, how our dev processes work publicly.
If we made them play by our rules, we may still end up in a much better place and move further faster. I think that's been the story the last 20 years.

Hugh Brock on Red Hat Research

Hugh Brock is Research Director at Red Hat. In this podcast, Hugh discusses how open source makes the way Red Hat approaches research different from the way it's done at other companies. He also talks about how the research program got started and, in particular, the role that Boston University has played.

Show notes:


Podcast:


Transcript:


-->
Gordon:  I thought I would get started off by talking about research programs in general at companies. There's a long history. Research labs, research organizations in corporations have often taken different forms. Sometimes there's a lot of fundamental research. Sometimes it's pre‑product development in a sense.
Can you take us through what some of the thinking was in Red Hat forming a research program and how you think about research, development, collaboration, intellectual property? That should take us a few minutes.
Hugh:  I think the way we're doing this at Red Hat is really exciting and also quite different from the way industry research has traditionally been done. The way companies...even the way companies have traditionally worked with universities. What we do at Red Hat Research is try to connect our engineers with researchers in universities via graduate student PhD projects.
The reason we work that way...well, there's two things, really. The reason we're able to work that way is because we're an open‑source company. The universities are happy to talk to us because they know that we're not interested in their intellectual property.
The reason it is an advantage for us to work that way is that it gives our engineers a chance to broaden their horizons, and it helps the universities focus what they're doing on something that is achievable in this now very fast moving world of IT and computer science research.
We think we have a winning model there. If you look at the way companies have traditionally done research, there's kind of two models. One model is you pay a researcher at a university to develop a project for you. I went to visit...Oh, I forget the guy's name. The research director at Mitsubishi Electric over here in Cambridge when I was first getting into this job.
One of the first things we learned in our conversation was that we have completely different jobs actually. Dick's whole enterprise is going to MIT and figuring out what he needs to pay them to do, which is a good model. It's good for MIT. It's good for Dick. He gets what he needs. All of that research then goes into a patent vault. Mitsubishi gets to use it but it doesn't get opened up until the patents expire.
Our model is completely different. What we're trying to do is, not pay researchers to do stuff that we want. It is to help them do what they want and get it into the open faster and more effectively than they could do it without our help.
So far, it's turned out to be a winning model. We hope that it will grow as we're able to contact more people and connect more people with our engineers.
Gordon:  One of the things that seems interesting in terms of academia, in industry, and open‑source, working together is...There are, of course, different objectives. There's also often different time scales in the way things happen.
In a way, I find academia interesting here because on the one hand, academia can often work in things that to someone sitting in a company, can look often very pie in the sky, very speculative. Maybe we will see something related to this in 15 years.
On the other hand, there's this incredible pace of change that you alluded to in IT and in tech where some project like Kubernetes goes from something internal at Google to something everybody is using in the course of just a few years. At least from teaching classes and so forth, things don't get revised that quickly at universities.
Obviously, there's also a tension of, you don't want universities chasing the toolkit of the day too quickly either.
Hugh:  Yeah. This is absolutely right. It's a real tension for universities. When we launched our relationship with Boston University, which would have been going on three years ago ‑‑ it'll be three years this December that we launched the Red Hat‑BU Collaboratory ‑‑ the case that my opposite number over at BU made to our VP of product, Paul Cormier was not only that Red Hat should do this because Red Hat will get interesting research out of it, but also that Red Hat should do this because we can help the universities do a better job of getting interesting research into the public.
My partner at BU, Dr. Orran Krieger, is a professor of computer engineering there. The case that he made to Paul was that industry is going so fast that academia needs to be pushed to keep up with them or academia will, in fact, become irrelevant. At least, in the computer science and computer engineering space. There's already a danger of that happening right now.
To some extent, there's a danger of it across the sciences with some of AI developments that we're seeing. The point is that we really are in a unique position at Red Hat to push research in a direction that's going to keep up with what we need in industry, and make a better, and closer partnership that works. That isn't parasitic or whatever, but actually serves the interest of both industry and university.
Gordon:  We'll get into some of that interesting AI work in a couple minutes. Before we dive down quite that deeply, let's talk about some of the threads that really came together in this whole program. Obviously, there's the universities, including universities in the Boston area.
Though, certainly not limited to that. The original Massachusetts Open Cloud work, which you just mentioned. Then, a lot of the interesting medical research that's happening in the Boston area. Probably many of my listeners know this, but Boston is known for having among the world class hospitals.
A lot of them are big research hospitals that are doing a lot of work. Can you talk about how all of this came together?
Hugh:  Yeah, it's actually a really interesting story. I mentioned the Red Hat Boston University Collaboratory. Red Hat Collaboratory at Boston University, I guess is the official name. This became the foundation of our research program at Red Hat. The way it came to being is a very interesting story.
Dr. Krieger over at BU wrote and received an NSF grant with his partner Peter Desnoyers about six years ago now, I want to say, five, six years. The grant was to study the feasibility of developing what's called an Open Cloud Exchange, which to put it very concisely is a bazaar to the public cloud's cathedral.
If Amazon is operating a single owner monolithic set of services that they control from top to bottom, the Open Cloud that Orran wanted to study is a marketplace where anybody can play. This is an interesting concept. There's a number of things that you need in order to make it real. The first thing you need is a data center.
It turns out that the five major research universities in the Boston area, Harvard, MIT, BU, Northeastern, and UMass system collaborated a few years ago on a data center called the Mass Green High Performance Computing Center MGHPCC, which is a very large data center in western Mass next to a hydro‑electric dam. Power's cheap.
They built this with the help of the commonwealth of Massachusetts so that they could move all of their research IT infrastructure out there.
With that done, it now is possible all of a sudden to start thinking about, OK, how can we build an Open Cloud that allows all five of these universities and the state and industries, small businesses, manufacturing to all participate in what amounts to a marketplace for computing services that looks like a cloud, but is ultimately much more efficient because there is no single owner.
It's more price efficient. This was the thing that Orran wanted to study. He got a grant. He got some computers, got a network infrastructure, set the thing the up, and set it up on the OpenStack while we Red Hat are a major OpenStack vendor. Orran kept pinging us saying, "Hey, do you guys want to help with this? This is really interesting."
He was trying to do some stuff with some of the OpenStack services that we at the time didn't think made sense. For a while, we put him off, like, "No, we're not really interested."
Eventually, he got through. The thing he was able to offer to Paul that no one else really had before was an opening for doing research in a practical way. Research that would draw our engineering team into partnership. That was a huge deal.
That was basis of this Red Hat BU Collaboratory, which is a million‑dollar a year partnership where we fund...Really, we fund basic research at BU, but we do it on a way that's connected to do what we want to do as an engineering company.
Fast forward a couple of years, we've established the Collaboratory. We're working with Orran at BU. Orran teaches what's called a Cloud Computing course. It's a project‑based course in Cloud Computing. This was the first year he had done it.
He brings in lots of industry partners as mentors to lead projects. We had a bunch of projects over there. One of the projects that we found in the Cloud Computing course was a little app that somebody at Boston's Children's Hospital had written to put a UI around medical image processing codes.
Codes that process MRI, for example, or any x‑rays or CT scans, or whatever, and do stuff with them. Not really AI, exactly, but advanced image processing. This project as it turns out was staffed by the wife of one our researchers at BU. Even funnier, the sponsoring researcher at BU turns out to be Orran's wife. He didn't know this at the time, which is hysterical.
We didn't realize that they were both working on opposite ends of the same project for a long time. They never talk apparently. Anyway, we got into this project and we realize that we could take this thing and put it to OpenShift fairly easily. That actually would be not only a great demo project for us, but a really nice contribution that would make back to this thing.
It is developed into a thing called the ChRIS project. That's how that got started. We're continuing to contribute to it, partly as because it's a great demo project for what you can do with OpenShift [Container Platform] on our tooling. Also, because we've been able to demonstrate some of the more advanced research results that we've found at BU.
Things like multi‑party computing, we have integrating that into ChRIS at that beginning part of this year. There are more things going to be coming there this year as well. That's been a really interesting story and it was a lot of fun.
Gordon:  The multi‑party computing and homomorphic encryption and differential privacy probably should be the topic for another podcast because they're really interesting. Essentially, ways that you can share data in a machine learning, AI context among institutions, and to have third‑party computing without compromising privacy.
That's actually a really interesting topic that...stay tuned, going to cover that in later episode in more detail. In addition to the MPC and chRIS, what are some other interesting projects that are going with research right now?
Hugh:  At BU in particular, we have two parallel tracks. One of them is the privacy‑preserving AI that you just mentioned. All the range of technologies around how to do machine learning in a privacy‑preserving way. The other kind of major research thrust that we have is all around how industry is going, and the world, is going to deal with the end of Dennard scaling.
Dennard scaling is the idea that you can continue to increase the number of transistors per square millimeter on a chip by doing various tricks to make that possible. It is a subject of a lot of debate exactly how long we will be able to continue to do Dennard scaling, but nobody is arguing that we'll be able to do it forever. It seems clear that we're approaching a point of diminishing returns.
What that means is that we are going to start looking again at specialty devices. Processors that are built for a particular purpose, the GPU is the most obvious example, but there are many of them. Many different types. The OS, which is our primary product here at Red Hat is going to have to start understanding how to deal with these things.
You can imagine a typical computer system in the cloud in three or four years is going to have not just a whole bunch of general purpose CPUs, but also GPUs, FPGAs which are programmable processors. You can program the architecture on the fly. Other devices we haven't even really thought of yet. All of these things are going to live together in the same machine.
We have a number of really interesting research projects going on right now that are all around the different aspects of that problem. Everything from can we build a Linux unikernel that really works to what do we need to do to create an open source tool chain for FPGAs. Any of a wide range of other projects along these lines. Partitioning hypervisors is another kind of key piece.
We've been very fortunate that BU turns out to have really strong Operating Systems department. We didn't know that when we made that partnership so that worked out quite well for us. We think we're going to do some groundbreaking stuff there. The unikernel project, in particular.
The idea of the unikernel is you take your app and you build it with the kernel it's going to run on so that you’ve basically built a bootable app. There's all kinds of interesting reasons why you might want to do that. It turns out that our kernel folks are really interested in this with the PhD who's working on it right now.
They're basically telling him, "If you can get this last stage of thing that you're working on right now to work, then we want to start looking at how we can actually use this in practice."
This is gone really quickly from pie‑in‑the‑sky idea Orran and Ali Raza who is the PhD, come in and say, "Hey, we want to look at unikernels and whether we can make a unikernel out of Linux and we think it's going to be really hard. We doubt it'll work," to in the space of not even, 18 months, Ali talking to our kernel engineers about the details of how we could make this real.
It is going very quickly. I think everybody's astonished that it's happened that quickly. It's an example of lots of different threads coming together at the same time. We've been really fortunate to be in the middle of it, but that's what we try to do at Red Hat Research. We weren't pulling these threads together, and then they would never intersect.
Gordon:  Probably topics for at least a couple more podcasts there. We have probably all the detail we can get into today. In closing out, where can people go to learn more about this? Many of these sounds interesting?
Hugh:  The best place to look for anything that we're doing is our website, which is research.redhat.com. We try to maintain there a list of all of the active projects and what the status is at all of the universities that we work with.
We also post there details of the events that we sponsor so colloquiums, workshops, things like that as well as the quarterly research review magazine that we produce to go into detail on these projects that we do.
DevConf is an annual conference that was launched in our Brno office in the Czech Republic. It's been running there now for, I think, 12 years. We did the first one here in the US last summer [2018] at the Boston University Student Center, the GSU, George Sherman Union.
We'll be doing it again August 15th‑17th this summer. It should be really good, I think. All of our interns will be presenting something there, particularly all of the PhD projects that I just mentioned. We think it's going to be a lot of fun.
Gordon:  Well, thank you, Hugh. Anything you'd like to close with?
Hugh:  I just want to thank you for reaching out and making this happen, Gordon. Thanks for listening everybody. If you're interested, again, in participating or just in knowing what's going on, check out research.redhat.com.