Facebook’s Open Compute Project helps competitors build hyperscale data centers together

Facebook’s Open Compute Project helps competitors build hyperscale data centers together

Facebook’s open source hardware development and procurement strategy grows with new competitors and new industries.

The conversion from free to paid registration and a spike in Open Compute Project Summit keynote attendance signaled that open hardware innovation is trending up. Summit attendees are companies like Facebook that buy land, build big data center buildings and fill them with commodity computing and networking hardware. Their mission is to build hyperscale, hyperefficient infrastructure that is flexible in handling workloads and agile in delivering new services in minutes.

Jason Taylor, OCP CEO, introduced Google’s Vice President of Infrastructure Urz Hölz as a surprise last OCP Summit keynote with Apple-like “wait there’s still more” showmanship. Hölz presented his team's open source hardware submissions, a new approach to powering the ocean of servers used in hyperscale web company data centers operated by Facebook and Google at a more power efficient 45V instead of 12V and a new rack design.

Hölz’s appearance represented old-fashioned Silicon Valley coopetition. Silicon Valley competitors have a long history of coopetition like this. Google and Facebook compete vehemently for mobile advertising revenues on the frontend but cooperate on the backend to improve data center efficiency.

Even bigger than Hölz and Google joining the OCP founded by Facebook, is the coopetition between competitors representing the financial services and telecom industries. Financial services were the first industry after the hyperscale web companies to identify infrastructure operations as a critical core competency. Goldman Sachs, Fidelity and Bank of America that compete on the front end for investors, depositors and loans collaborate through the OCP to build more efficient backend data centers.

Recent new additions to the OCP roster, monolithic telecom competitors, AT&T, Deutsche Telekom parent of T-Mobile and Verizon joined with the intention to collaborate with each other even though they are direct competitors. Network virtualization, automation, and cloud computing on the network edge are perquisites for the applications that will drive the next generation of 5G wireless. The telecoms don’t believe they can buy it from their traditional vendors or build it themselves without the cooperation of their competitors.

“Without the OCP umbrella it would be nearly impossible for competitors to hammer out legal agreements for individual collaborations,” said Taylor who is also Facebook’s vice president of infrastructure. OCP produces less friction and more speed and agility for open innovation between competitors within an industry.

Open source and open innovation has changed everything including hardware. The OCP is the manifestation of these trends in hardware. The OCP Summit is a traditional hardware conference where the conversation focuses on greater capacity, faster speeds, greener energy consumption and lower cost. But it’s also very different; instead of the manufacturers setting the pace of innovation, the OCP customers establish the metrics of innovation based on their own projected needs for increases in speeds and capacities and reductions in energy and cost.

The scale that these data centers operate at is so large that the consumer and many enterprise IT professionals can’t relate. For instance, Facebook is deploying 100GB optical Ethernet in some data centers later this year and will convert all its data centers to 100GB in 2017 while it investigates how to build the next bump to 400GB within the OCP. And, Intel and Facebook codeveloped a next-generation data center storage architecture that pools 120 Terabytes of high-speed NVM Express solid-state drives into a single 2U (19" x 3.5" x 24") enclosure.

The influence of open source software on the OCP hardware can’t be overstated. It extends beyond and below the LAMP (Linux, Apache, MySQL and PHP) stack that software developers use. A good example is an open source project that layers RocksDB write optimized database project on top of MYSQL data stores so that Replication and other familiar tools can be used.

+ BACKGROUND: Microsoft cloud server designs for Facebook's Open Compute Project +

Another is a set of open source libraries that Intel produced for programming Arria 10 GX FPGA. The FPGAs accelerate functions like encryption and compression can be added to data center motherboards. Running this code on FPGA hardware increases its performance. FPGAs can be reprogrammed as algorithms improve allowing critical hardware functions to evolve with the underlying open source projects specific to hyperscale applications.

OCP’s progress in data centers became clear in light of the statements of the new members from the telecom industry, just getting started with open hardware innovation who want the same results for implementing the next generation of 5G wireless.

Verizon Senior Vice President Mahmoud El-Assir Verizon said that networking up to now has been about speed and running different protocols for data, voice and video. Today’s networks are created with one box that contains software, hardware and networking. To change the network you need to change the box. Disaggreating the building blocks into hardware, software and networks into a virtualized cloud computing network will change how networks are built and provisioned. It will let telecom operators script the network to create virtual customer premise equipment (CPE) using automation capabilities that do not exist in today’s networks. With 5G and virtualization, networks will become flexible and agile in running application like Facebook’s and Google’s data centers.

Even though El-Assir says that 5G will be 50X the speed of 4G with single digit latency the G doesn’t stand for Gigabits and 5G networks will be much more valuable with cloud computing at the edge of the networks. Representatives from AT&T, Deutsche Telekom and South Korea’s SK Telecom all shared similar perspectives on 5G.

SK Telecom’s Vice Presient of R&D Kangwon Lee also sees open hardware innovation as a critical technical and operational component in the transition to 5G because a lot of different types of traffic will connect through the network such as the IoT, connected cars and virtual and augmented reality. Without open hardware innovation and virtualization it will be very difficult to setup networks that have very different quality of service (QoS) requirements without a virtual white-box approach. SK Telecom’s telco-engineering model of network deployment is very physically intensive. To scale the 5G network Lee said it will take a software engineering approach.

Join the CIO Australia group on LinkedIn. The group is open to CIOs, IT Directors, COOs, CTOs and senior IT managers.

Join the newsletter!


Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags GoogleFacebook

More about ApacheAppleBank of AmericaDeutsche TelekomFacebookGoldmanGoogleIntelLinuxMicrosoftMySQLSKT-MobileVerizon

Show Comments