Meta Open Source: 2022 Year In Review

This past year was one of renewed human connection and community for many people around the world. This theme carried over to open source work at Meta, as contributors, users and organizations congregated to further the impact of open source.

Introducing Reels Metrics To The Video Insights API

Following the announcement of Reels API for Facebook, today we are introducing Reels metrics to the Video Insights API. We have heard feedback from our developer community about the value of including Reels metrics in the API experience. We are excited...

Open-sourcing Anonymous Credential Service

Meta has open-sourced Anonymous Credential Service (ACS), a highly available multitenant service that allows clients to authenticate in a de-identified manner. ACS enhances privacy and security while also being compute-conscious. By open-sourcing and fostering a community for ACS, we believe we can accelerate the pace of innovation in de-identified authentication. Data minimization — collecting the [...]
The post Open-sourcing Anonymous Credential Service appeared first on Engineering at Meta.

Creating Apps With App Use Cases

With the goal of making Meta’s app creation process easier for developers to create and customize their apps, we are announcing the rollout of an updated process using App Use Cases instead of the former product-focused process

Enabling Static Analysis Of SQL Queries At Meta

UPM is our internal standalone library to perform static analysis of SQL code and enhance SQL authoring.  UPM takes SQL code as input and represents it as a data structure called a semantic tree. Infrastructure teams at Meta leverage UPM to build SQL linters, catch user mistakes in SQL code, and perform data lineage analysis [...]
The post Enabling static analysis of SQL queries at Meta appeared first on Engineering at Meta.

What To Know About Presto SQL Query Engine And PrestoCon

In this blog post, we explain Presto. Presto is a disaggregated SQL query engine originally designed to replace Apache Hive and achieve scalable interactive queries across massive data sets from different sources. If you're interested in learning about...

Retrofitting Null-safety Onto Java At Meta

We developed a new static analysis tool called Nullsafe that is used at Meta to detect NullPointerException (NPE) errors in Java code. Interoperability with legacy code and gradual deployment model were key to Nullsafe’s wide adoption and allowed us to recover some null-safety properties in the context of an otherwise null-unsafe language in a multimillion-line [...]
The post Retrofitting null-safety onto Java at Meta appeared first on Engineering at Meta.

PTP: Timing Accuracy And Precision For The Future Of Computing

Meta is deploying a timing protocol, Precision Time Protocol (PTP), that will offer new levels of accuracy and precision to our networks and data centers. We believe PTP will become the global standard for keeping time in computer networks. PTP will benefit today’s products and services and will be a foundational technology behind the development [...]
The post PTP: Timing accuracy and precision for the future of computing appeared first on Engineering at Meta.

How Precision Time Protocol Is Being Deployed At Meta

Implementing Precision Time Protocol (PTP) at Meta allows us to synchronize the systems that drive our products and services down to nanosecond precision. PTP’s predecessor, Network Time Protocol (NTP), provided us with millisecond precision, but as we scale to more advanced systems on our way to building the next computing platform, the metaverse and AI, [...]
The post How Precision Time Protocol is being deployed at Meta appeared first on Engineering at Meta.

Move Faster, Wait Less: Improving Code Review Time At Meta

Code reviews are one of the most important parts of the software development process At Meta we’ve recognized the need to make code reviews as fast as possible without sacrificing quality We’re sharing several tools and steps we’ve taken at Meta to reduce the time waiting for code reviews When done well, code reviews can [...]
The post Move faster, wait less: Improving code review time at Meta appeared first on Engineering at Meta.

Sapling: Source Control That’s User-friendly And Scalable

Sapling is a new Git-compatible source control client. Sapling emphasizes usability while also scaling to the largest repositories in the world. ReviewStack is a demonstration code review UI for GitHub pull requests that integrates with Sapling to make reviewing stacks of commits easy. You can get started using Sapling today.  Source control is one of [...]
The post Sapling: Source control that’s user-friendly and scalable appeared first on Engineering at Meta.

Tulip: Schematizing Meta’s Data Platform

We’re sharing Tulip, a binary serialization protocol supporting schema evolution.  Tulip assists with data schematization by addressing protocol reliability and other issues simultaneously.  It replaces multiple legacy formats used in Meta’s data platform and has achieved significant performance and efficiency gains. There are numerous heterogeneous services, such as warehouse data storage and various real-time systems, [...]
The post Tulip: Schematizing Meta’s data platform appeared first on Engineering at Meta.

Reducing Instagram’s Basic Video Compute Time By 94 Percent

In our constant quest to prioritize efficiency, Instagram’s engineers have developed a way to process new videos that reduces the cost to produce basic video encodings by 94 percent. With this method in place, Meta’s video infrastructure can continue to scale without needing to add more machines. This frees up resources so more people can [...]
The post Reducing Instagram’s basic video compute time by 94 percent appeared first on Engineering at Meta.