New ‘yardstick’ for benchmarking quantum computers

New ‘yardstick’ for benchmarking quantum computers

Technology News |
Scientists at Sandia National Labs say they have invented a new way of benchmarking the performance of a quantum computer's power that is faster and more accurate than previous methods.
By Rich Pell


The researchers say they have the first tool to rank a prospective technology’s ability to run realistic tasks, revealing its true potential and limitations. The new kind of benchmark test predicts how likely it is that a quantum processor will run a specific program without errors.

The so-called “mirror-circuit method” is a computer routine that performs a set of calculations and then reverses it. It is said to be faster and more accurate than conventional tests, helping scientists develop the technologies that are most likely to lead to the world’s first practical quantum computer, which could greatly accelerate research for medicine, chemistry, physics, agriculture and national security.

Until now, scientists have been measuring performance on obstacle courses of random operations. But, according to the new research, conventional benchmark tests underestimate many quantum computing errors. This can lead to unrealistic expectations of how powerful or useful a quantum machine is. Mirror-circuits offer a more accurate testing method, say the researchers.

“It is standard practice in the quantum computing community to use only random, disordered programs to measure performance, and our results show that this is not a good thing to do,” says computer scientist Timothy Proctor, a member of Sandia’s Quantum Performance Laboratory who participated in the research.

The new testing method also saves time, which will help researchers evaluate increasingly sophisticated machines. Most benchmark tests check for errors by running the same set of instructions on a quantum machine and a conventional computer. If there are no errors, the results should match.

However, because quantum computers perform certain calculations much faster than conventional computers, researchers can spend a long time waiting for the regular computers to finish. With a mirror circuit, however, the output should always be the same as the input or some intentional modification. So instead of waiting, scientists can immediately check the quantum computer’s result.

The researchers found that randomized tests miss or underestimate the compound effects of errors. When an error is compounded it grows worse as the program runs. By mimicking functional programs, the researchers found final results often had larger discrepancies than randomized tests showed.

“Our benchmarking experiments revealed that the performance of current quantum computers is much more variable on structured programs” than was previously known, Proctor says.

The mirror-circuit method also gives scientists greater insight into how to improve current quantum computers, say the researchers.

“By applying our method to current quantum computers, we were able to learn a lot about the errors that these particular devices suffer – because different types of errors affect different programs a different amount,” says Proctor. “This is the first time these effects have been observed in many-qubit processors. Our method is the first tool for probing these error effects at scale.”

For more, see “Measuring the capabilities of quantum computers.”

Sandia National Labs

Related articles:
IBM on ‘quantum supremacy’
NSF launches project to create first practical quantum computer
Google processor achieves quantum supremacy
IBM achieves quantum computing milestone, establishes roadmap


Linked Articles