Data representation is a core aspect of deep learning. While researchers have typically represented images or 3D shapes as multi-dimensional arrays, the use of implicit neural representations (INRs) has emerged as an attractive alternative. Recent work with INRs has shown that they can outperform established compression methods such as JPEG. …

Logic synthesis (LS) is an approach for finding equivalent representations of large-scale integrated circuits, generally via pre-mapping optimizations, technology mapping and post-mapping optimizations. LS is a sequential decision-making problem that can be formulated as a Markov decision process (MDP) and tackled by reinforcement learning (RL) algorithms. In the new paper…

Last June, the popular GitHub code repository and developer community platform released GitHub Copilot, a code auto-completion tool powered by OpenAI’s Codex model that FastAPI creator Sebastián Ramírez described as “seriously mind-blowing, difficult to overhype” and “the future of coding.” CoPilot and other neural code completion systems leverage language models…

The practicality of a single tool with multi-purpose capabilities is why the good old Swiss Army knife has remained popular for over a century. In the new paper A Generalist Agent, a DeepMind research team introduces an AI take on this concept, proposing Gato, a single general-purpose agent that can…

Although today’s large pretrained language models (LM) have demonstrated impressive zero-shot capabilities across a wide range of tasks, the performance of “frozen” LMs — whose weights remain unchanged — still trails that of LMs whose weights have been fine-tuned for specific downstream tasks. …

Quantum computing has become an increasingly attractive research field due to its huge potential for solving complex real-world problems in areas such as optimization, cryptography, chemistry, and the emerging field of quantum natural language processing (QNLP). …

Generalization is one of the primary goals in contemporary machine learning research and is regarded as a pathway to artificial general intelligence. Although today’s pretrained large language models (LMs) continue to push the state-of-the-art in natural language processing (NLP), most such models target specific problem classes and suffer significant performance…

Driven by the development of powerful machine learning models and the availability of large-scale web-mined datasets, the performance of academic and commercial machine translation (MT) systems has significantly improved in recent years. These systems however are generally restricted to fewer than 100 mainstream languages, a small fraction of the over…

While humans naturally combine various sensory inputs to form a more complete understanding of their environments, even today’s most powerful pretrained AI models can only handle one or two input modalities. In the push to endow their models with more humanlike intelligence, machine learning researchers are increasingly interested in the…