Skip to main content

A winning combination: Allen School recruits nine new faculty with expertise in computational neuroscience, machine learning, quantum computing, and more

Hand silhouetted against the sun, giving the "dubs up" symbol, with ring and middle finger crossed in between pinky and index finger to resemble the letter "W," against a purple background

When it comes to recruiting at the University of Washington, the latest promising commits to the Husky football team tend to grab most of the headlines. Here in the Allen School, we’re pursuing our own version of “Purple Reign” on a different playing field: the intense competition that is faculty recruiting in computer science and computer engineering. 

The results of the 2022 season are in, and the Allen School scored nine outstanding educators and researchers who are rising stars in their respective disciplines. The newcomers will strengthen the school’s historic leadership in core areas such as systems and architecture, programming languages, and computer science education while expanding our impact in rapidly growing areas such as computational neuroscience, machine learning, quantum computing, and more. 

Throw your dubs up for the newest additions to the Allen School and UW campus community:

Portrait of Gilbert Bernstein seated in a plush dark grey armchair against a light grey wall. He has reddish curly hair swept to one side and a beard, and he is wearing glasses and a blue plaid shirt over a light-colored t-shirt.

Gilbert Bernstein: High-performance domain-specific languages for simulation, optimization and design

Gilbert Bernstein bridges the fields of computer graphics and programming languages to develop domain specific languages (DSLs) that enable high-performance computing applications for physical simulation, optimization and design. His approach, which employs data abstraction for portability across architectures and decouples mechanism and policy in the scheduling of code and data structures, enhances system performance without the inherent tradeoffs of conventional techniques or the development and maintenance costs associated with customized software and hardware co-design. High-performance DSLs can be adapted to domains as varied as climate modeling, construction, drug development, fabrication, the visual arts and more — without requiring programmers to have deep domain expertise. Recent contributions include Aetherling, a DSL that enables hardware engineers to easily explore complicated space-time tradeoffs when developing hardware accelerators for system-on-a-chip designs, and an interactive sketch-based tool that assists quilters in creating designs compatible with foundation paper piecing to democratize fabric design and manufacturing. He previously contributed new approaches for working with 3D mesh data structures, editing vector graphics, and developing complex physical simulations.

Bernstein earned his master’s degree in 2012 from the Allen School before going on to complete his Ph.D. at Stanford University. He is currently pursuing postdoctoral research at the University of California, Berkeley and MIT and will officially join the Allen School faculty in January 2023.

Portrait of Andrea Coladangelo with short dark hair and trim facial hair and wearing glasses and a subtly striped blue button-down shirt. Leafy trees and hedges in front of a stone building with archways are visible in the background.

Andrea Coladangelo: Understanding quantum information through the computational lens

Andrea Coladangelo will join the Allen School faculty and the UW’s interdisciplinary QuantumX initiative in January. Coladangelo’s research focuses on the intersection of quantum computation, cryptography and complexity theory, with an emphasis on understanding the interplay between quantum information and ideas from computational hardness. In a recent example of this, he devised a new encryption scheme that protects against coercion in online elections in a way that is fundamentally impossible to do classically. In other work, Coladangelo showed how, in stark contrast with the classical setting, quantum communication allows one to realize the very general cryptographic functionality of secure multi-party computation from one-way functions — the latter being an object of essentially minimal cryptographic complexity. Going forward, Coladangelo is keen to explore the two-way interaction between quantum information and cryptography: On the one hand, how quantum information can be leveraged to achieve cryptographic functionalities that are beyond what is achievable classically, such as copy-protection of programs; on the other, how cryptographic hardness can be used to test and prove “quantumness,” as well as to understand the limits of quantum computation.

After earning his Ph.D. from Caltech, Coladangelo went on to pursue a postdoc at the University of California, Berkeley and the Simons Institute for the Theory of Computing. He is an editor of the open-access, peer-reviewed journal Quantum and a co-founder of qBraid, a cloud-based platform for experimenting with quantum programs.

Portrait of Elba Garza with long wavy hair, with the sides pulled back from her face and a dark yellow blouse with a contrasting multi-colored floral print. She is standing in front of a plain, neutral-toned wall.

Elba Garza: Accessible and engaging computer science education for a variety of learning styles

Elba Garza joined the faculty this fall as a teaching professor in the Allen School’s revamped introductory course sequence. As co-instructor of the course focused on students with little or no prior programming experience, Garza is particularly keen to ensure that the school delivers introductory computer science in a way that supports first-generation students and those from historically marginalized backgrounds as part of building a more diverse academic community. She is also interested in advancing methods for presenting course content in a cohesive manner while incorporating a variety of techniques for engaging students with diverse learning processes, inspired by her own experience as a student diagnosed with a type of Attention Deficit/Hyperactivity Disorder (ADHD). Garza’s background in computer architecture also prepares her to teach a variety of upper-division systems and architecture courses.

Garza earned her Ph.D. from Texas A&M University, where her research focused on the development of microarchitectural predictive structures and policies. Prior to her arrival in Seattle, Garza was a member of AccessComputing, a UW-based program that provides mentorship and learning opportunities for students with disabilities to pursue computing education and careers. She also co-founded and served on the steering committee of the Computer Architecture Student Association (CASA), a student-run organization with the goal of fostering well-being and inclusion within the computer architecture community.

Portrait of Matthew Golub with close-cropped hair, mustache and beard, wearing a dark blue button-up shirt. An interior building hallway is blurred but visible in the background.

Matthew Golub: Computational techniques for understanding and augmenting neural processes

Matthew Golub’s research focuses on computational neuroscience, with an emphasis on advancing the theory and tools needed for understanding computation and communication within large networks of neurons in the brain. Golub’s work has demystified how these networks of neurons coordinate to enable, and sometimes constrain, the brain’s ability to learn, generate decisions, and control movements. A core approach to his research is to view a network of neurons as a nonlinear dynamical system whose activity evolves over time due to how those neurons are connected and the inputs they receive from other networks in the brain. Golub’s contributions include FixedPointFinder, a software toolbox for revealing the computations performed by such nonlinear dynamical systems. This approach, which is broadly applicable to different organisms, regions of the brain, and tasks, can help researchers identify the most promising avenues for more costly and labor-intensive experimental validation. Golub also co-led a series of studies exploring the neural mechanisms that influence the learning and performance of new tasks, in the contexts of both naturalistic movements and brain-computer interface operation.

Golub will join the Allen School faculty this December after completing a postdoc at his alma mater Stanford University, where he earned his bachelor’s and master’s degrees. In between, he earned his Ph.D. in Electrical & Computer Engineering at Carnegie Mellon University.

Black and white portrait of Scott Sumio Ichikawa with short dark hair and wearing glasses, a pinstripe button-up shirt, and tie with wider diagonal stripes. He is pictured against a plain light-colored background.

Scott Sumio Ichikawa: Elevating design practices and education in service to society

Scott Sumio Ichikawa joined the faculty over the summer as a teaching professor and associate director of the UW’s Master’s in Human-Computer Interaction & Design (MHCI+D), which combines expertise from the Allen School, Information School, Department of Human-Centered Design & Engineering and the Division of Design in the School of Art + Art History + Design. Ichikawa’s devotion to advancing the ethical design of products and services for diverse users is matched by his commitment to mentoring the next generation of socially-aware design leaders — twin goals that are a natural fit for his leadership of MHCI+D. Ichikawa, who holds a Master of Design in Interaction Design from the UW, is already well-known within the MCHI+D community, having spent three years as an instructor for a range of undergraduate and graduate courses focused on foundational interface design, user research and evaluation, design methods, interaction design, and more.

In addition to leading his own independent design consultancy, Run, Jump & Fly, for the past 20 years, Ichikawa has held leadership roles at multiple design studios, where he worked with household names in technology, sports, consumer appliances and electronics, and the arts. He holds two patents related to the design of graphical user interfaces for planning and monitoring surgical procedures.

Portrait of Natasha Jaques with brown hair swept up and back and tendrils framing her face. She is wearing a dark sleeveless top or possibly dress with a high neck and large green and pink floral pattern. She is pictured against a plain light background.

Natasha Jaques: Advancing human-centered AI through social reinforcement learning

Natasha Jaques develops techniques for enabling artificial intelligence agents to engage in social learning, in which they acquire and practice increasingly complex behaviors from ongoing interaction with each other and with humans. Her goal is to build AI systems that can perform complex tasks, incorporate feedback from human social and emotional cues, and adapt seamlessly to new situations in order to assist humans with everyday tasks as effectively as another human can. For example, Jaques proposed a framework for enhancing coordination and communication in multi-agent reinforcement learning by rewarding agents for exercising causal influence over the actions of other agents. She also developed PAIRED, a novel reinforcement learning technique in which an environment generator builds increasingly complex environments for a pair of agents to solve and maximizes regret between the two to make the learner more robust. PAIRED demonstrated how multi-agent training can improve learning and generalization for a single AI agent. Jaques also proposed a method for training language models using reinforcement learning and human feedback that uses KL-control to minimize divergence from the original model trained on data. Going forward, Jaques intends to focus her research on developing agents’ ability to use social learning to acquire complex behavior, generalize to new environments, perceive and adapt to a person’s needs in real time, and to understand natural-language commands.

Jaques earned her Ph.D. from MIT and is currently a senior research scientist at Google Brain and a visiting postdoctoral scholar at University of California, Berkeley. She will join the Allen School faculty in January 2024.

Portrait of Baris Kasikci with short, light-brown hair and trim facial hair wearing glasses and a medium-blue button-down shirt under a dark suit jacket. Red tile roofs and palm or possibly banana trees are blurred but visible in the background.

Baris Kasikci: Building efficient and trustworthy systems across the computing stack

Baris Kasikci develops techniques for building efficient and trustworthy computer systems capable of delivering high performance at scale while minimizing bugs and security vulnerabilities. His work draws upon a range of disciplines, from systems and security, to computer architecture and programming languages, to produce solutions that span the entire computing stack. His contributions to software and applications include REPT, a practical tool for reverse debugging of failures in deployed software systems that is used in over a billion Windows systems worldwide, and OPTIMUS, the first hypervisor that supports scalable, flexible shared-memory virtualization of FPGAs for accelerating applications in the cloud. On the hardware side, Kasikci and his collaborators discovered microprocessor vulnerabilities such as Foreshadow that put billions of devices at risk. His group subsequently developed techniques to mitigate those risks while preserving performance, including NDA, which breaks the chain of dependent wrong-path instructions to head off speculative execution attacks at their source, and DOLMA, which introduced the principle of transient non-observability to comprehensively protect against transient execution attacks. Kasikci has also contributed to hardware/software co-design techniques for improving the performance and efficiency of data center systems that have been adopted by companies such as Intel and ARM.

Kasikci will join the Allen School next summer from the University of Michigan, where he has been a faculty member in the Electrical Engineering and Computer Science Department since 2017. During that time, he earned a National Science Foundation CAREER Award, a Microsoft Faculty Fellowship, an Intel Rising Star Award and a VMware Early Career Grant. Kasikci holds a Ph.D. from the École Polytechnique Fédérale de Lausanne (EPFL).

Portrait of Pang Wei Koh with short tousled dark hair wearing glasses and a grey t-shirt. Trees with autumn-colored leaves and evergreens are blurred but visible in the background.

Pang Wei Koh: Making machine learning systems robust and reliable in the wild

Pang Wei Koh focuses on the theory and practice of building reliable machine learning systems for real-world deployment. His research encompasses tools for inspecting model behavior; approaches for dealing with noisy, incomplete or contaminated data; and techniques for benchmarking and mitigating distribution shifts that contribute to model failure. For example, Koh developed an efficient and scalable method for explaining black-box model predictions by applying influence functions to identify which training examples contributed most to a given prediction. To support data-driven COVID policy, Koh helped develop a framework that combined population-scale mobility data with epidemiological modeling to assist policymakers in analyzing the impact of reopening policies on infection rates and societal inequities. Koh also co-led the development of WILDS — a curated set of benchmarks that reflect real-world distribution shifts for machine learning models deployed in domains spanning agriculture, biomedicine, wildlife conservation and more — as well as distributionally robust optimization methods for mitigating the effects of such shifts. He aims to build on his past work by developing techniques that will aid models in reliably extrapolating information from new data, improve model performance based on interactions with end users, and optimize models trained on broad data.

Koh is currently a senior research scientist at Google Brain and will join the Allen School in fall 2023. He was recently named among MIT Technology Review’s 2022 Innovators Under 35 Asia Pacific for his research. Before earning his Ph.D. from Stanford University, Koh was the third employee at Coursera, where he built and led the team responsible for course content and university partnerships.

Portrait of James Wilcox with short light brown hair and trim facial hair wearing a blue plaid button-down shirt. A glass and concrete building and green landscaping is blurred but visible in the background.

James Wilcox: Computer science education as refined storytelling

Allen School alum James Wilcox (Ph.D., ‘21) joined the faculty this fall as a teaching professor. His teaching interests include programming languages, systems programming, and reasoning about programs, and he enjoys teaching undergraduate and graduate as well as majors and non-majors courses. Wilcox’s favorite part of teaching is the creative process of learning, revising, and telling “the story” of each course in the spirit of oral tradition handed down from generation to generation.

Prior to joining the Allen School faculty, Wilcox taught multiple course offerings as a graduate student or lecturer, spanning undergraduate and graduate programming languages, software design and implementation, web browser engineering, introduction to systems, and more. His Ph.D. is in the theory of programming languages and focused on the application of formal reasoning techniques to distributed systems, including the first machine-checked proof for the popular Raft consensus protocol.

Including the 2022 recruiting season, the Allen School has added a total of 24 new faculty members over the past three years. Other recent arrivals are advancing transformational research focused on topics such as human-centric data visualization to support interactive exploration and discovery, bio-inspired wireless computing for environmental applications, molecular programming to bridge biology and information technology, and machine learning for understanding and treating disease.  Read more →

Technology for all: Kelly Mack earns ARCS Dorothy L. Simpson Leadership Award for championing accessibility through research and service-leadership

Portrait of Kelly Mack in lilac, aqua, and black floral short sleeve dress, amethyst pendant necklace, and pearl stud earrings standing in front of an ivy covered brick building.

Allen School Ph.D. student Kelly Mack is a problem solver who aims to ensure that other researchers take accessibility and disability into account — both in their research methods and during their design process. She has carried this accessibility mindset into her work with industry, where she helped establish the first disability-focused employee resource group as an intern at Snap Inc., and into her leadership of a chapter of Girls Who Code, where for the past five years she has facilitated workshops and taught girls between the ages of 10-18 how to code. 

“I want to inspire and provide mentorship for the next generation of computer scientists,” said Mack, who works with professor Jennifer Mankoff in the Allen School’s Make4All group. “Even in the early stages of learning about coding, we can create awareness around accessibility and inclusive design.” 

In recognition of her leadership and dedication to advancing the greater good, Mack recently received the 2022 Dorothy L. Simpson Leadership Award from the Seattle chapter of Achievement Rewards for College Scientists Foundation (ARCS). ARCS established the award in 2018 in honor of the late Dorothy L. Simpson, who, throughout her life, pursued intellectual curiosity and lifelong learning. As the President of the ARCS National Board and member of the Seattle ARCS chapter, Simpson was dedicated to supporting talented scholars through her philanthropic giving. Mack previously was named an ARCS Scholar (2019-2022), an award which is presented to top graduate students in the sciences who demonstrate exceptional qualities related to teamwork, innovation and creativity. 

“Kelly is a wonderful student, disability advocate and researcher,” said Mankoff, who is also founding co-director of the UW Center for Research and Education on Accessible Technology (CREATE). “She is dedicated to raising up people with disabilities.”

Although only in the third year of her doctoral studies, Mack has authored many papers presented at venues such as the ACM SIGACCESS Conference on Computer Science and Accessibility (ASSETS) and ACM Conference on Human Factors in Computing Systems (CHI). Five of her recent papers have been nominated for Best Paper Awards. Some of Mack’s notable work focuses on understanding accessibility and assistive technologies as a topic of research, qualitative research into the experiences and needs of people with disabilities using ethnographic and auto-ethnographic methods, and designing tools for high-quality alternative (alt) text authoring. 

In order to situate her own work as well as offer other researchers a starting point to explore questions related to accessibility, Mack led a meta-analysis of 836 papers produced over a 10-year period that focused on accessibility and assistive technology. The researchers wanted to learn who previous accessibility research had focused on, how other researchers articulated their goals (e.g., increase digital accessibility or increase independence for people), what methods were employed in the study design and how accessibility research has evolved since its conception.    

When COVID-19 turned her Microsoft Research internship virtual, Mack used it as an opportunity to examine how the pandemic style workspace created varied accessibility challenges for team members depending on their abilities, positions and seniority. This work broke new ground within Mack’s previous qualitative research endeavors wherein the researchers engaged in self-reflective methodology through the auto-ethnographic process. Ultimately, Mack and her team recommended guidelines such as community norm making, access labor and disability awareness, and a shift in attitudes toward accessibility within future mixed-ability virtual workspaces. 

Mack’s work on alt text authoring tackles the important topic of how to best assist authors to compose descriptions of digital images for the benefit of individuals who are blind or low-vision. In collaboration with Microsoft Research, this work was the first of its kind to tackle important questions related to alt text authorship as well as screen reader user preferences about human authored and human edited alt text. Significantly, this research uncovered the notion that screen reader users and alt text authors had widely different interpretations of what constitutes high-quality alt text. Likewise, Mack and her co-authors found that alt text authors produced superior alt text when they initiated the description based on the original digital image as opposed to when they edited AI generated alt text. 

For Mack’s dissertation work, she will focus on building technology that supports people with disabilities who have fluctuating access needs and disability identities.

“I want to demonstrate that ‘access’ isn’t static,” explained Mack. “What makes something accessible, or not, changes based on the person and context, and our technologies need to recognize that.”

Congratulations, Kelly! Read more →

Reaching to the moon, getting VOCAL, and other highlights from the Allen School’s 2022 Research Showcase

Fifteen people standing onstage in front of a black curtain smiling at the camera, wearing a mixture of casual attire with name badges and lanyards around their necks.
Award winners and runners up celebrate onstage with members of Madrona Venture Group during the Allen School’s annual Research Showcase

After a pandemic-enforced hiatus, last week the Allen School welcomed industry partners, alumni and friends to its 2022 Research Showcase this week to celebrate the groundbreaking work of its students and faculty. The typically annual event, which is hosted by the Industry Affiliates Program, welcomes industry partners and alumni to engage with the school’s research and learn more about how its members are advancing the field of computing. This year marked the first time the showcase has been held since 2019. 

The agenda included a variety of technical sessions featuring the latest and greatest Allen School research. Topics ranged from computing for the environment and artificial intelligence for health, to robotics and computational biology. The day concluded with an open house and poster session that culminated in the announcement of the Madrona Prize and People’s Choice Awards. 

Yejin Choi, wearing a black jacket, pullover shirt and jeans, stands behind a silver podium with an open laptop and speaks into a microphone. There is a sign on the front of the podium with text "Paul G. Allen School of Computer Science & Engineering" with the UW block "W" logo. There is wood paneling off to the side, a black curtain and a portion of a black stage railing visible behind her.
Allen School professor Yejin Choi delivers a keynote address on the algorithms that give smaller neural models an edge over larger industry-scale models

Allen School professor Yejin Choi, who was recently named a MacArthur Fellow for her work in natural language processing and commonsense AI, gave the keynote address titled “David vs. Goliath: The Art of Leaderboarding in the Era of Extreme Scale Neural Models.” During the talk, she highlighted the power of smaller neural models developed in academia and how they can have an edge over larger industry-scale models.

One of the approaches that gives them this edge, Choi explained, is Symbolic Knowledge Distillation, a new framework she and her colleagues proposed that distills knowledge symbolically as text besides just the neural model alone. Her work produced a machine-authored commonsense model that, for the first time, surpassed a human-authored model in all criteria, including scale, accuracy and diversity. Instead of humans directing the commonsense knowledge graph, Choi and her collaborators found that through their framework machines could write their own knowledge graph, teaching themselves to distill language, knowledge and reasoning. 

Choi also explained how an unsupervised, inference-time reasoning algorithm, can match or surpass supervised approaches on hard-reasoning tasks or complex language generation tasks that require logical constraints. The algorithm, called NeuroLogic Decoding, illustrated the limits of larger-scale neural models while also demonstrating better performance on text-generation tasks. 

While bullish on the potential of smaller, high-quality models, Choi acknowledged that scaling is a necessary condition for making progress in AI — necessary, but not sufficient.

“Scaling laws are real, and denial is futile,” said Choi, the Bret Helsel Professor in the Allen School and senior research manager at the Allen Institute for AI. “Especially when we think about hard problems in AI, we cannot just solve the hardest problems by scaling things up — analogous to how you cannot reach to the moon by making the tallest building in the world one inch taller at a time.”

A group of researchers prepares a demo on robot-assisted feeding. Two researchers are seated behind a table, one holding a smartphone up to the other to speak into; the third researcher is standing on the other side of the table holding a smartphone and looking toward a robotic arm. A monitor screen is visible showing images of a plate of food with a fork from above and the side. Two other people near a research poster are visible in the background.
A team demonstrates robot-assisted feeding during the open house

In the evening, nearly 300 people came together in the Paul G. Allen Center to catch up after two years of pandemic-enforced absence and view the latest research from Allen School labs. More than 50 teams of student researchers shared their work with attendees, who were invited to vote for their favorite poster or demo as part of the People’s Choice Award. 

Members of Madrona Venture Group, longtime friends and supporters of the Allen School, were on hand to present the Madrona Prize, which recognizes exciting projects with commercialization potential. Madrona partner Chris Picardo announced that members of the  UW Database Group behind VOCAL — short for Video Organization and Interactive Compositional AnaLytics — captured top honors for two projects related to that work. VOCAL allows users to extract semantic content from large datasets while minimizing inefficiencies in data cleaning, compositional queries, exploration and organization.

“We’re delighted to be back and able to award the prize again and have an amazing poster session,” Picardo said. “We’re thrilled that we get to do this and get to see such amazing research.” 

2022 Madrona Prize

Winner

Jared Nakahara, Chris Picardo, Dong He, Maureen Daum and Enhao Zhang smile while looking at the camera. Nakahara is wearing a gray shirt, black face mask and name tag. Picardo is wearing a purple sweater and green pants. He is wearing a black zip sweater and glasses. Daum is wearing a checkered red shirt. Zhang is wearing a gray zip sweater. The group is standing in front of a black curtain.
Madrona Prize honorees and presenters, from left: Runner-up Jared Nakahara, Madrona partner Chris Picardo, and winners Dong He, Maureen Daum, and Enhao Zhang. Photo courtesy of Madrona Venture Group

Video Organization and Exploration and Interactive Video Analytics for Compositional Queries: Ph.D. students Maureen Daum, Enhao Zhang and Dong He; Allen School director and professor Magdalena Balazinska; professor Ranjay Krishna; alum Brandon Haynes (Ph.D., ‘20), now a senior scientist at Microsoft

Runners up

Clearbuds: Wireless Binaural Earbuds for Learning-Based Speech Enhancement: Ph.D. students Ishan Chatterjee, Maruchi Kim and Vivek Jayaram; professors Shyam Gollakota, Ira Kemelmacher-Shlizerman, Shwetak Patel and Steven M. Seitz

Data Analysis Systems for Statistical Non-Experts: Ph.D. student Eunice Jun; professors Jeffrey Heer and René Just

Levity: Contactless Robotics and Automation for Synthetic Biology: Ph.D. student Jared Nakahara; professor Joshua R. Smith

2022 People’s Choice Awards

Distributing Trust and Establishing Transparency in Societal Scale Computing and Network Infrastructure: Ph.D. students Sudheesh Singanamalla, Matthew Johnson and Esther Han Beol Jang; master’s students Nick Durand and Abhishek Shah; postdoctoral researcher Spencer Sevilla; professors Richard Anderson and Kurtis Heimerl

Beyond WEIRDness of NLP: Ph.D. student Sebastin Santy; professors Katharina Reinecke and Yulia Tsvetkov; alum and former AI2 postdoc Maarten Sap (Ph.D., ‘21); psychology professor Andrew Meltzoff; research scientist Ronan Le Bras of the Allen Institute for AI; undergraduate alum Jenny Liang (B.S., ‘21), now a Ph.D. student at Carnegie Mellon University; research scientist Rodolfo Barragan of the UW Institute for Learning & Brain Sciences

Read GeekWire’s coverage of the awards here.

Thank you to our friends at Madrona and all of the members of the extended Allen School community who joined us in celebrating and supporting student innovation — it was wonderful to see you again! Read more →

‘I love the elegance of math’: Simon Du named Samsung AI Researcher of the Year for exploring deep questions surrounding deep learning

Simon Du, wearing a navy blue shirt, smiles while standing in front of a wooded background.

When Allen School professor Simon Shaolei Du opened his inbox on a cloudy Friday morning in October, he wasn’t expecting anything out of the ordinary, let alone a trip around the world. 

The website had slated the announcement for late September. When the date came and went, Du put the thought from his mind. Yet there it was. A click, a glow, then a smile. 

“It was very short notice, actually,” he said, grinning again. 

Next, plane tickets and slide decks awaited him – along with, if he was lucky, he said, some barbecue. 

Du was recently named a 2022 Samsung AI Researcher of the Year for his contributions to the field of artificial intelligence. He is one of five recipients of the award, which recognizes promising researchers under 35 who have made a significant impact in advancing the discipline. 

On Tuesday, Du was formally recognized at the 2022 Samsung AI Forum held in Seoul, South Korea. His talk focused on results from his previous work with deep learning and reinforcement learning. 

“I am grateful for receiving this award as a researcher working on the theoretical foundations of artificial intelligence,” Du said. “Furthermore, I am thrilled that machine learning theory research is valued.”

His work was among the first to show why over-parameterized neural networks can be optimized by simple algorithms, such as gradient descent, and established a theory for explaining why deep learning works well in terms of generalization. While over-parameterized models, which possess more parameters than training examples, have shown their power in recent years, it is unclear why. Du’s research centers on answering this question. 

“I aim to develop unifying theories for over-parameterized models to identify their benefits and drawbacks,” he said.

Du added he and his collaborators have also explored reinforcement learning theory and are seeking to further their scholarship in this arena. Reinforcement learning mimics the way humans learn – through trial and error. A system of positive reinforcers (awards) and negative reinforcers (punishments) guide the neural network in adapting to stimuli within the environment. As the agent experiences more, it grows wiser. 

It’s a solution whose beauty lies in the details. 

“I love the elegance of math, and I would like to make a real-world impact,” said Du, who credited his collaborators and students for helping make this achievement possible. “Machine learning is a field where mathematics is crucial in designing practically relevant methods.”

Du joined the Allen School faculty in 2020. In addition to the Samsung AI Researcher of the Year Award, he has received a National Science Foundation CAREER Award, an AAAI New Faculty Highlights Award from the Association for the Advancement of Artificial Intelligence and a NVIDIA Pioneer Award, among others. 

Congratulations, Simon! Read more →

What it’s like to be the first: Allen School community members share their stories to mark the National First-Generation College Celebration

For first-generation college students, navigating the complexities of higher education can be intimidating. Often there isn’t a blueprint from which to work. Yet for the more than 30% of undergraduates across the University of Washington who are first-generation students, it’s far from a solo journey. 

In honor of the National First-Generation College Celebration taking place today, the Allen School is highlighting members of its community who are among the first in their families to pursue a college degree. Here are a few of their stories. 

Responses have been edited for length and clarity.

Kent Zeng, wearing a white shirt with a gray sweater layered on top, stands in front of a green tree or shrub and is smiling.

Kent Zeng, undergraduate student

Kent Zeng, a senior studying computer science and minoring in math, serves as co-chair of GEN1, an organization for first-gen students in the Allen School. The life he’s living now contrasts sharply with the one his parents left behind when they immigrated to the U.S. from China. It’s a fact that spurs him, he says, to give back to his family and his community.

Allen School: Please describe why being a first-generation student is meaningful to you.

Kent Zeng: Being immigrants, my parents never really pursued their passions and mainly focused on providing for me and my sister in hopes that we could build a career that we found fulfilling. Being first-generation is meaningful to me because I am getting opportunities that my parents could only wish for. I honestly feel bad sometimes since I am getting all these experiences in college and my parents never did. However, I think the real point I should be focusing on is using these experiences to give back to my parents and to my community.

Allen School: How did you become involved with GEN1?

KZ: I initially got involved in GEN1 because I wanted to meet new people with a similar background as me. Now as an upperclassman my reason for staying involved in GEN1 is to support other first generation Allen School students academically and professionally. I’ve just started my role as co-chair, but the GEN1 team is kicking off the year strong. I recently led the Drive Your Career with Uber Technical Workshop where first-gen students learned from Uber recruiters and Uber technologists about how to best apply to technical roles and what day-to-day life at Uber is like. This year GEN1 is also hosting monthly community socials for our members to connect and we’ve got a lot planned for National First Gen Day! 

Allen School: Can you speak to the future impact of being a first-generation student?

KZ: I think one of the main generational outcomes that comes from being a first-generation student is the fact that the trajectory of families can dramatically change for the better. For starters, while not always the case, having a college degree can allow students from low-income families to graduate and work in lucrative industries, fundamentally altering the way families live. Education also expands minds, and first-generation students are now often able to think in ways that previous generations could not even fathom. In addition, with education, first-generation students can then go on to raise the foundation on which future generations can continue to grow.

Allen School: What is your favorite part about being a student at the Allen School? 

KZ: My favorite part of being a student in the Allen School is being connected with individuals who have similar motivations as I do and who challenge me to do better. Just hearing about all the cool things people in the Allen School community are doing inspires me to also do better and use my skills to help others.

Sonia Fereidooni smiles while standing in front of a blurred background, possibly a wooden door or entranceway, and is wearing black glasses and a white shirt.

Sonia Fereidooni, B.S./M.S. student

Sonia Fereidooni (B.S., ‘22) is a B.S./M.S. student studying computer science and one of the co-founders of GEN1. In June, she graduated with bachelor’s degrees in computer science and sociology. Now working on her master’s at the Allen School, she has served as a teaching assistant and was a lecturer for CSE 373: Data Structures and Algorithms this summer. 

Her love of teaching comes naturally; Fereidooni hails from a family of teachers. Her mother taught mechanical engineering and her grandmother taught high school math in Iran. Being the first in her family to receive a degree in the U.S. is not something she takes lightly. “It amplifies a story that anyone can make it,” she says, “and the more we are vocal about being the first in our family to achieve a postsecondary degree in the U.S., the more other first-generation students are inspired to do the same.”

Allen School: What inspired you to pursue a university degree?

Sonia Fereidooni: What inspired me was witnessing a female Iranian mathematician’s journey when I was a child. I first learned about Dr. Maryam Mirzakhani when I was about 10 or 11 years old, through an email chain my mother sent me about inspiring Iranian women.

Throughout the next few years, the more I learned about Dr. Mirzakhani, the more I wanted to pursue the field of mathematics like her and one day become a research professor. In 2014, she became the first woman to win the Fields Medal, the highest honor in mathematics, which led me to think that nothing was impossible. 

Allen School: What advice would you give first-generation students about to begin their college journey?

SF: I would advise that first-generation students understand that they are not like most of their peers entering the Allen School and this can be an empowering trait. Most first-generation students come into the Allen School already knowing how to build with intent and for the betterment of their larger community. Giving back to an underprivileged community is what many first-generation students have in mind and have as a goal when thinking about success at the Allen School. And there is strength in having that mindset as part of a large community of first-generation students, because we will always strive to support one another. 

Allen School: What is your favorite part about being a student at the Allen School?

SF: I have seen the Allen School in many different lights, but my favorite part is how fluid the school can be with leveraging opportunities to students. Even though the Allen School may seem very structured and traditional since it is one of the largest, most prestigious and most established computer science programs in the world, it really is not bound to some set of rules and structure the way most university departments are. At times, you can just reach out to professors and advisers and have a chat as friends. Or there will be opportunities where you obtain a research position just by talking to a research professor in a 20-second elevator ride at the Allen Center. The school is large, but if you are able to leverage the network and opportunities, you will be successful. 

Sofia Padilla Munoz stands in front of a gray building with two domes and there are trees in front of the building. She is wearing a white shirt and red glasses.

Sofia Isadora Padilla Muñoz, PMP student

Sofia Isadora Padilla Muñoz is a student in the Allen School’s Professional Master’s Program. Hailing from Guadalajara and raised in San Julian, both cities in Mexico, she earned her bachelor’s degree in electronics engineering from the Tecnológico de Monterrey. She cherishes her education, she says, because she knows it’s not a given. “Being a first-generation student is meaningful to me because I broke the endless family cycle where women, like my mother, were not allowed to study,” she says. “I am very grateful for my parents because they made it possible that my sisters and I are empowered and independent women, where each one can decide about her life and own it to live a fulfilled one.”

Allen School: What inspired you to continue your education after earning your bachelor’s degree?

Sofia Isadora Padilla Muñoz: I wanted to explore other areas of computer science to see which one I would like to specialize in further. Also, I wanted to connect with other engineers and hear their histories. Before coming to the Allen School, I was working as a software developer at Microsoft.

Allen School: What initially sparked your interest in computer science, and why did you choose the Allen School in particular? 

SPM: I decided to study electronic engineering and computer science because I thought that solving problems to improve the quality of life of people through engineering would add meaning and fullness to my life. So far, I think that it does. That is why I considered to keep studying and specializing in order to have a greater impact and responsibility in the new problems that society faces. I wanted an in-person program and, in verifying the rankings and academic consultants, the UW was the best option for me. It has all that I require to keep studying and working at the same time.

Allen School: What advice would you give first-generation students about to begin their college journey?

SPM: I would recommend to first-generation students to go to psychological counseling because we need help processing the changes and understanding them as a difficult challenge and not as a threat. Additionally, I would recommend they learn the best they can instead of being the best. In the end, what you learn is what you will remember. I have reached a point in my life where I no longer remember all the awards and prizes I have received because they simply do not define me. Knowledge and emotional stability give you security; prizes and awards do not. Finally, I would also add to have fun and enjoy the journey of college life and life itself: make friends, feel love, laugh loud, cry as needed, run, rest and eat. We only have one body and one mind and we need to take care of it.

Elle Brown, wearing a blue turtleneck sweater, smiles in front of a blurred background, possibly a brick wall.

Elle Brown, staff

In the days of dial-up, Elle Brown, a graduate advising program coordinator in the Allen School, remembers learning how to program, reinstalling Windows, tinkering with that heavy box, their portal to another world. It was not expected that they go to college, Brown says, but they had a passion for knowledge and a perseverance that allowed them to earn their bachelor’s degree after dropping out of high school. Now at the Allen School, Brown is helping others navigate their respective academic journeys. 

Allen School: Please describe why being a first-generation student is meaningful to you.

Elle Brown:  Being a first generation student is not only part of my history but part of my ancestors’ as well. My father did not graduate from high school. The story he told was that he was standing in the graduation line to walk in the ceremony when the administration pulled him out and said he was missing one credit. This infuriated him, so he walked out and never went back. Shortly after, he joined the army. My mom was a bride at 14. Her first husband, not my father, was 30 years her senior. She wouldn’t meet my father until she was 22. Needless to say, she also did not graduate high school.

Allen School: What are some challenges you experienced? 

EB: I dropped out of high school when I was 16 due to a number of factors, including chronic depression and anxiety. I was living with my paternal grandmother at the time, and she was still overcome with grief over my grandfather’s death five years prior. I was too much for her to deal with, and it was easier to let me drop out of school than to fight me every day, according to her. I managed to get a job at McDonald’s making $6.10 an hour, in hopes of moving out on my own and to stop being a burden on my grandmother. Though I lived in a rural area where the cost of living was considerably less than Seattle, I was still not able to make ends meet. I earned my GED in 2001, and I tried to figure out how to pursue college. I wasn’t sure how else to get on my own feet. I opted to apply to DeVry University in the school’s information technology subfields. A recruiter even came out to my grandma’s house to talk to us about enrolling.

Allen School: You overcame many obstacles on your way to graduating with your bachelor’s degree from UW. Can you talk a bit more about your journey from Georgia to earning your degree in Washington? 

EB: As a high school dropout and GED recipient, it was difficult to find colleges in my area that would accept my application. DeVry, though, seemed more than happy to take me on. My grandma and I didn’t understand the for-profit aspect of DeVry, and I know now that getting into that program was not about qualifying as much as it was about my being able to pay. My family was not able to provide any financial support. They never told me I would go to college, or that I needed to work hard to get there. It was simply not a possibility. The only people who talked about college were in books, those in TV or movies and at the occasional presentation at public school. There were student loans, though, and I could be declared independent since I didn’t have parents in my life. I would take on the loan debt. At the time there was a program called the HOPE Scholarship in Georgia that began in 1993. It was funded by the state lottery and promised money to students who showed academic excellence. Unfortunately, as a GED-recipient I only qualified for a tiny stipend.

I did not graduate from DeVry, and in fact I didn’t make it through a whole quarter. It was a rather dark time. In 2003, I met someone online and he asked me to move to Oregon to live with him. It was after I arrived there that I applied to Portland Community College and tried again to earn a degree. I did end up graduating from PCC in 2013 with an associate’s degree in general studies. I applied to UW in 2016 to earn a bachelor’s degree. I almost didn’t make it through my bachelor’s, and if it wasn’t for my adviser I would have dropped out my final quarter.

Allen School: What experiences led you to a position with the Allen School?

EB: My academic adviser was helping me search for job opportunities. I had the pleasure of interning with her during the last quarter of my degree in 2019. She found the program coordinator job with the Allen School and encouraged me to apply. I met with Elise, Garrette, who was the program coordinator before me, Les, Jen Hiigli and an outside staff member. They liked me and here I am!

Joe Eckert, wearing a dark blue sweater, leans on a railing while smiling in front of a blurred background, possibly a painting hung on a wall.

Joe Eckert, staff

Joe Eckert, the Ph.D. program manager in the Allen School, spent about eight years waiting for the federal government to acknowledge his financial independence while he attended community college as a part-time student. Once he was able to take loans out under his name, he finished his undergraduate work at Humboldt State University, now Cal Poly Humboldt. 

He continued his education at UW, pursuing a doctorate in geography. His experience as a graduate student eventually led him to academic advising. “After spending so much time and energy to uncover the ‘hidden curriculum’ for myself, I decided to continue teaching it to others as a staff adviser,” he says, noting his shift from student to staff. “I had to muck through this journey on my own and I’m excited to be able to help others avoid that.”

Allen School: What inspired you to pursue higher education?

Joe Eckert: Telemarketing is not a “forever” job, no matter how good you are at it.

Allen School: What led you to a position with the Allen School? 

JE: While I was supposed to be writing a dissertation, I picked up a graduate assistantship working as an academic adviser to geography undergraduates. I quickly learned that I liked advising far more than writing dissertations and took a year away from the program to take a temporary advising job at the Undergraduate Academic Affairs advising office, working primarily with non-majors who wanted to pursue tech careers. When the position concluded, I took on a role at the iSchool advising future librarians in their master’s program. In the middle of the pandemic, this job became available and I applied as quickly as I could!

Allen School: What is your favorite part about being a member of the Allen School? 

JE: I enjoy helping students learn that “hidden curriculum” that was invisible to me when I started both undergrad and graduate work. I’m privileged to work in a position that allows me to challenge “that’s just the way it’s always been” at both an interpersonal as well as a structural level. Working with folks who are discovering this academic way of being is the best. 

Allen School: What advice would you give first-generation students about to begin their college journey?

JE: Talk to someone. Find someone in your life who has been to college. It may not be your parents and it may not be anyone in your extended family. But you don’t have to navigate applications and career-planning alone – even if you’re used to having to figure stuff out independently. Also college advisers are nothing like high school counselors. You should ask your adviser things!

Learn more about UW’s first-generation celebration here. Read more →

Allen School researchers team up with clinicians and global health experts to repurpose inexpensive earphones to screen babies for hearing loss

A young boy wearing a grey and black zip-up jacket with green and orange trim and jeans sits in an ivory-colored plastic chair as a researcher seated adjacent to him in a dark grey office chair holds a probe to his ear. The probe is attached to a smartphone sitting on the researcher's lap. The researcher is wearing glasses, with a mask around his chin, a plaid button down shirt and dark cotton trousers. The child is looking down at the smartphone screen. There is a desk with papers and a pen and a backpack behind the child.
Allen School Ph.D. student Justin Chan, right, tests a child’s hearing in Kenya. Dr. Nada Ali/University of Washington

If you’re a frequent flyer, you may have amassed a motley collection of complimentary airline earbuds over the course of your travels — if you didn’t toss them in the trash immediately after clearing customs, that is. Soon, those throwaway pieces of plastic and wire could potentially transform the lives of children around the world. A team that includes Allen School professor Shyam Gollakota and Ph.D. student Justin Chan has devised a way to repurpose inexpensive earbuds to turn any smartphone into a device for screening newborn babies for hearing loss. The team described its prototype system in a paper published today in Nature Biomedical Engineering.

Clinicians screen newborns’ hearing by stimulating and evaluating otoacoustic emissions, or OAE, which are the sounds generated by the movement of the outer hair cells of a healthy cochlea. While such screening is currently routine in the United States, in many countries hospitals and clinics cannot afford the specialized equipment for administering the test. That disparity, along with firsthand experience, motivated Gollakota to tackle the project.

“I grew up in a country where there was no hearing screening available, in part because the screening device itself is pretty expensive,” Gollakota, who holds the Washington Research Foundation / Thomas J. Cable Professorship in the Allen School, told UW News. “The project here is to leverage the ubiquity of mobile devices people across the world already have — smartphones and $2 to $3 earbuds — to make newborn hearing screening something that’s accessible to all without sacrificing quality.”

The team designed an inexpensive probe using the aforementioned earbuds, an off-the-shelf microphone and a length of lightweight silicon tubing. The system plays a different tone through each earbud to stimulate the cochlea, and then records the OAE via the attached microphone and transmits it through the smartphone’s headphone jack for processing. In clinical testing involving more than 100 patients, the UW-developed system performed as well as commercial equipment costing thousands of dollars.

Now that they have a prototype, the researchers’ next step is to partner with local experts to scale up their approach. The team has already made a start by partnering with the UW Department of Global Health, the University of Nairobi and the Kenya Ministry of Health on the TUNE project, short for Toward Universal Newborn and Early Childhood Hearing Screening in Kenya. As reported on TUNE’s website, in countries with routine newborn screening programs, doctors detect hearing impairments in babies by the time they are two to three months of age; in countries without such programs, hearing loss often is not detected until the child reaches three years of age.

“We have an opportunity to really have an impact on global health, especially for newborn hearing,” Chan said. “I think it’s pretty gratifying to know that the research we do can help to directly solve real problems.”

Chan and Gollakota’s co-authors include Dr. Randall Bly and Dr. Emily Gallagher, both affiliated with UW Medicine and Seattle Children’s; Dr. Nada Ali of UW Medicine; Ali Najafi, who earned his Ph.D. from the UW Department of Electrical & Computer Engineering; Anna Meehan of Seattle Children’s, and Lisa Mancl of the UW Department of Speech & Hearing Sciences.

Read the Nature Biomedical Engineering paper here, a related article here, and the UW News release here. Read more →

A picture of health: Google Fellowship recipient Xin Liu combines machine learning and mobile sensing through an equity lens to support remote health assessment

Portrait of Xin Liu in dark blue button-up shirt and glasses standing outdoors with fall foliage and buildings blurred in the background.

When COVID consigned doctor-patient interactions from the clinic to a computer screen, Allen School Ph.D. candidate Xin Liu already had his finger on the pulse of that paradigm shift. Since his arrival at the University of Washington in 2018, Liu has worked with professor Shwetak Patel in the UbiComp Lab to combine mobile sensing and machine learning to real-world problems in health care, with a focus on developing non-contact, camera-based physiological screening and monitoring solutions that are accessible by all and adaptable to wide range of settings. His goal is to “democratize camera-based non-contact health sensing for everyone around the world by making it accessible, equitable, and useful.”

Liu embarked on his undergraduate education in the US as an international student realizing how difficult it was to integrate into a new culture. As an undergraduate student at UMass Amherst, he became the first international student consultant and peer-mentor. He also encouraged other international students to embrace leadership roles. Liu recounted that, “this experience motivated my research in computer science and health where I aimed to develop useful and accessible computing technologies for diverse populations.”

Liu’s research would take on new meaning and urgency as the pandemic upended modern social interactions. As remote clinical visits increased significantly during this time, the need for remote ways of sensing and monitoring heart health became critical for medical practitioners and patients alike. Liu’s work combining camera-based physiological sensing with machine learning algorithms could offer new possibilities in early detection of heart-related health issues as well as allow for much-needed remote diagnostics when a patient faces barriers to obtaining in-person care at a clinic — even outside of a pandemic. 

As Liu saw it, there were several major issues that needed to be considered, and, in some cases, corrected in order for camera-based health assessment to be widely applicable. From a practical standpoint, the tool would have to obtain a high level of accuracy for medical practitioners to evaluate patients’ vital signs remotely in order to make informed clinical decisions. Privacy is another major critical concern when it comes to people’s personally identifiable medical information; because of this, any collected data would need to be held locally on the device.

That device could come with varying capabilities — or lack thereof. 

“Since people have access to a wide range of devices, the application has to function on even the most rudimentary smartphone,” Liu explained. “Likewise, people in resource-constrained settings may not consistently have connectivity, so the application would need to be capable of running without being connected to a network.”

Disparate access to resources is not the only consideration for Liu and his colleagues when it comes to equity.

“In the past, camera-based solutions were skewed towards lighter skin tones, and did not function well with darker skin tones,” Liu noted. “To be truly useful, particularly to populations who are already underserved in health care, our application has to function accurately across the full range of skin tones, and under a variety of conditions.”

In 2020, Liu and his fellow researchers proposed the first on-device neural network for non-contact physiological sensing. This novel multi-task temporal shift convolutional attention network (MTTS-CAN) addressed the challenges of privacy, portability and precision in contactless cardiopulmonary measurement. Their paper, which was among the top 1% of submissions to the 34th conference on Neural Information Processing Systems (NeurIPS), was foundational in that it allowed for health sensing on devices with lower processing power. Following this, Liu conceived an even faster neural architecture called EfficientPhys for lower-end mobile devices, which will appear at the 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). 

Last year, Liu proposed an unsupervised few-shot learning algorithm called MetaPhys, presented at the Conference on Health, Inference, and Learning (CHIL), and a mobile-camera based few-shot learning mobile system called MobilePhys, which appeared in the Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), as steps toward addressing remote sensing’s shortcomings with regard to variations in patients’ skin tones, activities and environmental contexts. He has been involved with Microsoft Research’s efforts to use synthetic avatars to simulate facial blood flow changes and to systematically generate a large-scale video-based dataset under a wide variety of conditions such as different skin tones and backgrounds. This work has led to the production of a synthetic data set that offers labels with precise synchronization and without noise to overcome issues with variability and diversity. 

Having proven the concept, Liu has turned his attention to ensuring such tools will be reliable and efficient for diverse populations under real-world conditions. Whereas previous research on non-contact camera-based physiological monitoring has focused on healthy populations, Liu has initiated a collaboration with Dr. Eugene Yang, clinical professor and director of the Eastside Specialty Clinic at UW Medicine, to collect data in in-patient and out-patient clinical settings. Their goal is to validate the team’s machine learning augmented, camera-based approach for obtaining accurate readings for a range of health indicators, such as heart rate and respiration rate, in real-world clinical settings. Ultimately, Liu aims to push the boundaries of non-contact physiological measurement through exploring contactless camera sensing to measure such readings as blood pressure and arrhythmias.

“Xin takes a collaborative and interdisciplinary approach to his research,” said Patel, Liu’s Ph.D. advisor. “He works closely with his clinical partners to inform his research and executes his research with the highest ethical and equitable standards. He has taken on some difficult research challenges around skin tone diversity for health-related AI models that are already having industry impact.” 

Liu earned a 2022 Google Fellowship in Health Research and Artificial Intelligence for Social Good and Algorithmic Fairness to advance this work and foster the completion of his dissertation work. 

Congratulations Xin! Read more →

Lost in translation no more: IBM Fellowship winner Akari Asai asks — and answers — big questions in NLP to expand information access to all

Portrait of Akari Asai wearing grey floral lace top with black trim and dangling earrings against a grey background

Growing up in Japan, Akari Asai never imagined that she would one day pursue a Ph.D. at the Allen School focused on developing the next generation of natural language processing tools. Asai hadn’t taken a single computing class before her arrival at the University of Tokyo, where she enrolled in economics and business courses; her first foray into computer science would come thousands of miles from home, while studying abroad at the University of California, Berkeley. The experience would alter the trajectory of her academic career and put her on a path to solving problems on a global scale.

“I changed my major in the middle of my undergraduate studies, and I wished I had discovered computer science and opportunities for pursuing my career abroad earlier,” said Asai. “My own situation made me realize the importance of information access for everyone.”

That realization led Asai to pursue her Ph.D. at the University of Washington, where she is now in the business of developing next-generation AI algorithms that offer rich natural language comprehension using multi-lingual, multi-hop and interpretable reasoning working with Allen School professor Hannaneh Hajishirzi in the H2Lab.

“Akari is very insightful and cares deeply about the impact of her work,” observed Hajishirzi, who is also senior research manager in the Allen Institute for AI’s AllenNLP group. “She is bridging the gap between research and real-world applications by making NLP models more efficient, more effective, and more inclusive by extending their benefits to languages other than English that have been largely ignored.”

More than 7,100 languages are spoken in the world today. While English is the most prevalent, spoken by nearly 1.5 billion people, the global population is nearing 8 billion — meaning a significant proportion is excluded from the benefits of today’s powerful NLP models. Asai is trying to close this gap by enabling universal question answering systems that can read and retrieve information across multiple languages. For example, she and her collaborators introduced XOR-TyDi QA, the first large-scale annotated dataset capable of open-ended information retrieval across seven different languages other than English. The approach — XOR QA stands for Cross-lingual Open Retrieval Question Answering — enables questions written in one language to be answered using content expressed in another. 

Asai also contributed to CORA, the first unified multilingual retriever-generator framework that can answer questions across many languages — even in the absence of language-specific annotated data or knowledge sources. CORA, short for Cross-lingual Open-Retrieval Answer Generation, employs a dense passage retrieval algorithm to pull information from Wikipedia entries, irrespective of language boundaries; the system relies on a multilingual autoregressive generation model to answer questions in the target language without the need for translations. The team incorporated an iterative training method that automatically extends the annotated data previously only available in high-resource languages to low-resource ones. 

“We demonstrated that CORA is capable of answering questions across 28 typologically different languages, achieving state-of-the-art results on 26 of them,” Asai explained. “Those results include languages that are more distant from English and for which there is limited training data, such as Hebrew and Malay.”

Language is not the only barrier Asai is working to overcome. The massive computational resources required to operate the latest, greatest language models, which few groups can afford, also puts them out of reach for many. Asai is making strides on this problem, too, recently unveiling a new multi-task learning paradigm for tuning large-scale language models that is modular, interpretable and parameter-efficient. In a preprint, Asai and her collaborators explained how ATTEMPT, or Attentional Mixture of Prompt Tuning, meets or exceeds the performance of full fine-tuning approaches while updating less than one percent of the parameters required by those other methods.

Asai is also keenly interested in the development of neuro-symbolic algorithms that are imbued with the ability to deal with complex questions. One example is PathRetriever, a graph-based recurrent retrieval method that learns to retrieve reasoning paths over the Wikipedia graph to answer multi-hop open-domain questions at web scale. By leveraging a reading comprehension model alongside the retriever model, Asai and her colleagues enabled PathRetriever to explore more accurate reasoning paths in answer to complex questions compared to other methods. Some of her co-authors subsequently adapted the system to enable complex queries of scientific publications related to COVID-19. 

Ultimately, Asai intends to integrate the various facets of her research into a general-purpose, lightweight retriever and neuro-symbolic generator that will be capable of performing complex reasoning over diverse inputs while overcoming data scarcity. Having earned a 2022 IBM Ph.D. Fellowship earlier this year to advance this work, Asai’s ambition is to eliminate the disparity between the information “haves” and “have nots” by providing tools that will empower anyone to quickly and easily find what they need online — in multiple languages as well as multiple domains.

“Despite rapid progress in NLP, there are still several major limitations that prevent too many people from enjoying the benefits of that progress,” she explained. “My long-term research goal is to develop AI agents that can interact with broad swaths of internet users to answer their questions, giving everyone equal access to information that might otherwise be limited to certain default audiences.”

Her commitment to promoting equal access extends beyond information retrieval to include the field of NLP itself; to that end, Asai is an enthusiastic mentor to students from underrepresented backgrounds.

“I’m excited to continue making progress on my own research interests,” said Asai, “but I hope to also inspire the next generation of researchers in AI.”

Way to go, Akari! Read more →

Jeffrey Heer wins Test of Time Award at IEEE VIS for helping the visualization community better understand challenges facing data analysts

Jeffrey Heer seated at a wooden desk with his hands folded in front of an open laptop, which is positioned in front of two large computer monitors — one dark, one showing various graphs onscreen. A telephone is to the left of the monitors, and a textbook is on the desk. Part of a window and guest sofa are visible in the background.

Allen School professor Jeffrey Heer received a Test of Time Award at the 2022 IEEE Visualization & Visual Analytics Conference this week, marking the third consecutive year that his work has been recognized with the honor. 

Heer, the co-director of the Interactive Data Lab, co-authored the winning paper, “Enterprise Data Analysis and Visualization: An Interview Study,” which provided key insights into understanding how data analysts operate and the challenges they encounter in their workflows. The paper was published in IEEE Transactions on Visualization and Computer Graphics in 2012 when Heer and two of his co-authors were researchers at Stanford University. The team presented its findings at the IEEE Conference on Visual Analytics Science and Technology (VAST).

The Test of Time Award recognizes papers published at previous conferences that have had a lasting impact both within and beyond the field of visualization over the ensuing decade. 

“We’re thrilled that our colleagues still find our work relevant 10 years later,” said Heer, who holds the Jerre D. Noe Endowed Professorship at the Allen School. “While research ‘style’ probably plays a part, I think we were also in the right time and place as societal interest in data and analysis heated up. I also think it helps that our work has had interdisciplinary teams spanning human-computer interaction, data management, cognitive science and other disciplines, bringing more varied perspectives.” 

As the team members investigated tools to aid data analysis, they were particularly interested in what Heer referred to as “the messy early stages of data cleaning and preparation.” While they had hands-on experience themselves, they wanted to gain a deeper understanding of the different types of analysts, the issues they encountered and the infrastructure that supported them. 

To tackle this problem, the team launched a qualitative study, interviewing participants across a range of sectors, including health care, retail, social networking, finance, media, marketing and insurance. Among the insights they uncovered included analyst archetypes, how analysts collaborated with one another and with other business units and challenges they met in the analysis process. 

“The study helped prioritize our thinking around the varied backgrounds of people working with data, including different levels of statistical and software development expertise, and how organizational dynamics shapes how the work gets done,” Heer said. “Both are important to consider if new tools are going to be usable and effective in practice.”

Heer credited first author Sean Kandel, his former Ph.D. student at Stanford and fellow co-founder of Trifacta, with leading the project. Kandel was the chief technical officer of Trifacta, which develops data wrangling software and a popular data preparation platform used by Google, NASA and others. Trifacta was acquired by Alteryx in February. 

Co-author Andreas Paepcke is the director of data analytics and senior research scientist at Stanford. Co-author Joseph M. Hellerstein is the Jim Gray Professor of Computer Science at UC Berkeley and a co-founder of Trifacta. Hellerstein was at UC Berkeley at the time of the study. 

Heer previously earned Test of Time Awards at VIS for his work on data-driven documents and narrative visualization. Since joining the Allen School faculty in 2013, he has been recognized with the Association for Computing Machinery’s ACM Grace Murray Hopper Award, the IEEE Visualization Technical Achievement Award and Best Paper Awards at the ACM Conference on Human Factors in Computing (CHI), EuroVis and IEEE InfoVis conferences. Last year, Heer was elected to the CHI Academy by the ACM Special Interest Group on Computer-Human Interaction (SIGCHI) for his substantial contributions in the areas of data visualization, data wrangling, text analysis, language translation and interactive machine learning. 

Read Heer’s latest award-winning paper here and the award citation here

Congratulations to Jeff and his co-authors! Read more →

Making “magical concepts” real: Allen School professor Rachel Lin named one of Science News’ 10 Scientists to Watch

Portrait of Rachel Lin leaning against a metal railing in building atrium with concrete, wood and glass in the background

Science News has named professor Huijia (Rachel) Lin, a founding member of the Allen School’s Cryptography group, as one of its SN 10: Scientists to Watch. Each year, Science News recognizes 10 scientists who are making a mark in their respective fields while working to solve some of the world’s biggest problems. Lin earned her place on the 2022 list for achieving a breakthrough on what has been alternately referred to as the “holy grail” or “crown jewel” of cryptography by proving the security of indistinguishability obfuscation.

“I’m very attracted to these magical concepts,” Lin told Science News. “The fun of it is to make this concept come to realization.”

While Lin explores a variety of fundamental problems — from black-box constructions for securing multiparty computation to zero-knowledge proofs — her work on iO has been celebrated for answering an open question that had vexed cryptographers for more than 40 years: How to prove the security of this potentially powerful “master tool” for securing data and computer programs while maintaining their functionality and bring it into the mainstream. According to the article, previous attempts at proving iO were generally geared toward obtaining a result that would be deemed “good enough” — and one by one, those attempts would unravel under further scrutiny. 

Lin aimed for more than “good enough” by seeking a generalizable solution grounded in sound mathematical theory. Rather than approaching iO like “a bowl of spaghetti,” as she put it, Lin preferred to attack the problem by untangling it into its component parts, working alongside University of California, Los Angeles professor Amit Sahai and his then-Ph.D. student and NTT Research intern Aayush Jain, now a professor at Carnegie Mellon University. After two years, the team had a theoretical framework for provably secure iO that was based on a quartet of well-founded assumptions: Symmetric External Diffie-Hellman (SXDH) on pairing groups, Learning with Errors (LWE), Learning Parity with Noise (LPN) over large fields, and a structured-seed Boolean Pseudo-Random Generator (sPRG). The result was first reported in Quanta Magazine in the summer of 2020; Lin and her collaborators subsequently earned a Best Paper Award at the Association for Computing Machinery’s 53rd Symposium on Theory of Computing (STOC 2021) for their contribution — one that Lin is eager to see progress from theory to reality.

“These are ambitious goals that will need the joint effort from the entire cryptography community,” she observed at the time. “I look forward to working on these questions and being part of the effort.”

In other words, watch this space.

Lin is the second member of the Allen School’s Theory of Computation group to be recognized on the SN 10 list, after her colleague Shayan Oveis Gharan was highlighted in 2016.

Read Lin’s profile in Science News here, and the Quanta article on the i/O breakthrough here.

Photo: Dennis Wise/University of Washington Read more →

« Newer PostsOlder Posts »