Human Computer Interaction

figmaJun 24, 20263 min readCurated summary

What Does the Future of Software Look Like? | Figma Blog

AI may reshape software around more human, contextual interactions rather than fixed menus and mechanical commands. The post argues that future interfaces could understand intent through voice, gesture, emotion, and situation, adapting their behavior to each person. Instead of forcing users to adapt to increasingly powerful systems, software could meet users where they are while encouraging focus, presence, and healthier technology habits. ## Ephemeral Tools - Controls appear only when users select an object and indicate what they want to do. - Contextual options replace persistent menus, panels, and modes. - A video editor, for example, might show timing, pacing, alternate cuts, and sound options around a selected clip. - This lets creators focus on decisions and intent rather than remembering how software is organized. ## Magic Marker - Users interact through a combination of voice, cursor movement, gestures, sound effects, and body language. - Someone could circle an object, drag it into position, and verbally request a change. - AI would interpret these signals together, making it feel more like collaborating with a teammate. - This reduces the need for precise prompt engineering or complex document references. ## Adaptive Presence - Intelligent systems adjust their communication style and level of assistance based on user behavior. - They might offer structured guidance when someone is confused, step back when help is unnecessary, or switch between text, voice, and visuals. - Software could change pacing, simplify language, and divide information into smaller steps. - This approach is especially valuable in healthcare and education, where differences in user readiness can have serious consequences. ## Empathetic Flows - Interfaces could infer emotional states from typing speed, stylus pressure, speech patterns, facial expressions, and repeated revisions. - A food app might reduce choices when someone appears overwhelmed. - A creative tool could become quiet when the user is concentrating, while a hotel app might stop promoting upgrades when the guest seems tired. - Rather than requiring users to explicitly state what they need, systems would respond to behavioral signals. ## Situational Cues - Sound, motion, pacing, progress indicators, and visual transitions can help users understand where they are in an experience. - Earlier digital products used cues such as dial-up sounds, progress bars, and “You’ve got mail” announcements to provide orientation. - Future interfaces should counteract the overstimulation caused by attention-driven notifications. - Persistent progress indicators, transition sounds, and consistent visual language could help users regulate their attention and nervous systems. ## Spatial Tuning - Users could control software through bodily movement instead of conventional tapping and clicking. - Examples include shaping music with hand movements, navigating augmented reality by changing body orientation, or adjusting design elements through gestures. - These interactions demand attention and presence, making them harder to rush or automate. - Technology becomes an experience that intentionally slows users down rather than continually rewarding speed. ## Mash-Ups - Future systems could combine any two inputs—files, objects, sounds, locations, or physical gestures—to create something new. - The system would synthesize the combined inputs while blending their structure, tone, and meaning. - Possible examples include merging a playlist with a city map or combining digital objects through touch or gestures. The overall recommendation is to design AI-powered software around human intent, context, emotion, and physical presence. The most successful future interfaces may be those that make technology feel less like a collection of controls and more like an adaptable, considerate collaborator.

Read original

Human Computer Interaction AI User Experience Augmented Reality+3

figmaApr 1, 20263 min readCurated summary

6 Designs That Reimagine How We Interact With Software | Figma Blog

This Figma Make-a-thon showcase argues that software interaction can become more expressive, playful, and socially connective when designers rethink familiar conventions. The winning projects use technology to recreate communal crafts, enable hands-free control, and expand physical experiences beyond traditional limits. Together, they suggest that creativity and emotional connection—not just speed and efficiency—should shape digital experiences. ## Collaborative Embroidery: Common Thread - Charlota Blunárová’s winning project adapts the tradition of handmade samplers into a shared online canvas. - Visitors choose thread colors and stitch types, then contribute to a communal embroidery piece alongside strangers. - The project deliberately imposes constraints: one shared canvas becomes more meaningful as people add to it over time. - More than 100,000 stitches have been added, turning the site into an evolving, collectively authored artifact. - Blunárová built the real-time collaboration and canvas interactions in Figma Make despite having no engineering background. - Her process began with the desired feeling and used visual references, including logos and color palettes created in Figma. ## Hands-Free Interaction: Pucker - Aleyna Çatak’s “Pucker” replaces tapping and voice commands with head movements and a lip gesture. - Users tilt their heads to move through an interface, hold still to select an item, and pucker their lips to confirm. - The concept is designed for situations where users’ hands are occupied, such as cooking, knitting, or designing. - It also points toward more accessible interfaces that can be operated without touch or speech. - Pucker uses a device’s front camera for real-time tracking and states that no data is stored or transmitted. - Çatak describes it as a flexible interaction layer rather than a finished product, potentially adaptable across apps and platforms. - Her advice is to understand basic coding concepts so prototypes can be refined and troubleshot more effectively. ## A Remote Photo Booth: Duet Booth - Paige Latimer reimagines the traditional photo booth as a remote, asynchronous experience. - Duet Booth allows two people in different places—or participating at different times—to take photos that are combined into one photo strip. - The project preserves the photo booth’s sense of immediacy and shared participation while removing its physical and geographic constraints. - Latimer recommends concentrating on the core interaction before polishing visual details, giving the rest of the design a strong foundation. The projects presented in the article demonstrate how Figma Make lowers the barrier to prototyping ambitious ideas. Designers can use it to turn emotional concepts, alternative input methods, and collaborative rituals into working experiences—provided they begin with a clear sense of the feeling or interaction they want to create.

Read original

Human Computer Interaction Figma Real Time Collaboration Figma Make+2

figmaJan 7, 20262 min readCurated summary

Software Is Culture

Software has evolved from an invisible, mechanical tool into an intimate part of human experience. The next major shift is toward intelligent, adaptive systems that learn and change with users. The post argues that designers will shape this future not merely by automating tasks, but by deciding where technology directs human attention, curiosity, and creativity. ## Software as Human Experience - Software once operated behind screens as an efficient, obedient system. - Touch interfaces—pinching, swiping, and tapping—made software embodied and deeply connected to how people think, feel, and communicate. - As a result, user experience became inseparable from human experience. ## The Shift to Intelligent Software - Future systems will learn, adapt, and respond rather than follow fixed interactions. - Interfaces may change in real time based on users’ needs and behavior. - Static products will become fluid, adaptive, and increasingly “alive.” - Understanding this transition requires examining influential interactions and design decisions from the past two decades. ## AI as Tool and Collaborator - AI can amplify distinctly human qualities rather than simply replace human work. - Interaction is shifting from commands, layers, and parameters toward conversation, goals, gestures, and overall intent. - The central design question is not what to automate, but where people should focus their attention. ## The Designer’s Role - Designers are navigating how intelligent software will affect curiosity, meaning, and craft. - Their choices will influence how future generations experience and understand technology. - Finding a personal perspective as a designer is essential to shaping software’s cultural impact. The practical takeaway is to treat software design as cultural work: build adaptive systems thoughtfully, and focus on how they direct human attention and enable meaningful action.

Read original

Human Computer Interaction AI User Experience Machine Learning+3

metaDec 17, 2025Original article

How We Built Meta Ray-Ban Display: From Zero to Polish (opens in new tab)

Meta's development of the Ray-Ban Display AI glasses focuses on bridging the gap between sophisticated hardware engineering and intuitive user interfaces. By pairing the glasses with a neural wristband, the team addresses the fundamental challenge of creating a high-performance wearable that remains comfortable and socially acceptable for daily use. The project underscores the necessity of iterative refinement and cross-disciplinary expertise to transition from a technical prototype to a polished consumer product. ### Hardware Engineering and Physics * The design process draws parallels between hardware architecture and particle physics, emphasizing the high-precision requirements of miniaturizing components. * Engineers must manage the strict physical constraints of the Ray-Ban form factor while integrating advanced AI processing and thermal management. * The development culture prioritizes the celebration of incremental technical wins to maintain momentum during the long cycle from "zero to polish." ### Display Technology and UI Evolution * The glasses utilize a unique display system designed to provide visual overlays without obstructing the wearer’s natural field of vision. * The team is developing emerging UI patterns specifically for head-mounted displays, moving away from traditional touch-screen paradigms toward more contextual interactions. * Refining the user experience involves balancing the information density of the display with the need for a non-intrusive, "heads-up" interface. ### The Role of Neural Interfaces * The Ray-Ban Display is packaged with the Meta Neural Band, an electromyography (EMG) wristband that translates motor nerve signals into digital commands. * This wrist-based input mechanism provides a discrete and low-friction way to control the glasses' interface without the need for voice commands or physical buttons. * Integrating EMG technology represents a shift toward human-computer interfaces that are intended to feel like an extension of the user's own body. To successfully build the next generation of wearables, engineering teams should look toward multi-modal input systems—combining visual displays with neural interfaces—to solve the ergonomic and social challenges of hands-free computing.

Human Computer Interaction Augmented Reality Wearable Technology Hardware Design+3

figmaJun 8, 20252 min readCurated summary

Bill Atkinson’s 10 Rules for Making Interfaces More Human | Figma Blog

Bill Atkinson’s work at Apple showed that powerful technology can feel natural, accessible, and even joyful. Through QuickDraw, MacPaint, and HyperCard, he transformed complex computing tasks into intuitive creative experiences. The post distills his approach into principles centered on designing within limits, democratizing creation, challenging assumptions, and making interfaces disappear into the user’s work. ## Designing Within Constraints - Atkinson developed QuickDraw for the original Macintosh, which had only 128KB of RAM and limited processing power. - Instead of lowering the ambition for smooth graphics, he created highly efficient algorithms for drawing shapes and curves. - His approach favored elegant solutions that respected constraints rather than brute-force hardware improvements. ## Democratizing Creativity - HyperCard aimed to let people create interactive software without years of programming experience. - Its visual tools and natural-language scripting enabled teachers, artists, and businesses to build their own applications. - Atkinson believed transformative tools should serve everyone, not only technical specialists. ## Making Interfaces Feel Inevitable - Atkinson helped establish interface conventions such as the menu bar, double-clicking, and smooth graphical interactions. - These features made drag-and-drop and point-and-click computing accessible to non-programmers. - Great interface design, in this view, lets users focus on their work instead of the software. ## Questioning Conventional Wisdom - Atkinson challenged assumptions that computing had to be text-based or that bitmap editing was too difficult for ordinary users. - He later acknowledged that HyperCard’s architecture was limited by Apple’s “box-centric” worldview and might have become an early web browser in a network-oriented environment. - Designers should scrutinize ideas that seem obviously correct or impossible. ## Optimizing for Delight - MacPaint was designed to be immediately understandable, even to young children. - Tools such as the brush and paint bucket behaved like their real-world counterparts. - The goal was not merely task completion, but encouraging experimentation, play, and creative exploration. Atkinson’s legacy suggests that human-centered software combines technical rigor with empathy: work within limitations, remove unnecessary complexity, and make creation feel inviting.

Read original

Human Computer Interaction Figma Interface Design Graphical User Interface+3

figmaMay 18, 20253 min readCurated summary

Andrew “Boz” Bosworth's 10 Rules for Navigating the Next Design Paradigm | Figma Blog

Andrew “Boz” Bosworth argues that designers entering the next era of AI and spatial computing must challenge inherited assumptions rather than merely improve existing interfaces. His approach begins with real human problems, favors experimentation and intuition, and treats interactions as complete systems. The goal is to create technology that understands users and ultimately becomes nearly invisible. ## Start with real human problems - Identify a specific person with a genuine problem. - Let users determine whether a product is useful through their behavior. - Avoid prioritizing abstract ideas over practical human needs. ## Question inherited design assumptions - Recognize that familiar constraints and interaction patterns are man-made paradigms. - Ask whether the current approach is actually appropriate. - Treat seemingly fixed limitations as potentially changeable. ## Reimagine the interaction paradigm - Current computing often forces users to translate simple intentions into complicated sequences of apps and services. - After decades of desktop and mobile conventions, designers should reconsider the entire model of interaction. - New technology should simplify intentions rather than expose underlying complexity. ## Distinguish invention from optimization - “Zero-to-one” invention happens without established customers or constraints. - Optimization improves and refines an existing product with audience feedback. - AI and spatial interfaces provide greenfield opportunities where old assumptions may not apply. ## Use taste and intuition to choose the right direction - Product development resembles climbing through a difficult problem space. - Intuition helps teams choose promising “terrain” before investing in execution. - Good judgment does not remove the hard work, but it improves the odds of pursuing the right problem. ## Prototype aggressively - Build rough, unconventional prototypes to test whether an idea is worth pursuing. - Meta has used crude physical setups, including tracked hats and mesh-walled rooms, to explore spatial computing. - Direct experimentation reveals possibilities that discussion alone cannot. ## Design the complete system - Spatial products cannot be designed by changing one isolated component. - Gestures, visual/audio/haptic feedback, and resulting functionality must evolve together. - Iteration should happen across the whole interaction system. ## Give tools an appropriate theory of mind - Future tools should understand users’ intentions and goals. - They need enough agency to assist meaningfully, but not so much that they become intrusive or unpredictable. - Effective assistance depends on balancing automation with user control. ## Treat products and people as works in progress - Products should be viewed as successive versions rather than finished objects. - Bugs and improvements are a normal part of continued development. - Designers should apply the same iterative mindset to their own growth. ## Make interfaces disappear - Interfaces should be as seamless and minimal as possible. - Their value lies in enabling an experience, not in drawing attention to themselves. - The ideal interaction removes unnecessary friction between a person and their intention. Bosworth’s practical recommendation is to stay close to human needs, challenge conventional assumptions, prototype early, and design the entire experience. In emerging fields such as AI and spatial computing, success depends less on polishing familiar interfaces than on inventing simpler, more natural ways for people to accomplish things.

Read original

Human Computer Interaction AI Interface Design Virtual Reality+4

figmaJun 25, 20243 min readCurated summary

Are we finally entering the age of androids? | Figma Blog

Humanoid robots are moving from science fiction into public spaces and workplaces, forcing people to confront both the promise and risks of embodied AI. Their humanlike form makes technology more intuitive and emotionally engaging, but it also encourages people to project intelligence, intention, and personality onto machines. The article argues that designers must shape this illusion carefully, using humanoid robots to foster connection and understanding rather than control or deception. ## Humanoids as Technology in Human Form - Ameca, created by Engineered Arts, performs at Las Vegas’s Sphere as an interactive entertainer. - It turns toward speakers, displays facial expressions, tells jokes, and responds conversationally. - Its appeal comes from combining AI with expressive robotics. - Apollo, developed by Apptronik and argodesign, represents a different model: - It is designed as a general-purpose laborer. - Its flat face, cameras, and LED mouth prioritize function over lifelike appearance. - Humanoid robots have deep cultural roots, appearing in Greek mythology, Taoist philosophy, and science fiction. - Their human form makes software easier to engage with through gestures, expressions, and face-to-face interaction—what Engineered Arts CEO Will Jackson describes as a heads-up alternative to screen-based technology and virtual reality. ## What the Illusion of Sentience Unlocks - Humans naturally anthropomorphize objects and search for faces, motives, and signs of life. - Madeline Gannon uses body language and animal behavior as inspiration for designing industrial robots with recognizable personalities. - Even simple geometric animations can appear intentional: the Heider and Simmel experiment showed that people assign motives to moving shapes. - Ameca intensifies this effect through: - Furrowed brows, smiles, and expressions of surprise - Celebrity impressions - Custom personalities created by a dedicated “Persona Architect” - The ability to switch behavioral modes depending on context - Engineered Arts deliberately avoids making Ameca appear fully human: - Its metallic body avoids realistic skin. - It has no defined race or gender. - Its artificiality makes the theatrical nature of the interaction more visible. - The technology underneath remains impersonal: AI interprets language and maps it to suitable facial expressions. Nevertheless, users can experience meaningful emotional moments, such as a shy attendee gaining confidence while speaking Japanese with Ameca. - Gannon argues that designers must make complex systems legible, much as everyday objects communicate how they should be used. - She sees design as a way to redirect technology toward curiosity, kindness, and care, creating relationships based on connection rather than control. ## Designing Androids for Work - Apollo does not claim to be sentient; its purpose is practical labor. - It is being developed to address worker shortages, including work in Mercedes-Benz factories and potentially space exploration. - Its humanoid shape is primarily a response to human-scale environments and tools. - Unlike Ameca, Apollo must appear approachable enough for workers to accept, while avoiding the uncanny valley. - The article frames this as a central design challenge: workplace robots need to communicate socially without misleading people about what they are. Humanoid robots are most valuable when their appearance and behavior clarify how people should interact with them. Whether used for entertainment or labor, designers should treat the illusion of intelligence as an ethical material—balancing emotional engagement with transparency and purposeful design.

Read original

Human Computer Interaction AI Large Language Models Automation+3

figmaNov 30, 20202 min readCurated summary

Adding it all up: The math behind designing your career | Figma | Figma Blog

A career is less a predetermined trajectory than a collection of experiments, interests, and opportunities whose meaning becomes clearer in hindsight. Kylie Poppen argues that because work occupies roughly 90,000 hours of our lives, we should actively examine the patterns shaping our choices rather than assume a single “destiny.” Mathematical metaphors—scatterplots and Venn diagrams—offer tools for making more intentional career decisions. ## Careers as Scatterplots - People often describe careers as trend lines, connecting past experiences into a coherent narrative. - In reality, careers are lived as scatterplots: a series of moves between interests, jobs, and opportunities. - The next point cannot reliably be predicted from the current one; clarity usually comes only afterward. - Regularly reflecting on experiences can help reveal a more accurate career trajectory over time. - Work deserves careful consideration because it consumes about one-third of waking life and affects financial stability, purpose, frustration, pride, and identity. ## Finding Meaning Through Overlap - Venn diagrams illustrate how combining different interests can reveal unexpected possibilities and innovations. - Career choices do not need to force a decision between passion and practicality; meaningful work can emerge where hobbies, skills, and interests intersect. - Poppen’s childhood interest in designing posters with CorelDRAW, combined with her passions for storytelling, technology, and people, eventually pointed toward product design. - Her path was not direct: she explored recruiting, marketing, engineering, and project management before gaining the confidence to pursue design. - Mentorship and constructive feedback helped her see design as a craft developed through practice rather than an innate destiny. - Mapping personal interests can uncover overlooked career options and provide confidence to pursue a desired direction. A practical approach is to treat your career as an evolving set of data points, then look for recurring patterns and intersections among your interests, abilities, and experiences. This can lead to more fulfilling choices without requiring certainty about the final destination.

Read original

Human Computer Interaction Product Design Data Visualization Coreldraw+1

figmaApr 22, 20202 min readCurated summary

Bringing Figma to even more classrooms | Figma Blog

Figma expanded its Figma for Education program in response to the growing need for remote teaching during COVID-19. The program now supports online courses, bootcamps, school-sponsored hackathons, and other virtual or informal classrooms—not just accredited degree programs. Its goal is to make collaborative design education accessible to more learners. ## Expanding Eligibility Beyond Traditional Institutions - Figma had previously offered free access and discounts to students and educators at accredited institutions. - More than 100,000 people worldwide were already using Figma in classrooms. - The expanded program now includes: - Online courses - Bootcamps - School-sponsored hackathons - Other in-person and virtual learning environments - This broader eligibility supports students pursuing degrees, changing careers, improving their skills, or simply learning about design. ## Supporting Remote Classrooms - The shift to remote education created significant challenges for educators and students. - Figma worked with educators such as Miguel Cardona of RIT and Students Who Design to publish teaching materials and guidance for organizing online classes. - These resources cover onboarding students, structuring files, teaching remotely, and providing project feedback. ## Benefits of the Education Plan Applicants accepted into the program receive: - A free Education plan with Professional-level features. - Unlimited editors, files, and projects. - Classroom-focused templates and other teaching resources. - Access to a community of educators and students. - Invitations to virtual events and meetups. ## Collaborative Design Learning - Figma emphasizes that its browser-based, collaborative workflow fits naturally with how students already work together online. - UC Berkeley professor Eric Paulos highlighted the platform’s ability to bring rich online collaboration into visual design education. - The program reflects Figma’s broader mission of making design more accessible. Educators and students can apply for an Education plan through Figma’s education program, while feedback and ideas are welcomed through the dedicated education team.

Read original

Human Computer Interaction Figma User Experience Remote Collaboration+2

figmaJan 9, 20183 min readCurated summary

How Figma Transformed This Berkeley Design Class | Figma Blog

UC Berkeley’s CS 160 course used Figma to make digital product design more accessible to computer science students. The cloud-based tool solved problems involving incompatible devices, steep software learning curves, and limited collaboration. As a result, students spent more time applying usability principles and less time learning complicated design software. ## Challenges in Teaching Digital Design - CS 160 teaches human-computer interaction through 3–4-person teams building Android apps around themes such as healthcare and elections. - The course struggled with: - Students using Linux, Windows, Macs, or no personal computer. - Limited computer-lab solutions for incompatible software. - Adobe tools requiring substantial training. - Students with prior design experience often handled wireframing and prototyping, while others focused on coding or user testing. - Enrollment demand was high enough that the course’s original 100-student limit had to be doubled. ## Figma Made Design More Accessible - Figma was free for students and worked across different operating systems. - Its simple interface allowed students without design backgrounds to learn the basics quickly—one student reported becoming productive in about an hour. - Built-in features supported teaching: - In-context comments for instructor feedback. - Version history for reviewing progress. - Simultaneous editing by multiple students. - Integrated prototyping for presentations. - Students could focus on concepts such as Nielsen’s usability heuristics instead of spending most of their time learning Photoshop. ## More Effective Project-Based Learning - Students applied classroom lessons directly to their projects, reinforcing the concepts through practice. - One healthcare-themed team designed an app helping people with alcoholism locate nearby Alcoholics Anonymous meetings. - Figma’s quick prototyping was especially useful because teams had only about an hour of face-to-face collaboration each week. - Teachers and TAs could comment directly on relevant parts of a design rather than sending unclear, broad feedback by email. ## Collaboration Across Disciplines - Real-time editing enabled students to brainstorm, observe one another’s work, and contribute regardless of their design background. - Teams could work outside class without worrying about conflicting file versions or accidentally overwriting one another’s work. - The course used Figma to bring coding and design together, giving computer science students a more collaborative introduction to product design. Figma’s main contribution was reducing technical and logistical barriers so students could concentrate on design thinking, usability, and teamwork. For similar project-based courses, accessible cross-platform tools with real-time collaboration and contextual feedback can make design education more inclusive and effective.

Read original

Human Computer Interaction Figma User Experience Prototyping+4

figmaOct 23, 20173 min readCurated summary

Why Professors at Stanford and UC Berkeley Use Figma to Teach Design | Figma Blog

Figma argues that interface design courses need tools that minimize technical overhead so professors can focus on design principles. Its browser-based, collaborative platform is presented as accessible across devices, free for educational institutions, and easy for beginners to learn. The post concludes that these features make teaching, feedback, sharing, and group work more efficient. ## The Challenge of Teaching Interface Design - Interface design remains uncommon in college curricula, often appearing as isolated interdisciplinary courses. - Professors must teach substantial technical concepts in limited time. - Traditional design tools can be difficult and time-consuming for students to learn. ## Accessible on Any Computer - Figma runs in the browser and supports PCs, Macs, Linux systems, and Chromebooks. - Students can work anywhere with internet access, without downloading large software packages. - This helps students who do not own high-powered personal computers. ## Free for Educational Institutions - Figma’s premium version is offered free to educational institutions. - Schools do not need to negotiate expensive contracts. - The lack of cost reduces barriers for students from lower-income backgrounds. ## Easy to Learn - Figma is designed around the core functionality digital designers need. - Berkeley instructors describe it as lightweight, simple, and intuitive. - Students with no prior design experience can reportedly learn the basics in under an hour. - Professors and TAs can concentrate on design principles rather than tool training. ## Technical Support for Classes - Figma provides in-app chat support for students and instructors. - The company states that it responds within 24–48 hours on weekdays. - This reduces the technical-support burden on professors and TAs, especially in large classes. ## Always-Current, Shareable Designs - Designs are stored online and accessed through a file URL. - Instructors can view the latest version without requiring students to export or email files. - Teachers can review work or watch students design in real time. ## Feedback and Version History - Comments can be pinned directly to specific design frames. - Students can view feedback immediately and iterate without waiting for in-person meetings. - Version history shows how a design developed and helps instructors assess contributions in group projects. ## Real-Time Collaboration - Multiple students can work in the same file simultaneously. - Cloud collaboration eliminates the need to email files, manage conflicting versions, or take turns editing. - The post also introduces seamless developer handoff as another benefit, though the provided excerpt does not elaborate on it. Figma’s combination of low cost, cross-platform access, simple onboarding, collaboration, and built-in feedback makes it a practical classroom tool for teaching design fundamentals rather than software mechanics.

Read original

Human Computer Interaction Figma Collaborative Design Cloud Computing+2