Systems Engineer Input Systems

Apples vision products our head-worn compute platforms (HMD and glasses) are designed to become the fastest way to do serious detailed work when paired with Mac faster than a laptop alone. This role owns the systems architecture for fusing spatial inputs (hand wrist eye and head tracking) with the keyboard mouse and trackpad connected to Mac targeting a meaningful improvement in input efficiency without adding physical or cognitive fatigue. You will define how discrete input modalities combine into one continuous interaction model and you will be the one who proves with data that people can type point select and manipulate faster on our vision products than on any other platform while feeling just as comfortable as they do today.

As a Systems Engineer you will own the architecture that lets our vision products fuse spatial sensing with best-in-class keyboard mouse and trackpad input when plugged into Mac. Your mandate: make our vision products the worlds most efficient mechanism for detailed sustained productive will:nnDefine the system-level architecture for fusing spatial input (hand wrist eye head) with keyboard/mouse/trackpad signals into a single low-latency interaction modelnSet and validate an ambitious input-efficiency improvement target against Mac-only baselines across representative productivity tasks (text entry navigation selection precision pointing)nOwn the specification for how our vision products preserve best-in-class high-rate text input keyboard remains the backbone for speed; fusion must augment it not compete with itnBuild the measurement methodology and test harness for input efficiency (throughput error rate correction cost) and for fatigue/comfort (physical and cognitive) and treat the two as co-primary metrics no speed win counts if it costs comfortnDecompose the fused-input experience into system requirements and drive them through sensor firmware input-stack and macOS-integration teamsnPartner closely with Sense u0026 Constellation (sensor selection/config) Display Systems (latency budget) hand/eye tracking human factors and product design to land a coherent end-to-end specnRun structured human-performance studies own the resulting data and be the teams authority on whats actually faster versus what only feels faster

Bachelors degree in Electrical Engineering Computer Science Robotics Human Factors/Human-Computer Interaction or a related fieldn 6 years of experience in systems engineering HCI or input-technology roles ideally on shipped consumer hardwaren Deep experience in systems engineering for human input devices (HID) sensor fusion or human-computer interaction on shipping consumer hardwaren Experience with sensor fusion algorithms and multi-modal input systemsn Fluency in the trade-offs between input speed precision and physical/cognitive fatigue across keyboard trackpad mouse and spatial (hand/eye/head) trackingmodalitiesnTrack record of defining and driving end-to-end system requirements across sensors firmware the OS input stack and application layernComfortable owning ambiguous cross-functional problems that span hardware firmware ML/perception human factors and macOS software integrationnExcellent written and verbal communication skills with the ability to turn a fuzzy product ambition into a testable spec with clear acceptance criteria

Masters degree in Electrical Engineering Computer Science Robotics Human Factors/Human-Computer Interaction or a related fieldn Experience designing and running quantitative human-performance studies (e.g. words-per-minute Fittss-law target acquisition task completion time) and defensibly translating results into system/product requirementsn Working knowledge of fatigue and comfort measurement methods (EMG perceived exertion scales longitudinal wear studies) including evaluating physical and/or cognitive fatigue in wearable or prolonged-use hardware and how to hold comfort constant while pushing performancenExperience building or integrating novel text-entry or pointing techniques or shipping input features that combine wearable sensors with traditional peripheralsnPublications patents or shipped features in multi-modal input text entry or spatial interaction