We are at the forefront of Artificial Intelligence and Machine Learning, building intelligent system experiences for impactful platforms such as iOS, macOS, tvOS, etc. Our system-wide intelligence provides best-in-class solutions for critical problems affecting 1st and 3rd party applications on Apple platforms. We tackle complex areas like sharing suggestions, vector indexing and search, discovering and indexing people identities, social relationships, visual recognition of people and things, OCR, natural language generation, visual generation, etc.
We seek highly skilled and creative ML practitioners with expertise in large language models (LLMs) for downstream tasks beyond language generation. Specifically, we're interested in using LLMs to reason in a multi-modal setting, combining imperfect visual perception with contextual information derived from the system. As part of the Human and Object Understanding (HOUr) team within System Intelligence and Machine Learning (SIML), we develop fundamental ML technologies and systems for visual perception and reasoning of humans-in-context.
We've made significant advancements in visual perception technologies, including real-time always-on object detection (Center Stage, Cinematic Mode), end-end system-wide person recognition (Photos, HomeKit, Memojis, Apple Pay), spoof detection (IDs in Wallet), and gaze understanding (Center Stage, intelligent cropping). Our high-level reasoning systems include sharing suggestions, inferring name-person relationships, and efficient vector indexing.
Key Requirements :
Familiarity with Python, PyTorch, TensorFlow. Delivering high-quality models is paramount. Effective communication skills are essential for collaborating across teams. Hands-on experience with LLM-based workflows: prompt engineering and parameter-efficient fine-tuning of pre-trained LLM. Experience with multi-modal settings, specifically Vision and Language. Ability to rapidly iterate with fine-tuning toolboxes. Translate high-level product goals into data, model, and metrics requirements. Awareness and attention to model complexity, power, and performance.
Description :
As a ML engineer in the SIML HOUr team, you will work closely with large-language models and multi-modal generative models, leveraging groundbreaking advancements to adapt and apply them to internal use cases. Your primary mission will be building adapters on top of large models to enable specific use cases, directly impacting features across the Apple ecosystem. This involves translating high-level product goals into different levels of the stack, from defining data needs to evaluating the model's performance and delivering it for integration.
The role will be multifaceted, requiring collaboration with ML researchers, software engineers, product designers, and other teams. You will be expected to iterate quickly to deliver high-quality models that are performant, reliable, extensively tested, and well-documented. Additionally, you will gain experience in project scoping, estimating timelines, multi-functional planning, and presenting your work to organization leadership.
Additional Expectations :
At Apple, our people are our most valuable resource. Our benefits support the well-being of our employees and their families in meaningful ways. Regardless of where you work at Apple, you can access our health and wellness resources and time-away programs. We offer stock grants to all employees and provide discounts on Apple products, allowing everyone to share in the company's success. Discover many more benefits of working at Apple, including programs that match charitable contributions, reimburse education expenses, and offer employee pricing on Apple products. Apple benefits vary by country and are subject to eligibility requirements. Apple is an equal-opportunity employer committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Apple is committed to working with and providing reasonable accommodation to applicants with physical and mental disabilities. Apple is a drug-free workplace.