Senior Machine Learning Engineer, Computer Vision – Robotics

San Francisco, California
Scale AI
Overview

Scale’s Robotics business unit is dedicated to solving the data bottleneck in Physical AI. This position will be a key contributor in conducting applied research in Robotics and developing ML pipelines for training and fine-tuning on data collected by Scale. In this role, you will have the opportunity to advance Robotic research, shape Scale’s robotics offerings, and expand the frontier of Robotics data and model evaluation.

You will

• Pioneer Core CV Algorithms: Lead the research, design, and implementation of novel computer vision and deep learning algorithms, with a specialized focus on 2D and 3D data (e.g. point clouds).
• Focus Area Expertise: Drive innovation in key perception areas, including:
  • 3D Reconstruction and SLAM: Real-time 3D mapping, pose estimation, and environmental modeling from multi-modal sensor inputs (e.g., RGB-D, LiDAR).
  • Hand/Body Tracking: Models for hand pose estimation, gesture recognition, and full-body tracking under varying lighting and occlusion.
  • Object Detection and Tracking (MOT/SOT): High-performance models for detection and persistent tracking of objects and people in video streams.
  • Video Processing: Temporal feature extraction, video-based action recognition, and motion analysis.
• Model Optimization: Optimize computationally intensive models for deployment on edge devices (low power, low latency) and/or large-scale cloud infrastructure.
• Technical Leadership: Serve as the subject matter expert in Computer Vision, providing technical direction and mentorship to junior engineers and cross-functional teams.
• Publication & IP: Maintain state-of-the-art knowledge, evaluate recent academic publications, and drive the filing of patents and publication of novel research.
• Cross-Functional Partnering: Collaborate with Software Engineering, Product, and Hardware teams to define requirements, integrate vision systems, and meet performance targets.

You have

• Ph.D. in Computer Science, Computer Engineering, or a related quantitative field (Mathematics, Electrical Engineering, etc.) OR a Master’s degree with 4+ years of equivalent professional experience in an applied research setting.
• 5+ years of hands-on experience in algorithm development for 2D/3D computer vision and deep learning.
• Deep Learning Frameworks: Proficiency in at least one major deep learning framework (PyTorch, TensorFlow or Jax).
• Programming: Mastery of Python for machine learning and strong proficiency in C++ for performance-critical algorithm implementation.
• 2D/3D Fundamentals: In-depth knowledge of classical and modern computer vision fundamentals, including multi-view geometry, projective geometry, camera calibration, and 3D graphics/rendering principles.
• Building real-time and batch ML systems that analyze structured and unstructured signals.
• Hands-on experience rapidly prototyping and iterating on ML systems with changing requirements.

Nice to have

• Deep Learning Frameworks: Proficiency in PyTorch, TensorFlow or Jax.
• Programming: Python for ML and C++ for performance-critical implementation.
• 2D/3D Fundamentals: Computer vision fundamentals including multi-view geometry, camera calibration, and 3D rendering principles.
• Building real-time and batch ML systems that analyze structured and unstructured signals.
• Hands-on experience prototyping and iterating on ML systems with changing requirements.

Compensation and benefits

Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position, determined by work location and additional factors, including job-related skills, experience, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity-based compensation, subject to Board approval. You’ll also receive benefits including health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. This role may be eligible for additional benefits such as a commuter stipend.

Location and salary

The base salary range for this full-time position in the location of San Francisco is: $218,400-$273,000 USD

Notes

PLEASE NOTE: Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.

About Us

At Scale, our mission is to develop reliable AI systems for the world’s most important decisions. Our products provide the high-quality data and full-stack technologies that power the world’s leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work with industry partners and government agencies to accelerate the development of AI applications.

Equal opportunity

We are an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status.

Accessibility

We are committed to providing reasonable accommodations to applicants with disabilities. If you need assistance in the application process, please contact . Please see the United States Department of Labor Know Your Rights poster and Pay Transparency provisions for additional information. We collect, retain and use personal data for our professional business purposes in accordance with our privacy policy.