# Machine Learning Engineer (Video Foundation Models & Agentic AI) at Maxinsights Machine Learning Engineer (Video Foundation Models & Agentic AI) at Maxinsights in Santa Clara. On-site, full-time. Posted September 25, 2026. - Company: Maxinsights - Location: Santa Clara - Workplace: On-site - Job type: Full-time - Posted: 2026-09-25 - Apply: https://jobs.ashbyhq.com/maxinsights/631ee3d8-07ca-455d-b6a2-dee4d3d33a72/application - Source: https://jobmagic.ai/jobs/machine-learning-engineer-video-foundation-models-agentic-ai-maxinsights-b5vrq6 ## Requirements - Large-scale model training, fine-tuning, and distributed training optimization. - Efficient video processing, and inference acceleration. Model compression, quantization, and optimization of latency, throughput, and computational cost. - Production model serving, monitoring, and continuous performance improvement. - End-to-end optimization of model quality, reliability, and deployment efficiency. ## Description ### Job Description: **About the Team**We are building Max VLM, a next-generation video foundation model designed to understand human activities, object interactions, and the physical world through first-person video. Our mission is to develop intelligent video understanding systems that can accurately interpret complex real-world activities and turn continuous visual observations into structured, actionable information. As a fast-moving startup team, we work across the entire machine learning lifecycle, from data collection and model training to evaluation, optimization, and production deployment. We combine state-of-the-art multimodal AI technologies with real-world data and practical engineering to build scalable, reliable, and efficient AI systems.  **Project Overview & Technical Challenges**Despite rapid advances in multimodal large language models, understanding real-world video remains a challenging problem. Existing systems often struggle with fine-grained activity recognition, temporal reasoning, long-video comprehension, and computational efficiency. Our team focuses on building high-performance video foundation models and bringing them into real-world applications. Key technical directions include:   ### **1 - Video Foundation Models & Multimodal Understanding** Develop and improve video-language models capable of understanding complex human activities and physical-world interactions. - Fine-grained action recognition, temporal grounding, and video understanding. - Long-video comprehension, temporal reasoning, and event-level understanding. - Multimodal model fine-tuning, post-training, and performance optimization. - High-quality training data generation, automated labeling, and data selection. - Model evaluation, error analysis, and data-driven iteration to continuously improve production performance.   ### **2 - Efficient Model Training & Deployment** Build scalable and efficient machine learning systems that support real-world product requirements. - Large-scale model training, fine-tuning, and distributed training optimization. - Efficient video processing, and inference acceleration. Model compression, quantization, and optimization of latency, throughput, and computational cost. - Production model serving, monitoring, and continuous performance improvement. - End-to-end optimization of model quality, reliability, and deployment efficiency.  **3 - Agentic Video Understanding & Advanced Post-Training** Explore advanced AI techniques to improve video understanding and reasoning capabilities. - Develop agentic video understanding systems with autonomous tool use and multi-step reasoning. - Explore reinforcement learning and advanced post-training techniques to improve model performance. - Apply emerging AI research to real-world applications and product improvements.  **Key Responsibilities** - Design, train, fine-tune, and optimize video-language foundation models for real-world applications. - Build and improve large-scale ML pipelines covering data processing, training, evaluation, and inference. - Analyze model failures, identify performance bottlenecks, and drive continuous improvements through data and algorithmic iteration. - Develop efficient model inference and deployment solutions that balance quality, latency, and computational cost. - Collaborate closely with product and engineering teams to translate business requirements into technical solutions and deliver production-ready ML capabilities. - Explore and evaluate emerging techniques in multimodal learning, reinforcement learning, and agentic AI, applying promising advances to practical problems. - Take ownership of ML projects from problem definition and experimentation through deployment and ongoing improvement.  **Qualifications** ### **Minimum Qualifications** - Bachelor's, Master's, or PhD degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field, or equivalent practical experience. - Strong understanding of deep learning and hands-on experience with model training, fine-tuning, or inference. - Proficiency in Python and deep learning frameworks such as PyTorch. - Familiarity with modern LLMs, multimodal models, or computer vision models. - Strong problem-solving skills and the ability to independently implement, debug, and optimize machine learning systems. - Ability to work in a fast-paced environment, take ownership, and deliver practical solutions to complex problems.   ### **Preferred Qualifications** - Strong research capabilities, demonstrated through publications at top-tier conferences (e.g., NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) or other impactful research contributions. - Experience with video understanding, vision-language models, or multimodal foundation models. - Experience with LLM/VLM post-training, including SFT, reinforcement learning, or reasoning-oriented training. - Experience with distributed training, efficient inference, or production-scale ML systems. - Familiarity with agentic AI, tool-augmented reasoning, or multimodal reasoning. - Proven ability to translate novel research ideas into practical implementations and measurable improvements.   ### **Why Join Us?** - Real-World Impact: Build video AI systems that directly power real-world products and reach users through production deployment. - End-to-End Ownership: Work across the complete ML lifecycle, from data and model development to optimization and deployment, with the opportunity to own meaningful technical initiatives. - Challenging MIL Problems: Solve practical and technically challenging problems in video understanding, large-scale model training, and efficient inference. - Frontier AI Exploration: Stay close to advances in multimodal foundation models, reasoning, reinforcement learning, and agentic AI, with opportunities to apply new ideas to real-world problems. - Startup Environment: Work in a small, fast-moving team that values ownership, technical excellence, rapid iteration, and measurable impact. Default Benefits: - Health insurance - Vision care - Dental coverage - 401(k) - Paid holidays - PTO (Paid Time Off) - Sick leave