Senior Machine Learning Engineer at Zillow

You are a seasoned machine learning engineer with 6+ years of experience building and scaling large-scale data infrastructure for production environments. You p

Work type: remote

Location: Remote-USA

Salary: $171,700 – $274,300/yr

Type: Full-time

Summary

You are a seasoned machine learning engineer with 6+ years of experience building and scaling large-scale data infrastructure for production environments. You possess a deep background in agentic AI frameworks and data processing pipelines to support complex model-serving systems. **What makes it worth a look...** Zillow offers a fully remote role based in the U.S. with an annual base salary range of $171,700 to $274,300 depending on your state. Beyond the competitive pay, you will earn equity awards while working on high-impact AI infrastructure for a major real estate platform. **You might be a good fit if you...** * Have hands-on experience with agentic frameworks like LangGraph, LangChain, or Agents SDK. * Regularly use large-scale data tools such as Spark, Databricks, or Airflow. * Maintain a cloud-first approach with proficiency in AWS. * Build and manage production-grade vector stores for retrieval and ranking systems.

Job Description

## About the team

Zillow is seeking a highly experienced, product-minded Senior Machine Learning Engineer to anchor our Agentic Data Foundations team within the broader Agentic Data Platform organization. In this role, you will be the bridge between our core data platforms and the AI teams building Zillow’s next-generation customer experiences.

You will design and build the highly scalable, robust foundational infrastructure that empowers our AI teams. We need a "roll-up-your-sleeves" technical leader who thrives in ambiguity, holds a high bar for production engineering, and possesses the ability to align multiple teams around a shared technical vision.

## About the role

As a Senior Machine Learning Engineer on the Agentic Data Foundations team, you will:

• Architect and Build: Lead the design, prototyping, and deployment of scalable machine learning infrastructure that can power Zillow AI Mode.

• Bridge and Partner: Serve as a critical technical liaison between the Agentic Data Platform and applied AI teams. You will collaborate closely with scientists, engineers, and product partners to understand their dependencies and deliver the data foundations they need to innovate rapidly.

• Influence and Align: Act as a technical anchor for the team. You will drive alignment on timelines, architectures, and prioritization across different organizations, successfully influencing technical direction without requiring direct authority.

• Scale for Impact: Deploy and optimize capabilities in production environments, ensuring high availability, low latency, and efficient resource utilization capable of handling massive scale.

• Mentor and Elevate: Foster a culture of rapid innovation, frugality, and engineering excellence. You will mentor other engineers, guiding them in using the right technologies and establishing best practices.

• Distill Complexity: Translate complex ML infrastructure designs and ambiguous customer problems into clear, actionable insights for diverse audiences, including leadership and non-technical stakeholders.

In California, Connecticut, Maryland, Massachusetts, New Jersey, New York, Washington state, and Washington DC the standard base pay range for this role is $171,700.00 - $274,300.00 annually. This base pay range is specific to these locations and may not be applicable to other locations.

In Colorado, Hawaii, Illinois, Minnesota, Nevada, Ohio, Rhode Island, and Vermont the standard base pay range for this role is $163,200.00 - $260,600.00 annually. The base pay range is specific to these locations and may not be applicable to other locations.

In addition to a competitive base salary this position is also eligible for equity awards based on factors such as experience, performance and location. Actual amounts will vary depending on experience, performance and location. Employees in this role will not be paid below the salary threshold for exempt employees in the state where they reside.

## Who you are

You are a seasoned engineer who seamlessly marries state-of-the-art machine learning paradigms (LLMs, Agentic frameworks) with large-scale data engineering. You love the architectural tension of a rapidly evolving space, expertly balancing the need to ship adaptable, high-value capabilities for immediate learning against the long-term vision of scale, all without falling into the trap of premature platform building. You are a natural relationship-builder who earns trust quickly, operates with a growth mindset, and knows how to lead initiatives from the whiteboard to production.Our ideal candidate meets the following requirements:

• Experience: 6+ years of hands-on expertise building, scaling, and operating large scale data and ML infrastructure, including production-grade pipelines, feature stores, model-serving layers or end-to-end ML systems.

• Foundational ML & AI Expertise: Deep understanding of Machine Learning fundamentals and the production systems they require — data flows, serving infrastructure, observability, and evaluation. Familiarity with agentic patterns including orchestration, tool use, skill-based architectures, memory, and retrieval strategies (embeddings, hybrid search, ranking)

• Technical Stack: Proficiency with agentic AI frameworks (e.g., LangGraph, LangChain, Agents SDK), large-scale data processing (Spark, Databricks, Airflow), cloud platforms (AWS preferred), and vector stores. Python required.

• Leadership & Influence: Proven ability to build strong cross-functional relationships. You excel at leading collaborative efforts, creating buy-in for your architectural vision, and driving execution across matrixed teams.

• Exceptional Communicator: Excellent verbal and written communication skills, with a track record of clearly articulating technical trade-offs to both engineering peers and executive leadership.

• Engineering Rigor: Deep understanding of software design patterns, distributed systems architecture, and operational excellence (CI/CD, monitoring, A/B testing).

• Agility: Comfort operating in a fast-paced, sometimes ambiguous "startup-like" environment within a larger enterprise, embracing a "build, learn, and pivot" mentality.

• Advanced degree (M.S. or Ph.D.) in Computer Science, Machine Learning, or a related field.

• Experience building foundational infrastructure for agentic systems or real-time AI applications.

• Experience with regulated, private, or sensitive data at scale.

At Zillow, we’re reimagining how people move—through the real estate market and through their careers. As the most-visited real estate platform in the U.S., we help customers navigate buying, selling, financing and renting with greater ease and confidence. Whether you're working in tech, sales, operations, or design, you’ll be part of a company that's reshaping an industry and helping more people make home a reality.

Zillow is honored to be recognized among the best workplaces in the country. Zillow was named one of [FORTUNE 100 Best Companies to Work For® in 2025,](https://www.greatplacetowork.com/best-workplaces/100-best/2025) and included on the [PEOPLE Companies That Care® 2025 ](https://people.com/100-companies-that-care-list-2025-11784812)list, reflecting our commitment to creating an innovative, inclusive, and engaging culture where employees are empowered to grow.

No matter where you sit in the organization, your work will help drive innovation, support our customers, and move the industry—and your career—forward, together.

View this job on nocollar jobs