Job Description

We are looking for an AI Inference Engineer to join our growing team. Our current stack is Python, C++, TensorRT-LLM, and Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference. Responsibilities: Develop APIs for AI inference that will be used by both internal and external customers. Benchmark and address bottlenecks throughout our inference stack. Improve the reliability and observability of our systems and respond to system outages. Explore novel research and implement LLM inference optimizations. Qualifications: Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX). Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.). Experience with deploying reliable, distributed, real-time model serving at scale. (Optional) Understanding of GPU architectures or experience with GPU kernel programming using CUDA. The cash compensation range for this role is $190,000 - $240,000. At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe. To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion. Equity: In addition to the base salary, equity is part of the total compensation package. Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan. Apply for this job * indicates a required field First Name * Last Name * Email * Phone * Resume/CV * Accepted file types: pdf, doc, docx, txt, rtf Website LinkedIn Profile Will you now or in the future require visa sponsorship for employment? * Select... Are you open to a hybrid work schedule (In office M-W-F) * Select... Are you located in the San Francisco Bay? * Select... Could you provide an example of an inference project that you have worked on? * Please provide a short description of the project and your responsibilities there. Do you have a proven track record of working on large-scale inference systems? * Select... Have you worked on machine learning projects for more than 4 years? * Select... Please make sure your resume reflects this. #J-18808-Ljbffr Tbwa Chiat/Day Inc

Job Tags

Similar Jobs