Job Description
Job Overview
Upstart is seeking a Senior Software Engineer for its Core GenAI Platform team, which is focused on building foundational infrastructure that democratizes access to generative AI and large language models (LLMs) across the company. The role involves designing and implementing a unified interface for interacting with LLMs, ensuring that integrations are performant, secure, and compliant. The engineer will collaborate with cross-functional teams to enhance developer productivity and streamline AI integrations.
Technical Requirements
Required Skills
- • object-oriented software engineering
- • backend development with Python
- • microservices architecture
- • Kubernetes
- • Docker
- • Terraform
- • building ML platforms
Preferred Skills
- • Full Stack development with React
- • Kotlin or Java
- • Spring framework
- • LLM toolchains (LangChain, LlamaIndex, OpenAI APIs)
- • model inference optimization
- • retrieval-augmented generation
- • vector databases
- • operationalizing LLMs
Experience Level
6+ years of experience
Responsibilities
- • Build the Core GenAI platform for generative AI use cases
- • Design and implement reliable infrastructure for model inference and data workflows
- • Drive cross-functional adoption of AI tooling through reusable components
- • Increase developer productivity through automation and metrics dashboards
- • Set the technical roadmap for platform capabilities
- • Partner with ML researchers and product engineers
Benefits & Perks
- • Competitive Compensation (base + bonus & equity)
- • Comprehensive medical, dental, and vision coverage
- • 401(k) with 100% company match
- • Employee Stock Purchase Plan (ESPP)
- • Life and disability insurance
- • Generous holiday, vacation, sick and safety leave
- • Supportive parental and family care leave programs
- • Annual wellness, technology & ergonomic reimbursement
- • Catered lunches and snacks in offices
Additional Information
- Location
-
Remote, San Mateo, Columbus, Austin
- Type
-
Full-time
- Compensation
-
$163,600—$226,400 USD