Data Platform Engineer, Data Capture at Upstart

Job Description

Job Overview

Upstart is seeking a Data Platform Engineer to join its Data Engineering team, which focuses on enhancing developer tools and scalable data infrastructure. This role involves contributing to the Data Capture subdivision by expanding tools for capturing business events and improving data observability within the Lakehouse. The ideal candidate is passionate about building data products and will collaborate with various stakeholders to ensure architectural alignment with business objectives.

Technical Requirements

Required Skills

• Data Engineering
• Data Quality
• Data Infrastructure
• Python
• PostgreSQL
• Databricks
• Spark

Preferred Skills

• Algorithms and Data Structures
• Distributed Systems
• Big Data Technologies
• AWS Technologies
• DevOps Engineering

Experience Level

3+ years of experience in data engineering or related fields

Responsibilities

• Build and improve tools owned by the Capture team
• Own the service/raw layer data observability and SLAs
• Collaborate with stakeholders across various product verticals
• Participate in code reviews and architecture discussions
• Contribute to engineering best practices and mentor junior team members
• Continuously monitor and improve data platform performance, reliability, and security

Technical Environment

Languages

Python

Tools & Technologies

Databricks PostgreSQL Spark Kafka AWS Airflow Airbyte Fivetran DBT EKS Docker Kubernetes

Benefits & Perks

• Medical, dental, vision insurance
• 401k
• Target bonuses
• Equity compensation

Additional Information

Location: Remote, United States
Type: Full-time
Compensation: $142,000—$196,600 USD

About Upstart

Upstart is a leading AI lending platform partnering with banks and credit unions to expand access to affordable credit.

Company Size

unknown

Website

https://upstart.com

Skills & Technologies

AWS Big data technologies Docker Kubernetes PostgreSQL Python