The Data Platform team is at the center of Rivian’s ‘data universe’, as well as at the center of all customer-facing business processes - collecting, processing and analyzing petabytes of data from our consumer and commercial fleet.
This is what you’ll do:
You will work on Rivian’s Data Platform team as an Infrastructure Engineer and be involved in building frameworks and systems that will be used to ingest high speed data, perform stream processing and streaming analytics, store for online and batch queries to derive insights from our connected vehicle fleets.
- Build the core frameworks for messaging, stream processing, OLAP storage, visualization and data catalog
- Build and manage operators on Kubernetes
- Implement self-service observability solutions for service owners
- Implement the necessary controls for data security
- Build the necessary automation used to control highly scaled stateful services
- Work with engineering teams to identify scope, constraints and dependencies
- Identify risks and opportunities across the solution space
- Collaborate with TPMs, other engineering teams, senior engineers, and leadership as required
This is what you’ll need:
- Deep understanding of AWS service, cloud infrastructure and code pipelines
- Sound knowledge of designing and building infrastructure to support highly scalable & distributed multitenant systems
- Deep experience with Terraform, Cloud formation, or other modern infrastructure automation tools
- Experience with AWS’s big data products
- Experience owning Apache Druid, Pinot, ClickHouse or similar OLAP systems
- Understanding and experience with storage formats such as Parquet, Avro and/or Delta
- Programming in Python, Java or Scala is a plus
- Possible understanding of REST APIs and micro services
- Working knowledge of Kubernetes, EKS, ECS is a plus
- Bachelor’s Degree in Computer Science or Engineering, or equivalent experience
