You Do Not Need a Bigger Boat: Recommendations at Reasonable Scale in a (Mostly) Serverless and Open Stack

Code

• github.com/jacopotagliabue/metaflow-intent-prediction
  OfficialIn papertf★ 873
• github.com/jacopotagliabue/you-dont-need-a-bigger-boat
  tf★ 873

Abstract

We argue that immature data pipelines are preventing a large portion of industry practitioners from leveraging the latest research on recommender systems. We propose our template data stack for machine learning at "reasonable scale", and show how many challenges are solved by embracing a serverless paradigm. Leveraging our experience, we detail how modern open source can provide a pipeline processing terabytes of data with limited infrastructure work.

Tasks

Reproductions