How Roblox Reduces Spark Join Query Costs With Machine Learning

Abstract Every day on Roblox, 70 million users engage with millions of experiences, totaling 16 billion hours quarterly. This interaction generates a petabyte-scale data lake, which is enriched for analytics and machine learning (ML) purposes. It’s resource-intensive to join fact and dimension tables in our data lake, so to optimize this and reduce data shuffling, […]

Cost Based Optimizer in Apache Spark 2.2, by Jules S. Damji, Databricks Engineering

TPCx-BB (Big Bench) in a Single-Node Environment

DATA… OUR MOST CRITICAL RESOURCE

Spark SQL Query Engine Deep Dive (11) – Join Strategies – Azure Data Ninjago & dqops

PDF) The Optimization of Cost-Model for Join Operator on Spark SQL Platform

Spark SQL Query Engine Deep Dive (11) – Join Strategies – Azure Data Ninjago & dqops

The art of joining in Spark. Practical tips to speedup joins in…, by Andrea Ialenti

ROBLOXRSS (@ROBLOXRSS) / X

The secret to reduce Spark applications costs, by P Platter, Agile Lab Engineering

Roblox on LinkedIn: How Roblox Reduces Spark Join Query Costs With Machine Learning Optimized…

What I Learned From Attending Tecton's apply() Conference — James Le

How Concur uses Big Data to get you to Tableau Conference On Time