2026-01-04 15:04:13.535174 Optimization: repartition(200) + sortWithinPartitions(click_count desc) AdaptiveSparkPlan isFinalPlan=false +- TakeOrderedAndProject(limit=100, orderBy=[total_clicks#190L DESC NULLS LAST], output=[page#189,total_clicks#190L]) +- HashAggregate(keys=[source_page#184], functions=[sum(click_count#187)], output=[page#189, total_clicks#190L]) +- Exchange hashpartitioning(source_page#184, 200), ENSURE_REQUIREMENTS, [plan_id=1776] +- HashAggregate(keys=[source_page#184], functions=[partial_sum(click_count#187)], output=[source_page#184, sum#193L]) +- Exchange RoundRobinPartitioning(200), REPARTITION_BY_NUM, [plan_id=1771] +- FileScan parquet [source_page#184,click_count#187] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/mnt/c/Users/rania/OneDrive/Documents/Projet/outputs/project/silver], PartitionFilters: [], PushedFilters: [], ReadSchema: struct