Adaptive Algorithms For Dynamic Decision-Making: Bridging Online Learning And Non-Parametric Regression