Online Learning For Linearly Parametrized Control Problems