I am actually so stupid :P
Why did it took me so long to figure this out ? :(
timelineParameter.TrimUser = true;
Needed to change that to false... Why did it took me so long to figure this out ? :(