If the handle is difficult to insert into the roller assembly, the likely cause is paint contamination on the roller head connector or roller head, and should be cleaned thoroughly.

Also ensure the handle and roller are correctly orientated.