Please start the LoRA weight from 0.1 and incrementally increase it by 0.01. Do not exceed 0.2, as going above 0.2 will cause overfitting. Every 0.01 increase in weight will affect the image. (Some checkpoints allow weights higher than 0.2, so please adjust the weight based on the checkpoint you are using.)