If you have a hand or foot layer parented to the end controller, that layer won't follow the end of the limb when you dial up FK. The solution is to click Add FK to generate a new FK controller, and parent your hand or foot to this layer instead. If you make sure the FK is set to zero before you click Add FK, Limber automatically does the re-parenting for you.
Joint controllers follow the position of the limb joint, should you need something to parent knee or elbow artwork to. The Joint controller has it's own Limber Joint effect on it with four rotation options. None will make the controller always point downwards at 0º. Outwards will align the controller to the direction the joint itself points towards. With Lower will aim it towards the end controller, and With Upper will aim it directly away from the Start Controller. With Lower and With Upper rotations do not respond to Bone Curvature values, they behave as if the limb were two, straight sections.
You cannot remove FK and Joint controllers by simply deleting them. Instead, you'll need to Alt-click on the respective Add button, with one or more layers from the set selected. If you remove an FK Controller when FK is set to zero, Limber will automatically re-parent any child layers to the relevant end controller. You cannot remove Start and End controllers.