Followup issue for ghost resource handling

See issue on specific situations, in fabric8 client there might be improvements coming so we don't have to use timer in the implementation.
https://github.com/operator-framework/java-operator-sdk/issues/3208

Fabric8 issue: https://github.com/fabric8io/kubernetes-client/issues/7550