removing feature from featureset and its assoicated esrifeatureset

i created my own new feature set , and then i use the

 

featureset.features.removeItem(feature);

 

it successfully removes the feature. However, it does not remove the Esri feature from the associated feature set. so when the time comes and i need to use this featureset , i use the  featureset.loadfeatures(); it actually loading all the features even the ones that i have removed