Your duty

You have to do things ("your duty") in your life.  Anything.  From the giant to the mundane.  When you complete a task, simply let the things you did just drop from you.  They are not indelible.  They do not define you forever.  Nothing is forever. If they are to bear fruit, they will.  You are there to just put the pieces in the right place so that the outcome you desire is more likely to occur.  Don't continue thinking/wondering/worrying if your actions will bear fruit or not.  The fruit is the thing you did coming to fruition, not you or something you control.  Simply do your duty and move on.  If fruit is to be born from the performance of your duty, then it will be born and so be it.  If fruit is not to be born from the performance of your duty, then it will not be born and so be it.  Reread Bhagavad Gita about this concept.