Why would it worry you?
People build hundreds of chapels and churches in the 1800's. My great, great Grandfather was a founding member of one such in Southampton. Many of these old buildings have no congregation these days but the buildings are often listed and may not be demolished. Slowly they are being converted to other uses but the external appearance often may not be changed because of their listed status. Many are still standing on "consecrated" ground, there may even be some graves to be considered.
If you really want to know about it ask at you local planning office, they will have details of any listings etc and will probably know who currently owns the property and what, if any plans, they have for its future.
IMHO far too many of these wonderful old buildings have been allowed to vanish. They are part of our heritage and whether you are religious or of the "you won't catch me worshipping sky pixies" brigade, these buildings and those that built them are our history and are what once made this country great. My recommendation would be that you simply enjoy the history and architecture that goes with it and remember that it was built by people as an expression of their faith with money raised from their own pockets over a great many years. Governments do not build such places, neither do rate payers. The old congregation will have purchased the land, all the materials and done the work with no help from anyone and often in the face of opposition from the "established" church.