Yes, of course! If you find value in service there, there is no reason to stop attending LDS Church services.
The LDS Church publishes as one of its articles of faith: “We claim the privilege of worshiping Almighty God according to the dictates of our own conscience, and allow all men the same privilege, let them worship how, where, or what they may” (Articles of Faith 1:11).
Therefore, you have scriptural authority to follow the doctrine of Christ and remain LDS. However, because the LDS Church has cultural, as well as membership policy expectations beyond what the scriptures require, this may be difficult at times, but it can be done. We did this for many years, and followed our membership obligations, but reached a point where we wanted to share the opportunity Christ has extended for everyone to be baptized or re-baptized (for a remission of sins, and to mark a rejection of idolatry, and to look forward to the Lord’s future return). To be honest with ourselves and others in facing the currently accepted role of a “member” in the LDS Church, we have decided that resignation was best for us so we could publish these different views without facing a fight with church leaders (3 Nephi 11:28-30). But, that may not be the situation you find yourselves in. There are many different ways to serve, and when you are in the service of your fellow beings, you are in the service of your God (Mosiah 2:17).
If you decide to tow the line between scriptures and membership obligations, part of the difficulty comes from unpublished leadership directives that confuse interpretations of membership requirements and temple questions. An overly strict LDS leader can mean the difference between having a challenging experience versus a pleasant one.
If situations like that arise, remember what the Lord said in his Sermon on the Mount, reiterated to the Nephites: “And blessed are all they who are persecuted for my name’s sake, for theirs is the kingdom of heaven” (3 Nephi 12:10, Matthew 5:10).
Likewise, there are many good men in the Priesthood who belong to the LDS Church, who haven’t consented to the excommunication of the innocent, and who haven’t condemned or “wrested” the scriptures (see Alma 41:1). These righteous men can still perform authoritative ordinances if they follow the Lord’s pattern in all things. Their individual power in the Priesthood is the true authority to do things on behalf of the Lord (D&C 121:34-46).
Other answers on this site will likely address more about the Lord’s pattern in ordinances, and how a minister of Christ gains power in his Priesthood.