@sh58233857
GailL has given you her usual excellent advice. I will add my own 2 cents.
My first cent:
It sounds as though you are already receiving your retirement benefits but are thinking that perhaps the SSA is coming up a bit short in them. That's understandable, how ones retirement benefit is calculated is a bit technical.
You mention that you did work those 4 years out of the last 50 years. Now I realize that I am a bit confused. I took this to mean that you actually worked at employment for 50 years but that the SSA (Social Security Administration) had no record of 4 of those years. Am I mistaken in your working 50 years?
In fact, just to clarify, are you drawing benefits on your own work records or spouse's (living or deceased)?
In any case, if you did work those full 50 years (a very long career!) let's consider that:
1 - were all of your jobs covered under Social Security? Some types of jobs were not covered and may still not be covered (I think this may include wait staff and a number of others).
2 - More importantly, the 46 or 50 years of working (if I understand correctly) is a moot point. It (likely) doesn't matter as far as your benefit goes. Your SS benefit is determined by using the 35 years of highest earnings. So if you worked 36 or 40 or 46, it doesn't matter (unless those were high-earning years). If someone does not have a full 35 years' worth of covered earnings then for benefit calculation purposes the "blank" years are treated as "0" income and will cause the calculated benefit to be smaller than otherwise.
When calculating the SS benefit those 35 years' earnings are manipulated through some fancy calculations with standard inflation factors, etc, to come up with some standardized number. This is further manipulated by using two of what they call "bend points", which serve to give lower-earning workers a higher proportion of their working income than is given to higher-earning workers.
Note that if you took your SS benefit at an age younger than your "Full Retirement Age" (FRA) then your benefit is reduced as well, the amount depends on how many years/months early you take it. It can be a pretty large reduction.
Your benefit can be independently calculated to confirm or verify the benefit you actually receive. There are calculators available on the SSA website (though they may not give you the calculation details). There are also free and pay-for calculators available on the internet, many of which will show the gory details of the calculation (I myself have used spreadsheets to check mine and I also use the free anypia32 software program published by the SSA).
To perform these double check calculations you will need a record of your earnings history. This history is available to you on the "My Social Security" account that Gail told you about.
My second cent:
Yes, some people are grumpy when you try to work with them. Maybe it's just their day to be grumpy or maybe they're grumpy all the time. Sometimes it's just the interaction between the two personalities that rubs one or the other or both the wrong way (I have been in a few such situations).
Fortunately, you can always call back and wait to get someone else. Although as it's possible that they keep a record of your SSN when you call this may not be viable too many times. It's best to try to educate yourself first on how the benefit is calculated and then if you still disagree make further investigations with the SSA.
A third cent:
Here are some sites that give some guidance on how the benefit is calculated:
https://www.ssa.gov/pubs/EN-05-10070.pdf
https://www.fool.com/retirement/2018/05/26/heres-how-the-social-security-retirement-benefit-f.aspx
https://opensocialsecurity.com/
https://www.aarp.org/work/social-security/social-security-benefits-calculator.html
If you still have questions on "how" the benefit is calculated, come back with further info and questions.