I am aware of many FedEx locations that have no perimeter fence or gates at all. There is a central station/warehouse, and 40-50 vehicles are parked outside. To enter the station, you must go to a man door, punch-in a code, and then you can enter and raise the overhead door. Again, unless your station is adjacent to a ramp, I'm not getting this angle from the TSA.
FedEx created this issue. They want to maintain the RLA exemption at ALL costs. Remember your ID card says "airline identification" all the stations have a ramp identifier code, the government has said fine, play that game and this is what will happen. If you use an airport identifier code for your location, then we will conceder it part of that ramp, and you MUST act like you are at a "real ramp" at all times.
Now FedEx does not want to provide real airport type security to these outlying stations, and that is where another situation of where FedEx abuses the employees, by trying to turn them into security guards. Fact is, at a ramp you should "challenge" someone wondering around an aircraft, however if you see some strange guy wondering through your station the ONLY action I would take would be to use my cell phone to call my manager and report it that way. Now I'm sure some managers would try to tell you it's your job to confront this person, but I would tell him I don't feel safe, and just like the active shooter video training we had, I would say I am responsible for my safety and I am leaving the area.