Throttling REST requests in C#

Question

I'm rather new to C#, and found relevant subclassing examples surprisingly hard to come by. I've whipped up this class that appears to work, but am pretty sure this is not optimal:

private class ThrottledRestClient
{
    int pause;  // mininum ms between requests
    double rpm;  // max requests per minute
    long last_request_time;
    RestClient client;
    public ThrottledRestClient(string url, HttpBasicAuthenticator auth, double rpm = 60)
    {
        this.client = new RestClient(url);
        this.client.Authenticator = auth;
        this.rpm = rpm;
        this.pause = (int)((60 / rpm) * 1000);
    }

    public IRestResponse Execute(RestRequest request)
    {
        long now = DateTime.Now.Ticks;
        int wait = pause - (int)((now - this.last_request_time) / TimeSpan.TicksPerMillisecond);
        if (wait > 0)
        {
            //Console.WriteLine("Waiting ms: " + wait);
            Thread.Sleep(wait);
        }
        this.last_request_time = DateTime.Now.Ticks;

        return this.client.Execute(request);
    }
}

How could this be better? Is there an existing solution I haven't found?

Sync, but I'm running batches of things that don't depend on each other. — Cees Timmerman
– Cees Timmerman, Commented Jan 23, 2015 at 15:05
this is not thread safe. several thread will update and read last_request_time concurrently — skyde
– skyde, Commented Mar 10, 2017 at 22:59

Bruno Costa · Accepted Answer · 2015-01-26 10:40:47Z

I'm rather new to C#, and found relevant subclassing examples surprisingly hard to come by

You just needed to try a bit harder! You are doing pretty much what you were supposed to do logic wise. What you are trying to do here obviously (maybe), is a specialization of a RestClient, so the RestClient class is the best candidate to inherit from. From there you may override the Execute method.

Don't be afraid to use verbose variables. The rpm name could be firstly reminded as rotations per minute which doesn't really apply here. Also try to name your instances fields in camelCase, you may or may not prefix them with _.

I also didn't get why your pause is (60 * 1000) / rpm = 1000 with the default rpm, but one thing I know is that you don't need to store it in a field because it may be calculated. I would also recommend using Environment.TickCount instead of DateTime.Now.Ticks, which is more performant.

With those modifications the code would become the following:

public class ThrottledRestClient : RestClient
{
    private readonly int _requestsPerMinute;
    private int _lastRequestTime;

    public ThrottledRestClient(int requestsPerMinute)
    {
        _requestsPerMinute = requestsPerMinute;
    }
    public override IRestResponse Execute(IRestRequest request)
    {
        int elapsedTime = Environment.TickCount - _lastRequestTime;
        int pause = (60/_requestsPerMinute)*1000;
        int wait = pause - elapsedTime;
        if (wait > 0)
        {
            Thread.Sleep(wait);
        }
        var response = base.Execute(request);
        _lastRequestTime = Environment.TickCount;
        return response;
    }
}

EDIT: To answer you comment. You can use this client like you would use the previous one eg:

var client = new ThrottledRestClient(60);
client.Authenticator = new HttpBasicAuthenticator("user", "password");
//so on so forth;
client.BaseUrl = "http://google.pt";
client.Request(new RestRequest());

I used 60 / rpm in case the API specified something else, e.g. 1 request per minute, so the pause would then be 60000. I don't see why you mention a more performant alternative yet keep calculating the pause. — Cees Timmerman
– Cees Timmerman, Commented Jan 26, 2015 at 8:40
@CeesTimmerman Gotcha. I was referening to Environment.TickCount. This Tickcount is more suitable to calculate an epalsed time then DateTime.Now.Ticks. — Bruno Costa
– Bruno Costa, Commented Jan 26, 2015 at 8:44
Indeed it is. Strange that C# uses two different concepts named Tick. — Cees Timmerman
– Cees Timmerman, Commented Jan 26, 2015 at 8:47

Community · Accepted Answer · 2017-04-13 12:40:41Z

2

You might want a Generic throttling class see : Throttling class

var throttler = new Throttler(_requestsPerMinute, TimeSpan.FromMinutes(1));

And in your request processing simply call throttler.ThrottledWait(1);

public override IRestResponse Execute(IRestRequest request)
{
    throttler.ThrottledWait(1);
    return base.Execute(request);
}

edited Apr 13, 2017 at 12:40

CommunityBot

1

answered Apr 10, 2017 at 17:26

skyde

1931 silver badge9 bronze badges

\$\begingroup\$ Is this thread-safe? \$\endgroup\$

Cees Timmerman
– Cees Timmerman

2017-04-11 09:01:36 +00:00
Commented Apr 11, 2017 at 9:01
\$\begingroup\$ @Cees Timmerman yes the Throttler class is thread-safe \$\endgroup\$

skyde
– skyde

2017-04-20 21:16:15 +00:00
Commented Apr 20, 2017 at 21:16

Add a comment |

Stack Exchange Network

Throttling REST requests in C#

2 Answers 2

You must log in to answer this question.

Linked

Hot Network Questions

Throttling REST requests in C#

2 Answers 2

You must log in to answer this question.

Linked

Related

Hot Network Questions