Problem with Interval Trigger in Background Scheduler

[sri-dhurkesh]

I am currently working on Algorithmic trading and I am using an API to retrieve data every second. The API request takes approximately 300ms. However, I am experiencing an issue where the background scheduler with an interval trigger is skipping some time. Specifically, on average every 20 seconds, I receive a warning that states " skipped: maximum number of running instances reached." I have tried using a different scheduler library, the schedule library, and it works without skipping any time. I suspect that this issue may be caused by thread overload, but I am not certain. Can anyone provide guidance on how to solve this problem? Below is the code for the scheduler that I am currently using:

scheduler.add_job(id="Monitor", func=get_data, trigger="interval", seconds=1, coalesce=True, timezone="Asia/Kolkata")

Note: I am not able to increase the max instance.Because it is a synchronous process.

[agronholm]

Have you tried setting a more lenient misfire_grace_time?

[sri-dhurkesh]

Does the schedule library place any restrictions on how many instances of a scheduled task can be running at once? What I'm asking is whether you actually measured the time taken by the target function.

Yeah @agronholm , I actually measured the time taken to run the target function for every second using both apschduler and schedule library. In schedule library, it always takes around 200 ms.

[agronholm]

Ok, can you construct a trivial script that reproduces the issue, substituting get_data() with sleep() (with an argument of 0.2)?

[sri-dhurkesh]

You're not answering my questions. If the function cannot complete before the next scheduled run, you will get a warning like above.

I got like skipped: maximum number of running instances reached.. There no error other than this

[sri-dhurkesh]

Ok, can you construct a trivial script that reproduces the issue, substituting get_data() with sleep() (with an argument of 0.2)?

Okay, I'll create a script will post it ASAP.

[agronholm]

How's that going?