Introduction to Flaky Tests by Example

• freezegun

  9 3,970 6.7 Python

  Let your Python tests travel through time

Another way of doing so would be to inject the value directly to the method. Python has a very good library to sandbox the tests when using the built-in datetime objects: freezegun. Once again, and unfortunately for us, the project was using arrow so this was not a possibility.

• arrow

  1 7,467 8.0 Python

  Discontinued Better dates & times for Python [Moved to: https://github.com/arrow-py/arrow] (by crsmithdev)

  

Another way of doing so would be to inject the value directly to the method. Python has a very good library to sandbox the tests when using the built-in datetime objects: freezegun. Once again, and unfortunately for us, the project was using arrow so this was not a possibility.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• pytest-randomly

  1 583 8.3 Python

  :game_die: Pytest plugin to randomly order tests and control random.seed

  

By “chance” the tests were always run in the right order for years. This situation could have been detected way earlier by using a random execution order for tests. It happens that python has simple modules to do so.

• kevin-deldycke-blog

  2 35 8.0 Python

  :notebook: My blog, based on Pelican.

If you are curious about the context that led to the apparition of those flaky tests, my former manager Kevin Deldycke provides a more detailed view in a very interesting post: Billing Pipeline: A Critical Time Sensitive System.

Suggest a related project