Perihelion Summer[0] by Greg Egan is a great story with a similar premise (A black hole passing by the solar system and affecting earth's orbit)

[0]: https://amzn.to/3DNiUDj