Read on Twitter
You know the best way to nerd snipe a tester? Say "Test fails for an unknown reason."
Context: I've been poking around the LibrePCB issues, looking for something I could maybe help with... and found this: https://github.com/LibrePCB/LibrePCB/issues/718
Which then lead me to this:
https://github.com/LibrePCB/LibrePCB/blob/59be81367912a18e01af63197739415f5e8e2d65/tests/funq/librarymanager/test_create_local_library.py#L13
https://github.com/LibrePCB/LibrePCB/blob/59be81367912a18e01af63197739415f5e8e2d65/tests/funq/librarymanager/test_create_local_library.py#L13
So... of course.. I installed VirtualBox, installed macOS Catalina, set up a dev environment, checked out and compiled the code, ran the tests, and reproduced the same test failure... (Never mind the fact I've never debugged a Qt app before...)
Looking at the source code... It's automating the "Create Library" widget. It's supposed to fill out the form, click the "Create library" button... and verify that count of projects has increased by one. But the count doesn't increase, so the test fails...
I noticed that right before the test reported the failure, the UI window was still on screen... So on a hunch, I wondered what would happen if I clicked the button myself while the test was running (after the data is entered, but before the test timeout...)
HUZZAH! I *GOT* YOU, YOU LITTLE PUNK.
*Okay, I didn't actually "get" the little punk. I've only found a way to get the punk off my lawn temporarily, metaphorically speaking. *BUT*, I now know the exact pivot point where things start going down hill.
This is where I'm at now... (Sorry, to end this thread on a cliff-hanger.) Now I have a few things to try: First guess was that this was "just" timing issue. But adding a sleep command before the button click didn't work, so I'll need to keep digging...
Side-note: everything about the @LibrePCB project is *lovely*. It has detailed documentation, a functional and well-maintained build system, loads of unit tests, and all the dependencies are clearly labeled. It's a dream project to dive into...
