https://library.ldraw.org/library.csv is down - 500 SERVER ERROR

[tom alphin]

This is how I update the LDraw part numbers used on my LEGO Parts Guide at https://brickarchitect.com/parts/

I don't know how long it has been broken, since I haven't updated my dataset since 4/30.

[Orion Pobursky]

This is how I update the LDraw part numbers used on my LEGO Parts Guide at https://brickarchitect.com/parts/

I don't know how long it has been broken, since I haven't updated my dataset since 4/30.

Server maintenance is in progress. The library will be up and down intermittently today.

[tom alphin]

Server maintenance is in progress. The library will be up and down intermittently today.

no worries, thanks for the update.

[tom alphin]

Server maintenance is in progress. The library will be up and down intermittently today.

It seems to be down again today - is maintenance underway or is there a new problem?

Thanks in advance,
---Tom

[Orion Pobursky]

It probably related to a failed part submit that I haven't had a chance to look at yet.

[Orion Pobursky]

Fixed

[tom alphin]

Fixed

Thank you.  My import script is working again so that's good news :-)


Sincerely,
---Tom

[tom alphin]

Thank you.  My import script is working again so that's good news :-)


Sincerely,
---Tom

The library.csv page is failing to load today.  It worked earlier today.

Code:

"Warning: file_get_contents(https://library.ldraw.org/library.csv): Failed to open stream: HTTP request failed! HTTP/1.1 500 Internal Server Error"

[Orion Pobursky]

The error is now fixed.

[tom alphin]

The error is now fixed.

It works now :-)

[tom alphin]

It works now :-)

P.S. The load time has more than doubled and timed out one of the four times I tested it today.  Just wanted to let you know about the performance regression.

[Orion Pobursky]

I noticed as well. Working on it.

[Orion Pobursky]

I've implemented a stop gap solution. Since the file has gotten too bog, It's no longer a "live" look at the library. Right now it regenerates every 5 minutes. Eventually I have it generate every time parts list changes but that will take more time to code and I wanted to get a solution out now.

[Orion Pobursky]

And now the file is updating "live".  This is a queued process so there may be some lag, especially around 0000 UTC when the tracker does maintenance.

[tom alphin]

I've implemented a stop gap solution. Since the file has gotten too bog, It's no longer a "live" look at the library. Right now it regenerates every 5 minutes. Eventually I have it generate every time parts list changes but that will take more time to code and I wanted to get a solution out now.

Confirmed, it loads almost instantly now!  Thank you.

[tom alphin]

And now the file is updating "live".

I did just notice that the image_url field now has a postpended "?" text...  I do not remember it having that extra text in the past.  It does not impact my use case, but thought you should know.

ex: http://library.ldraw.org/media/ldraw/uno...1759267430

[Orion Pobursky]

It's a cache buster. Cloudflare caches our images (a good thing) but the unofficial part images change enough that the library needs to override that behavior.

[tom alphin]

It's a cache buster. Cloudflare caches our images (a good thing) but the unofficial part images change enough that the library needs to override that behavior.

That does make sense, thanks for explaining.  That said, it is also present for "official" parts - should it be removed in that case?

[Orion Pobursky]

That said, it is also present for "official" parts - should it be removed in that case?

It's a feature of the media management package being used. It on or off and since it's not hurting anything and changing that behavior to exclude a certain class of images wouldrequire some custom code, I'll just leave it on.  Also, every update has a handful of part fixes (or in the case of the last update quite a few handfuls) that regenerate the image so even the official images aren't totally static.