LDCad Set PBG generator


LDCad Set PBG generator
#1
I finished entering all 526(!) torso assemblies (out of a possible 3700ish) into the cross reference file, I've moved the Set PBG generator out of experimental status.

New url is:
https://www.ldraw.org/downloads-2/pbg-generator.html

My next project is hips assemblies then Minidoll torso and leg assemblies followed by Technic action figures. I may sprinkle in other assemblies as I find them.

As always, If you find bugs or oddities, please post them here. If you find a misnumbered single file that's not part of an assembly, submit a change request at Rebrickable.

The current crossref file can always be found here:
https://www.ldraw.org/common/data/pbg_crossref.csv
Reply
RE: LDCad Set PBG generator
#2
(2020-05-28, 0:08)Orion Pobursky Wrote: I finished entering all 526(!) torso assemblies (out of a possible 3700ish) into the cross reference file, I've moved the Set PBG generator out of experimental status.

New url is:
https://www.ldraw.org/downloads-2/pbg-generator.html

My next project is hips assemblies then Minidoll torso and leg assemblies followed by Technic action figures. I may sprinkle in other assemblies as I find them.

As always, If you find bugs or oddities, please post them here. If you find a misnumbered single file that's not part of an assembly, submit a change request at Rebrickable.

The current crossref file can always be found here:
https://www.ldraw.org/common/data/pbg_crossref.csv

As it happens, a certain level of privileges is needed to submit change requests to RB, which I don't personally have. That's fine with me, but I just thought I'd make note of it.

But the tool looks good and seems to work well, so cheers there!
Reply
RE: LDCad Set PBG generator
#3
(2020-05-28, 0:57)N. W. Perry Wrote: A certain level of privileges is needed to submit change requests to RB

It really takes very little effort to get to that point. I started because I want to submit a set list and it took me no time adding some of my sets and following MOC builders.

That said, if this doesn't interest you, just post your changes here and I'll submit them.
Reply
RE: LDCad Set PBG generator
#4
Do you know if they are scanning our library?
Most of the set I have looked at have bad info on the patterned parts. It looks like Rebrickable assume a ldraw pattern number based on their own numbering system. Why should we push lots of change request to them when they should be pulling info from us?
All of the printed parts to the Minion set 75551 are made, but non of them have correct number at RB.

Is there a way to get stickers and/or stickered parts included in this generator?
A set list is not complete without the sticker sheet numbers.
Reply
RE: LDCad Set PBG generator
#5
(2020-05-29, 8:51)Magnus Forsberg Wrote: Do you know if they are scanning our library?
Most of the set I have looked at have bad info on the patterned parts. It looks like Rebrickable assume a ldraw pattern number based on their own numbering system. Why should we push lots of change request to them when they should be pulling info from us?
All of the printed parts to the Minion set 75551 are made, but non of them have correct number at RB.

Yes, they are in a limited sense. Patterns are hard since they have to be manually matched. I've submitted somewhere in the realm of 400 entries to their database for just patterns.

Also, for the set you've mentioned, all of those parts are unofficial. For patterns I've been focusing on just the one's in the official library before moving on to the PT.

(2020-05-29, 8:51)Magnus Forsberg Wrote: Is there a way to get stickers and/or stickered parts included in this generator?
A set list is not complete without the sticker sheet numbers.

Funny you mention stickers since I just started with cross referencing stickers (while I think about how I'm going to approach hip assemblies which aren't as straight forward as torsos were). Sticker sheets would be considered "assemblies". This means they'll have to be added to the crossref file.
Reply
RE: LDCad Set PBG generator
#6
(2020-05-28, 1:29)Orion Pobursky Wrote: It really takes very little effort to get to that point. I started because I want to submit a set list and it took me no time adding some of my sets and following MOC builders.

That said, if this doesn't interest you, just post your changes here and I'll submit them.

Oh yeah, I'm sure it'll just happen at some point without my even realizing it. Wink
Reply
RE: LDCad Set PBG generator
#7
(2020-05-29, 14:22)Orion Pobursky Wrote: Yes, they are in a limited sense. Patterns are hard since they have to be manually matched. I've submitted somewhere in the realm of 400 entries to their database for just patterns.

I was going to add, most of the errors I run into do seem to be wrong pattern codes. That suggests to me it might be more an issue of how they track these parts in their database, rather than requesting changes case-by-case.
Reply
RE: LDCad Set PBG generator
#8
(2020-05-29, 15:40)N. W. Perry Wrote: I was going to add, most of the errors I run into do seem to be wrong pattern codes. That suggests to me it might be more an issue of how they track these parts in their database, rather than requesting changes case-by-case.

I'm not doing case by case any more. I've been in contact with the database admins and I send them batch edit in the form of CSV files.
Reply
RE: LDCad Set PBG generator
#9
(2020-05-29, 14:22)Orion Pobursky Wrote: Funny you mention stickers since I just started with cross referencing stickers (while I think about how I'm going to approach hip assemblies which aren't as straight forward as torsos were). Sticker sheets would be considered "assemblies". This means they'll have to be added to the crossref file.

Stickers are in the crossref. Not all the entries are correct because not all sticker sheets are in the Rebrickable data nor are they numbered consistently. Also, since Rebrickable doesn't assign a color to the sheets, I've assumed the color white for everything. This can be changed as I manually research each sheet.
Reply
RE: LDCad Set PBG generator
#10
(2020-05-29, 17:45)Orion Pobursky Wrote: Stickers are in the crossref. Not all the entries are correct because not all sticker sheets are in the Rebrickable data nor are they numbered consistently. Also, since Rebrickable doesn't assign a color to the sheets, I've assumed the color white for everything. This can be changed as I manually research each sheet.

All the stickers in our library that are also cataloged at RB are now properly cross-ref'd with the proper color (White, Trans-Sticker, or (in one instance) Chrome Silver). I did my best so if you find a sticker group with the wrong color, let me know and I'll change it.
Reply
RE: LDCad Set PBG generator
#11
Thank you so much for this exporter.  Smile I really appreciate the new UI and UX. Smile 

Testing set 70618 again, I only wonder at some parts that are reported to be "not found in the official library or on the Parts Tracker" like 25375 (tassel, LDraw already has the base parts in the official library but composed base parts are on the parts tracker) and 25111 (sword, Rebrickable seems to have a LDraw-rendered image of unknown source: the referenced LDraw number does not exist and I could not find any sword with my limited search abilities). Is this something at Rebrickable?

(2020-05-18, 15:47)Orion Pobursky Wrote: Thanks for the offer.

I think this is a topic for a separate thread but here's what I want help on: the format for the cross ref file. I keep changing my mind on how I want to structure it. I think some input from other developer will help me finalize things. That said, I strongly prefer it be JSON (or XML if you twist my arm).
I don't know if this is the separate thread. Wink  But I like to sustain my offer to support in any way (I dislike XML, too). Smile
Reply
RE: LDCad Set PBG generator
#12
(2020-06-01, 1:20)Stefan Frenz Wrote: 25375 (tassel, LDraw already has the base parts in the official library but composed base parts are on the parts tracker) and 25111 (sword, Rebrickable seems to have a LDraw-rendered image of unknown source: the referenced LDraw number does not exist and I could not find any sword with my limited search abilities). Is this something at Rebrickable?

I just submitted a change request for 25375 to point it to 25375-f1

The render for 25111 is probably the raw LDD data.

(2020-06-01, 1:20)Stefan Frenz Wrote: I don't know if this is the separate thread. Wink  But I like to sustain my offer to support in any way (I dislike XML, too). Smile

I decided to go with something much simpler: a CSV file. It's much easier to work with as I can do work in a spreadsheet and just export as CSV. The location to the file the generator uses is given above.
Reply
RE: LDCad Set PBG generator
#13
Update on the crossref.

The hips and legs are currently undergoing revision on the PT. I'm going to hold off including them until they are official.

As for Technic action figures, The only parts that change are the heads and torsos. I was thinking of including the Complete shortcut (that can be inlined) and the appropriate head/torso as loose parts.  Thoughts?
Reply
RE: LDCad Set PBG generator
#14
(2020-06-11, 0:27)Orion Pobursky Wrote: As for Technic action figures, The only parts that change are the heads and torsos. I was thinking of including the Complete shortcut (that can be inlined) and the appropriate head/torso as loose parts.
Sorry, not sure to understand what you intend to do exactly?
Reply
RE: LDCad Set PBG generator
#15
(2020-06-11, 0:27)Orion Pobursky Wrote: I was thinking of including the Complete shortcut (that can be inlined) and the appropriate head/torso as loose parts.  Thoughts?
Maybe for the non-technic-figures the assemblies could be done in the same way? I would love to have the figures "done already" in some way as I (personally) prefer building the sets - building/assembling the figures is not my favored action, so I would prefer "having" figures instead of "building" them. Wink
Reply
RE: LDCad Set PBG generator
#16
(2020-06-11, 7:31)Stefan Frenz Wrote: Maybe for the non-technic-figures the assemblies could be done in the same way? I would love to have the figures "done already" in some way as I (personally) prefer building the sets - building/assembling the figures is not my favored action, so I would prefer "having" figures instead of "building" them. Wink

This would be awesome but is beyond the scope of this project. Although, an enterprising person could use the cross ref file and the new minifig feature of Rebrickable to do just this.
Reply
RE: LDCad Set PBG generator
#17
(2020-06-11, 5:53)Philippe Hurbain Wrote: Sorry, not sure to understand what you intend to do exactly?

So basically for torso assemblies, I replace the Rebrickable entry with the appropriately patterned torso, left and right arms, and 2 hands. The Technic action figure, however, is significantly more parts, most of which don't change. Therefore, I think the best solution is to replace the Rebrickable entry with Technic Action Figure shortcut (2698c01) in the dominant color, the appropriately patterned torso (2698pXX), and the appropriately patterned head (2707pXX). 2698c01 can then be inlined and the head and torso replaced with a double click.
Reply
RE: LDCad Set PBG generator
#18
Got it. Yes, I think it's a good solution...
Reply
RE: LDCad Set PBG generator
#19
(2020-05-28, 0:08)Orion Pobursky Wrote: I finished entering all 526(!) torso assemblies (out of a possible 3700ish) into the cross reference file, I've moved the Set PBG generator out of experimental status.

New url is:
https://www.ldraw.org/downloads-2/pbg-generator.html

My next project is hips assemblies then Minidoll torso and leg assemblies followed by Technic action figures. I may sprinkle in other assemblies as I find them.

As always, If you find bugs or oddities, please post them here. If you find a misnumbered single file that's not part of an assembly, submit a change request at Rebrickable.

The current crossref file can always be found here:
https://www.ldraw.org/common/data/pbg_crossref.csv
Found a problem with 298c02 part :
For example set 76042-1 or 7236-1 have 2 of it but in the export there are only 1x4592 +1x4593.

When 298c02 is exported in 2 sub parts (i prefer this solution), why 2429c01 is not ?
Reply
RE: LDCad Set PBG generator
#20
(2020-05-28, 0:08)Orion Pobursky Wrote: I finished entering all 526(!) torso assemblies (out of a possible 3700ish) into the cross reference file, I've moved the Set PBG generator out of experimental status.

New url is:
https://www.ldraw.org/downloads-2/pbg-generator.html

My next project is hips assemblies then Minidoll torso and leg assemblies followed by Technic action figures. I may sprinkle in other assemblies as I find them.

As always, If you find bugs or oddities, please post them here. If you find a misnumbered single file that's not part of an assembly, submit a change request at Rebrickable.

The current crossref file can always be found here:
https://www.ldraw.org/common/data/pbg_crossref.csv

Great work Orion. This a a VERY useful tool!
Jaco van der Molen
lpub.binarybricks.nl
Reply
RE: LDCad Set PBG generator
#21
(2020-06-11, 18:09)Marc Giraudet Wrote: Found a problem with 298c02 part :
For example set 76042-1 or 7236-1 have 2 of it but in the export there are only 1x4592 +1x4593.

That is indeed a bug but not a serious one. The cross ref code doesn't take quantity into account but LDCad doesn't do anything with quantity at the moment so it shouldn't affect the ability to use the PBG effectively. I'll push a change shortly.

(2020-06-11, 18:09)Marc Giraudet Wrote: When 298c02 is exported in 2 sub parts (i prefer this solution), why 2429c01 is not ?

This is because the two parts of 2429c01 never come as different colors. Therefore it is trivial to add the part to the model and then inline it.
Reply
RE: LDCad Set PBG generator
#22
(2020-06-11, 18:19)Orion Pobursky Wrote: That is indeed a bug but not a serious one. The cross ref code doesn't take quantity into account but LDCad doesn't do anything with quantity at the moment so it shouldn't affect the ability to use the PBG effectively. I'll push a change shortly.


This is because the two parts of 2429c01 never come as different colors. Therefore it is trivial to add the part to the model and then inline it.
I agree it's not a serious one.
About quantity in LDCad, I use 2 part bin to check inventory of official model after finishing. I found the issue when I check my latest set (76042).
Today I check one by one but maybe LDCad could proposed further an automatic check. Or a new part bin "dynamic" like a box, the number of part decreased when you put a part in the model (at the end, easier to found parts).

Thanks for the explaination of the colour.
Reply
RE: LDCad Set PBG generator
#23
(2020-06-11, 18:19)Orion Pobursky Wrote: That is indeed a bug but not a serious one. The cross ref code doesn't take quantity into account but LDCad doesn't do anything with quantity at the moment so it shouldn't affect the ability to use the PBG effectively. I'll push a change shortly.

This bug is fixed.
Reply
RE: LDCad Set PBG generator
#24
Added a new feature:
If a sticker sheet that isn't in the cross reference is detected, it is skipped and a warning issued.
Reply
RE: LDCad Set PBG generator
#25
(2020-06-13, 3:05)Orion Pobursky Wrote: Added a new feature:
If a sticker sheet that isn't in the cross reference is detected, it is skipped and a warning issued.

LDCad Set PBG generator broken ?
Error : {"error":"Error: cross reference file not found","messages":null,"pbg":null}
If you don't understand my english, that's normal, me too !
Reply
RE: LDCad Set PBG generator
#26
(2020-06-26, 16:40)Marc Giraudet Wrote: LDCad Set PBG generator broken ?
Error : {"error":"Error: cross reference file not found","messages":null,"pbg":null}


Fixed. I moved some code around and forgot to update the paths.
Reply
RE: LDCad Set PBG generator
#27
I tested the PBG generator for the Black Seas Barracuda... Got some glitches Smile
- Some possible X-ref improvements:
970e02 -> 84637c01
2529pb01 -> 2528p30
2559c03 -> 2559c01
2557c03 -> 2557c01
3934a -> 3934?
3660 -> 3660a
42009 -> 42009a
973c11 -> torso+arms+hands? or 973c01 ?


More annoying:
4589 cone was replaced by stickers 004589
4315 hinge was replaced by stickers 004315
Reply
RE: LDCad Set PBG generator
#28
(2020-11-02, 15:53)Philippe Hurbain Wrote: I tested the PBG generator for the Black Seas Barracuda... Got some glitches Smile
- Some possible X-ref improvements:
970e02 -> 84637c01
2529pb01 -> 2528p30
2559c03 -> 2559c01
2557c03 -> 2557c01
3934a -> 3934?
3660 -> 3660a
42009 -> 42009a
973c11 -> torso+arms+hands? or 973c01 ?


More annoying:
4589 cone was replaced by stickers 004589
4315 hinge was replaced by stickers 004315

Some of these are indeed problems with PBG gen. The rest are Rebrickable database errors which I can submit fixes. I'll have a more detail response once I have access to my desktop.
Reply
RE: LDCad Set PBG generator
#29
Quick update:

Quote:970e02 -> 84637c01
2559c03 -> 2559c01
2557c03 -> 2557c01

Change requests have been submitted for these

Quote:3934a -> 3934?
3660 -> 3660a

These need to be researched and a "better" LDraw to Rebrickable map created. Then I can submit change requests.

Quote:42009 -> 42009a
2529pb01 -> 2528p30

I can't find either of these

Quote:973c11 -> torso+arms+hands? or 973c01 ?

I'll add this to the crossref

Quote:More annoying:
4589 cone was replaced by stickers 004589
4315 hinge was replaced by stickers 004315

Still investigating these 2
Reply
RE: LDCad Set PBG generator
#30
Quote:
Quote:
42009 -> 42009a
2529pb01 -> 2528p30

I can't find either of these
Sorry, typos... was 4209 -> 4209a
and 2528pb01 -> 2528p30
I submitted a change request for both
Reply
RE: LDCad Set PBG generator
#31
If I may ask; what is the advantage of this separate pbg exporter compared to the pbg exporter available on Rebrickable itself? It uses the same data, if I understand correctly?
Reply
RE: LDCad Set PBG generator
#32
(2020-11-07, 19:15)Merlijn Wissink Wrote: If I may ask; what is the advantage of this separate pbg exporter compared to the pbg exporter available on Rebrickable itself? It uses the same data, if I understand correctly?

The biggest advantage is the inclusion of assemblies (e.g. Torsos) that Rebrickable has declined to catalog as separate elements.

Also, it translate patterns that aren't yet included in the LDraw library to the plain versions.

And, when I finally get off my butt to program it, it'll include LDCad flexible elements as well.
Reply
RE: LDCad Set PBG generator
#33
(2020-11-02, 15:53)Philippe Hurbain Wrote: More annoying:
4589 cone was replaced by stickers 004589
4315 hinge was replaced by stickers 004315

I finally found this bug. Basically its that there's a sticker sheet with the number 004589 and a part with the number 4589. So it's a number conversion problem. It's gonna be a bit before it's fixed since I have to add a new field to the CSV file or improve part match logic (whichever proves to be more efficient)
Reply
RE: LDCad Set PBG generator
#34
(2020-11-27, 16:01)Orion Pobursky Wrote: I finally found this bug. Basically its that there's a sticker sheet with the number 004589 and a part with the number 4589. So it's a number conversion problem. It's gonna be a bit before it's fixed since I have to add a new field to the CSV file or improve part match logic (whichever proves to be more efficient)
A little request (I guess it should rather go to Roland actually...): in LDCad, I can't search for set description, only for set number. That improves if the pbg file name is extended to contain set description...
Reply
RE: LDCad Set PBG generator
#35
(2020-11-27, 17:32)Philippe Hurbain Wrote: That improves if the pbg file name is extended to contain set description...

This is trivial to implement. I'll have it done shortly.
Reply
RE: LDCad Set PBG generator
#36
(2020-11-27, 17:44)Orion Pobursky Wrote: This is trivial to implement. I'll have it done shortly.

Done!
Reply
RE: LDCad Set PBG generator
#37
(2020-11-27, 16:01)Orion Pobursky Wrote: I finally found this bug. Basically its that there's a sticker sheet with the number 004589 and a part with the number 4589. So it's a number conversion problem. It's gonna be a bit before it's fixed since I have to add a new field to the CSV file or improve part match logic (whichever proves to be more efficient)

I was even wrong about the source of the bug. It was a problem with the cross reference file itself. This problem is now fixed.
Reply
RE: LDCad Set PBG generator
#38
Got a small problem with PBG generator for 42121 set. Generated PBG uses 92694 for linear actuator, but this is actually the body only. AFAIK, Rebrickable inventory lists 92693, and this one correctly maps to 92693c01-f1.
Reply
RE: LDCad Set PBG generator
#39
(2021-05-08, 17:28)Philippe Hurbain Wrote: Got a small problem with PBG generator for 42121 set. Generated PBG uses 92694 for linear actuator, but this is actually the body only. AFAIK, Rebrickable inventory lists 92693, and this one correctly maps to 92693c01-f1.

Hmm. I don't know what's going on here. The response from Rebrickable doesn't even have 92694 in it and the crossref file isn't overriding anything. I'll have to dig into the code to find out whats up.
Reply
RE: LDCad Set PBG generator
#40
(2021-05-11, 21:08)Orion Pobursky Wrote: Hmm. I don't know what's going on here. The response from Rebrickable doesn't even have 92694 in it and the crossref file isn't overriding anything. I'll have to dig into the code to find out whats up.

I found the issue. 92693 is MOVED TO 92694. This means that I need to retool my order of operations regarding redirect substitution. This will give me the opportunity to update and streamline the code.
Reply
RE: LDCad Set PBG generator
#41
(2021-05-11, 21:30)Orion Pobursky Wrote: I found the issue. 92693 is MOVED TO 92694. This means that I need to retool my order of operations regarding redirect substitution. This will give me the opportunity to update and streamline the code.

This issue should now be fixed.
Reply
RE: LDCad Set PBG generator
#42
(2021-05-18, 20:35)Orion Pobursky Wrote: This issue should now be fixed.
Thanks Orion!
Reply
RE: LDCad Set PBG generator
#43
(2020-05-28, 0:08)Orion Pobursky Wrote: I finished entering all 526(!) torso assemblies (out of a possible 3700ish) into the cross reference file, I've moved the Set PBG generator out of experimental status.

New url is:
https://www.ldraw.org/downloads-2/pbg-generator.html

My next project is hips assemblies then Minidoll torso and leg assemblies followed by Technic action figures. I may sprinkle in other assemblies as I find them.

As always, If you find bugs or oddities, please post them here. If you find a misnumbered single file that's not part of an assembly, submit a change request at Rebrickable.

The current crossref file can always be found here:
https://www.ldraw.org/common/data/pbg_crossref.csv

I'm working on improved sticker detection that will used formed shortcuts if available. The ultimate goal is to do away with the crossref file completely but that will depend on interfacing with Bricklink.
Reply
RE: LDCad Set PBG generator
#44
I've made a few "under the hood" changes to the code to allow for better code reuse in other projects and to try to ensure that we don't exceed the request/sec limitation imposed by Rebrickable. If you notice anything odd, as always, report it here. I have a path forward for automatic sticker inclusion but have to think more on how to handle sticker shortcuts.
Reply
RE: LDCad Set PBG generator
#45
(2021-05-19, 16:27)Orion Pobursky Wrote: I'm working on improved sticker detection that will used formed shortcuts if available. The ultimate goal is to do away with the crossref file completely but that will depend on interfacing with Bricklink.
What's the best procedure for x-ref update? If that helps, I prepared a csv with the 4 torso assemblies of set 10278 that I recently patterned...


Attached Files
.txt   pbg_crossref.csv.txt (Size: 304 bytes / Downloads: 5)
Reply
RE: LDCad Set PBG generator
#46
I was interested in your file but always get an error "Authorization code mismatch. Are you accessing this function correctly". Did I something wrong or is the file protected against me? Wink
   
Reply
RE: LDCad Set PBG generator
#47
(2021-11-17, 8:48)Stefan Frenz Wrote: I was interested in your file but always get an error "Authorization code mismatch. Are you accessing this function correctly". Did I something wrong or is the file protected against me? Wink

Since I couldn't send directly a csv file, I renamed it .csv.txt so here it opens as a plain text (which it is actually  Big Grin)
Reply
RE: LDCad Set PBG generator
#48
(2021-11-17, 12:32)Philippe Hurbain Wrote: Since I couldn't send directly a csv file, I renamed it .csv.txt so here it opens as a plain text (which it is actually  Big Grin)

Thank you very much, now it works Smile
Reply
RE: LDCad Set PBG generator
#49
(2021-11-17, 8:32)Philippe Hurbain Wrote: What's the best procedure for x-ref update? If that helps, I prepared a csv with the 4 torso assemblies of set 10278 that I recently patterned...

The best way is what you just did. I have a script that will pull info if there's enough crossref info in the keywords (part of why I started using Rebrickable numbers instead of Bricklink numbers) and then I just have to check arm and hand color. It's still a fairly manual process at the moment.
Reply
RE: LDCad Set PBG generator
#50
Just noticed this (and it's something of a judgment call): the "caption" and "description" tags are reversed from the intended usage—or at least from the usage in the example .pbg files.

The more verbose ("Parts in…") tag should go under description, which appears in the hint bar of the main editing window.

The less verbose tag should be the caption, which appears in the top of the part bin itself. It's meant to be as short as possible since the part bin window is typically not very wide.

Although this is made somewhat moot by the way the generator is set up, since it adds the set name, so you wouldn't want to reverse it completely. Still, I think the expected output should be something like this, to match the "official" example files:
Code:
caption=Set 21057-1
description=Parts in set 21057-1 - Singapore
Reply
« Next Oldest | Next Newest »



Forum Jump:


Users browsing this thread: 4 Guest(s)