yes and no. We haven't caved in entirely on structured schemas. We view the flattened form of large complex schemas to be a deployment step intended for when they are used with XSD-related tools other than Daffodil.
A large complex DFDL schema, in development using Daffodil, is best organized in modular fashion. For example, the Link16 DFDL schema we are working on (at Owl) consists of: * extendedCharsets - a "schema" with a charset plugin for a needed custom char encoding * jreap - mil-std-3011 - a header usable with several kinds of data payloads (not only Link16. Supports VMF and Link22 also, for example) * link16 - mil-std-6016 - just the data messages without any header/envelope (usable with many kinds of headers: jreap, nact, simple, mil-std-2045, etc.) * link16-with-jreap - assembles the above schemas together, and contains some test data All the above can be tested individually (via 'sbt test') which runs either a smoke-test, or in the case of link16-with-jreap over 1000 tests. Then there are various test-data projects which reference the link16-with-jreap schema, but consist almost entirely of test data files under src/test. We have 2 such projects today for different bodies of test data (from different places), and we expect to add more. * test-project-1 * test-project-2 On Mon, Nov 11, 2024 at 10:16 AM Larry Barber <larry.bar...@nteligen.com> wrote: > Hi Mike, > Would the proposed schema flattening option be likely to solve the issue > you have with your large complex schema? > > -----Original Message----- > From: Mike Beckerle <mbecke...@apache.org> > Sent: Thursday, November 7, 2024 3:11 PM > To: dev@daffodil.apache.org > Subject: Re: [VOTE] Apache Daffodil™ Extension for Visual Studio Code > 1.4.0-rc3 > > My vote: +1 > > I did run into the issues mentioned in > > https://github.com/apache/daffodil-vscode/wiki/Apache-Daffodil%E2%84%A2-Extension-for-Visual-Studio-Code:-v1.4.0#known-issues-in-v140 > > (I keep thinking it's time to ditch Ubuntu, or maybe just Gnome-based UIs > for Linux. Plain xfce feels really attractive to me given all this UI > weirdness with Ubuntu/Gnome) > > But I was able to configure and debug a useful example schema (I am using > DFDLSchemas/fakeTDL as my simple example these days). > > I have not (yet) been successful configuring the VSCode extension for a > large complex schema I have been working on. But that's not a blocker. This > RC3 is still is an incremental improvement. > > Observations: None of these below are blockers. > > It is very hard to find some things. I can find a way to open the data > editor, but not to display the regular data hex dump with the highlighting > of the current position (or was that behavior removed?) > > This notion that all the menu choices live under ctrl-shift-P, for every > kind of debugger is terrible. There should be a real menu where one can > select from the various kinds of displays (data, infoset, infoset-diff, > data editor,... at any given time. ). The fact that one must use > ctrl-shift-P and scroll to find the way to open the data editor is really > awful. > > Context of the project is completely non-existent. The file selector > dialogs always open in my homedir, even though the project of interest tree > of files is open on the immediate left panel. Any time I have to specify a > file I should be able to use the project folders on the left to navigate. > Opening a separate dialog for this is painful. Having to always drill from > my homedir to where the project of interest exists is painful given how > often one has to hit these file selection dialogs. > > My highest priority is being able to (a) somehow get the data hex dump > open) (b) get it to work on my large DFDL schema project, so I can use > this to demo data parsing for a client. > > On Mon, Nov 4, 2024 at 11:15 AM Shane Dell <shaned...@apache.org> wrote: > > > Hello all, > > > > I'd like to call a vote to release Apache Daffodil™ Extension for > > Visual Studio Code 1.4.0-rc3. > > > > All distribution packages, including signatures, digests, etc. can be > > found at: > > https://dis/ > > t.apache.org%2Frepos%2Fdist%2Fdev%2Fdaffodil%2Fdaffodil-vscode%2F1.4.0 > > -rc3&data=05%7C02%7Clarry.barber%40nteligen.com%7C684b0dad317847f27cc9 > > 08dcff686b3d%7C379c214c5c944e86a6062d047675f02a%7C0%7C0%7C638666071358 > > 367383%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJ > > BTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=0ua%2FiCtxok7oDGME1thET > > HCzo7cdtEzpt9WWyivdEZw%3D&reserved=0 > > > > This release has been signed with PGP key > > 86DDE7B41291E380237934F007570D3ADC76D51B, corresponding to > > shaned...@apache.org, which is included in the KEYS file here: > > https://dow/ > > nloads.apache.org%2Fdaffodil%2FKEYS&data=05%7C02%7Clarry.barber%40ntel > > igen.com%7C684b0dad317847f27cc908dcff686b3d%7C379c214c5c944e86a6062d04 > > 7675f02a%7C0%7C0%7C638666071358374965%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi > > MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7 > > C&sdata=yhmjn3l0rHUQvyLOfDxr8yYn8f%2FzsfYiXUJJkXYOWQg%3D&reserved=0 > > > > The release candidate has been tagged in git with 1.4.0-rc3. > > > > For reference, here is a list of all closed GitHub issues tagged with > > 1.4.0: > > https://git/ > > hub.com%2Fapache%2Fdaffodil-vscode%2Fmilestone%2F5%3Fclosed%3D1&data=0 > > 5%7C02%7Clarry.barber%40nteligen.com%7C684b0dad317847f27cc908dcff686b3 > > d%7C379c214c5c944e86a6062d047675f02a%7C0%7C0%7C638666071358387026%7CUn > > known%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haW > > wiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=sQuIz3BjlIk65kDEOoCYW3WdkebbDaeF%2 > > FiNOZoFcfw8%3D&reserved=0 > > > > Please review and vote. The vote will be open for at least 72 hours > > (Thursday, 7 November 2024, 11:30am EST). > > > > [ ] +1 approve > > [ ] +0 no opinion > > [ ] -1 disapprove (and reason why) > > > > Documentation for 1.4.0 can be found here > > > > https://git/ > > hub.com%2Fapache%2Fdaffodil-vscode%2Fwiki%2FApache-Daffodil%25E2%2584% > > 25A2-Extension-for-Visual-Studio-Code%3A-v1.4.0&data=05%7C02%7Clarry.b > > arber%40nteligen.com%7C684b0dad317847f27cc908dcff686b3d%7C379c214c5c94 > > 4e86a6062d047675f02a%7C0%7C0%7C638666071358396071%7CUnknown%7CTWFpbGZs > > b3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D > > %7C0%7C%7C%7C&sdata=D80GMBScPRgD53FPJhFR9mjetyq6mFQhDqh%2FONqKDuQ%3D&r > > eserved=0 > > . > > > > Thank you, > > > > - Shane Dell > > >