Fw: Apache JIRA vs. github "issues"

2021-09-25 Thread Beckerle, Mike
Santos Rodríguez Cc: Beckerle, Mike ; us...@infra.apache.org Subject: Re: Apache JIRA vs. github "issues" * Did you export / import the jira issues to github? We initially thought about that and even started doing it, but eventually we decided not to do that and "leave" th

Re: github issues vs. JIRA for VSCode Debugger - Fw: Apache JIRA vs. github "issues"

2021-09-23 Thread Beckerle, Mike
AM Interrante, John A (GE Research, US) < john.interra...@ge.com> wrote: > +1 for using GitHub issues in Apache's VSCode Debugger repo. > > -----Original Message- > From: Beckerle, Mike > Sent: Thursday, September 23, 2021 10:30 AM > To: dev@daffodil.apache.org

github issues vs. JIRA for VSCode Debugger - Fw: Apache JIRA vs. github "issues"

2021-09-23 Thread Beckerle, Mike
mikeb From: Jarek Potiuk Sent: Thursday, September 23, 2021 10:21 AM To: Beckerle, Mike Cc: us...@infra.apache.org Subject: Re: Apache JIRA vs. github "issues" It's quite OK to only use Github Issues/Discussions - we switched to GH in Apache Airflow ~

FYI: Apache emails blocked by Microsoft email spam filters

2021-09-23 Thread Beckerle, Mike
As you may have heard. Apache email and Microsoft's spam filtering systems don't mix: There have been ongoing problems with Microsoft domains partly because many of their users report our legitimate email as spam. The Infrastructure team have been trying to get the bans removed, but with no s

Try Java 17 LTS

2021-09-22 Thread Beckerle, Mike
Java 17 is officially GA as of Sept 14. It is a Long-term-support (LTS) release. I recommend developers download it and start using it in place of Java 16. We need to officially support Java 8, 11, and 17 now. If you are still using Java 8 or 11, I would also mention that when I switched to mos

verify licenses on dependencies for vscode debugger

2021-09-17 Thread Beckerle, Mike
I recall someone verifying the licenses on dependencies. I can't find that message now. However, this must be a transitive verification, so there's quite a few. The build.sbt has only: "ch.qos.logback" % "logback-classic" % "1.2.3", "com.microsoft.java" % "com.microsoft.java.debug.c

Re: Fwd: FW: DFDL: potential problem

2021-09-17 Thread Beckerle, Mike
Apologies on tardy reply. I missed parts of this thread due to spam email filter. (I learned that MS Outlook 365 is misclassifying some Apache email as junk email. ) Here's the link to what is proposed for checksum calculations, and it has links to some mock-ups showing how this checksum/crc s

Re: daffodil-vscode - how to package and identify the contribution - some git questions

2021-09-16 Thread Beckerle, Mike
t Owl we test it against every Daffodil release, so we know it continues to work. tarball attached. From: Beckerle, Mike Sent: Thursday, September 16, 2021 2:56 PM To: dev@daffodil.apache.org Subject: Re: daffodil-vscode - how to package and identify the contrib

Re: daffodil-vscode - how to package and identify the contribution - some git questions

2021-09-16 Thread Beckerle, Mike
are welcomed. On Thu, Sep 9, 2021 at 2:11 PM Beckerle, Mike wrote: > I know of one file in the repo which will have to be removed which is the > jpeg.dfdl.xsd file, which is there just as an example workspace. > > The copyright and provisions of that are not compatible with Apache >

Re: daffodil-vscode - how to package and identify the contribution - some git questions

2021-09-10 Thread Beckerle, Mike
: dev@daffodil.apache.org Subject: Re: daffodil-vscode - how to package and identify the contribution - some git questions Mike - Those were renames from the original versions that had "mock" in their names. commit 383fd4882a8fe51adf21b5ae31fe252056800447 On Fri, Sep 10, 2021 at 12:54 PM

Re: daffodil-vscode - how to package and identify the contribution - some git questions

2021-09-10 Thread Beckerle, Mike
John Wass said: I had a few more (6) source files as modified.. extension.ts debugAdapter.ts daffodilRuntime.ts daffodilDebug.ts adapter.test.ts activateDaffodilDebug.ts The 3 files with daffodil or Daffodil in their names, aren't those new files? Or were those based on provided files, but the

Re: daffodil-vscode - how to package and identify the contribution - some git questions

2021-09-09 Thread Beckerle, Mike
and "./mockDebug" was changed to "./daffodilDebug". The other two files do appear to be where all the real blended code is. From: Beckerle, Mike Sent: Thursday, September 9, 2021 4:21 PM To: dev@daffodil.apache.org Subject: Re: daff

Re: daffodil-vscode - how to package and identify the contribution - some git questions

2021-09-09 Thread Beckerle, Mike
xample-daffodil-vscode/issues/77 > > > > On Thu, Sep 9, 2021 at 2:11 PM Beckerle, Mike > wrote: > >> I know of one file in the repo which will have to be removed which is the >> jpeg.dfdl.xsd file, which is there just as an example workspace. >> >> The copyri

Re: daffodil-vscode - how to package and identify the contribution - some git questions

2021-09-09 Thread Beckerle, Mike
erify the licenses of all code in the repo. Hopefully little of that is original microsoft MIT and can be granted to ASF and relicensed. On 9/9/21 1:30 PM, Beckerle, Mike wrote: > The requirement, is that the entire dependency tree (transitively) cannot > depend on any software that ha

Re: daffodil-vscode - how to package and identify the contribution - some git questions

2021-09-09 Thread Beckerle, Mike
>> >> So I'm curious how much of that original Microsoft code still exists? I >> assume since it was just example code it has mostly been replaced? If >> that's the case, we could potentially say Microsoft has no ownership of >> this code, and so their CLA and

daffodil-vscode - how to package and identify the contribution - some git questions

2021-09-09 Thread Beckerle, Mike
So the daffodil-vscode code-base wants to be granted to become part of the Daffodil project. One question arises which is "what is the contribution?" exactly. The normal way this is identified is by creating a tarball of the source files and specifying an sha or md5 hash of that file. However,

Re: Please review mock up idea for checksum calculations in DFDL

2021-08-25 Thread Beckerle, Mike
One further comment at the end. From: Steve Lawrence Sent: Monday, August 23, 2021 2:23 PM To: dev@daffodil.apache.org Subject: Re: Please review mock up idea for checksum calculations in DFDL On 8/23/21 1:51 PM, Beckerle, Mike wrote: > Comments below see @@

Re: trying to rerun checks on PR - no option for it?

2021-08-24 Thread Beckerle, Mike
>> Workflows will not run on pull_request activity if the pull request > has a merge conflict. The merge conflict must be resolved first. > I think users do just need to rebase and fix the conflicts. But that means the comment history of the PR will be lost, as one will have to force-push to th

Re: Please review mock up idea for checksum calculations in DFDL

2021-08-23 Thread Beckerle, Mike
operties (e.g., for layering length kind, etc.) rather than using a generic hook. Ideally layering transformers could check these properties statically and issue SDEs if misused. On 7/30/21 2:29 PM, Beckerle, Mike wrote: > I would like comments on the layering enhancement to enable checksum

Please review: DFDL parity calculations also - was: Fw: Please review mock up idea for checksum calculations in DFDL

2021-08-03 Thread Beckerle, Mike
Thank you ____ From: Beckerle, Mike Sent: Friday, July 30, 2021 2:29 PM To: dev@daffodil.apache.org Subject: Please review mock up idea for checksum calculations in DFDL I would like comments on the layering enhancement to enable checksum computations in DFDL schemas.

Please review mock up idea for checksum calculations in DFDL

2021-07-30 Thread Beckerle, Mike
I would like comments on the layering enhancement to enable checksum computations in DFDL schemas. This is a high-priority feature for Daffodil's next release 3.2.0, especially for cybersecurity applications of Daffodil, which I know a number of us are involved in. I've produced a mock-up of

Re: trying to rerun checks on PR - no option for it?

2021-07-30 Thread Beckerle, Mike
fix the conflict, and push his PR again with " git push --force-with-lease". From: Beckerle, Mike Sent: Friday, July 30, 2021 10:51 AM To: dev@daffodil.apache.org Subject: EXT: trying to rerun checks on PR - no option for it? Darryl S. pushed a commit to his PR https://github.co

trying to rerun checks on PR - no option for it?

2021-07-30 Thread Beckerle, Mike
Darryl S. pushed a commit to his PR https://github.com/apache/daffodil/pull/601/checks As a first time contributor, his checks won't automatically run. I was going to trigger them manually, but I see no option for doing so. Wasn't there a button for that? In the past I swear I saw one. Anybody

Re: How to list offset and length of DFDL elements within native data?

2021-07-01 Thread Beckerle, Mike
Daffodil doesn't currently have this ability. The raw ingredients are largely there. For example, the dfdl:valueLength or dfdl:contentLength function can be used as rulers to measure how big something is. So if you organized a DFDL schema as Then you can put an element in the schema and lit

Java 9's Modules System - not a help for dependency isolation problem

2021-06-29 Thread Beckerle, Mike
We have many *many* dependencies from Daffodil, and this has the potential to cause conflicts when creating systems that use Daffodil as part of a larger system. If an application requires libraries A and B (suppose B is daffodil), and those each in turn require library C (suppose C is the ICU

Re: So many automated PRs... do we need to count them separately?

2021-06-24 Thread Beckerle, Mike
This link you sent: https://github.com/apache/daffodil/pulls?q=is%3Apr+is%3Aopen+sort%3Aupdated-desc is really useful. Like I noticed all my WIP PRs are down at the bottom of the list 🙁

So many automated PRs... do we need to count them separately?

2021-06-24 Thread Beckerle, Mike
One of the metrics of project health at the ASF is number of PRs and commits on projects. Ours have been massively inflated by these scalabot and dependbot PRs. (dependbot is new, but I was already observing this just from the scala update bot). This isn't terrible, and presumably as other pro

Re: test cases - examples

2021-06-17 Thread Beckerle, Mike
Depends on what you mean by available. They're in the daffodil source tree. The daffodil-test module is a big suite of tests, organized by section numbers of the DFDL spec, all expressed as TDML. https://github.com/apache/daffodil/tree/master/daffodil-test/src/test/resources/org/apache/daffodi

transformation example

2021-06-17 Thread Beckerle, Mike
DFDL isn't normally thought of as a data transformation language. Yet it has computed elements, hidden groups, expressions that can refer to elements in arrays using the index position within the current array (via the dfdl:occursIndex() function). These result in it having substantial data tra

Re: Use GitHub Releases

2021-06-09 Thread Beckerle, Mike
I think it is fine to have github releases and convenience binaries served from there, with a couple constraints based on not undermining the important ASF policies that provide for verifiable software supply chain. If the github releases and artifacts correspond to official Apache releases, th

VSCode License - we're good

2021-06-09 Thread Beckerle, Mike
So I think our debugger work won't involve direct linking to VSCode, but anyway I checked on the licenses. The source code license for VSCode is the MIT License, which is Category A. So if we found we need to, for example, embed a captive custom version of VSCode, we could embed this source. I

XML Catalogs feature - should we deprecate it

2021-06-04 Thread Beckerle, Mike
I spent quite a bit of time this week trying to get 2 DFDL schemas using XML Catalogs to work. I succeeded, but I find XML Catalogs very fragile, with important aspects that don't work (I was unable to get relative-catalogs to work at all) and I am wondering if we really need to support XML Cat

Re: The future of the daffodil DFDL schema debugger?

2021-05-26 Thread Beckerle, Mike
model after existing concepts. On Mon, May 24, 2021 at 12:48 PM Beckerle, Mike < mbecke...@owlcyberdefense.com> wrote: > Some thoughts re: data format debugger > > I suggest we enumerate > > * every single piece of state of the parser, > * every single piece of state

Re: The future of the daffodil DFDL schema debugger?

2021-05-24 Thread Beckerle, Mike
cently came across this hex editor: >>>>> >>>>> https://www.synalysis.net/ >>>>> >>>>> The screenshots are a bit small so it's not super clear, but this tool >>>>> has one view for the data in hex, and one view for a tree

Re: broke master 3.2.0-SNAPSHOT branch with latest commit

2021-05-20 Thread Beckerle, Mike
Note only broken for Java 8 JVM. From: Beckerle, Mike Sent: Thursday, May 20, 2021 3:08 PM To: dev@daffodil.apache.org Subject: broke master 3.2.0-SNAPSHOT branch with latest commit Will fix shortly. Mike Beckerle | Principal Engineer [cid:233aca18-26a6-4e2f

broke master 3.2.0-SNAPSHOT branch with latest commit

2021-05-20 Thread Beckerle, Mike
Will fix shortly. Mike Beckerle | Principal Engineer [cid:233aca18-26a6-4e2f-9ce6-557022deda7e] mbecke...@owlcyberdefense.com P +1-781-330-0412

Re: DAFFODIL-1927

2021-05-20 Thread Beckerle, Mike
This is an important change. There is design work to do here for how it should work. There are two features in Daffodil that dynamically load extensions already: User-defined functions, and Validators. So you should be able to look at those to figure out how to dynamically load layer implement

ICU library version - was: IBM DFDL is upgrading ICU level

2021-05-19 Thread Beckerle, Mike
DFDL implementors at IBM have noticed some issues with the ICU library worth noting. There is an ICU pull request to fix, targeted at ICU version 70.1. From: Subject: IBM DFDL is upgrading ICU level Hi Mike We are moving up the level of ICU that IBM DFDL is

Re: [GitHub] [daffodil] stevedlawrence commented on pull request #567: Update scala-library, scala-reflect to 2.13.6

2021-05-18 Thread Beckerle, Mike
Is scala reflect 2.13.6 actually about scala 2.13, or is it just a coincidence of the numbering that their sub-version number just rolled up to 13? From: GitBox Sent: Tuesday, May 18, 2021 12:55 PM To: comm...@daffodil.apache.org Subject: [GitHub] [daffodil] ste

Re: Windows debug clues needed

2021-05-18 Thread Beckerle, Mike
18/21 12:30 PM, Beckerle, Mike wrote: > The XML comments was definitely part of it. Found that one and fixed it with > the override def comment(..) as you suggest. > > There are still other tests failing though. > > I have been spinning up a windows dev environment and I noticed that

Re: Windows debug clues needed

2021-05-18 Thread Beckerle, Mike
ment' function, so maybe we just need to override that to normalize the comment contents? - Steve On 5/18/21 8:58 AM, Beckerle, Mike wrote: > My PR https://github.com/apache/daffodil/pull/560 > <https://github.com/apache/daffodil/pull/560> > > Keeps failing its tests on MS-Window

Windows debug clues needed

2021-05-18 Thread Beckerle, Mike
My PR https://github.com/apache/daffodil/pull/560 Keeps failing its tests on MS-Windows. I am unable to reproduce the failures on Linux obviously. But... I am also unable to reproduce these failures on MS-Windows. I have installed sbt, git, intellij idea, emacs, etc. all on MS-Windows. When I

Re: [VOTE] Release Apache Daffodil 3.1.0-rc2

2021-05-17 Thread Beckerle, Mike
+1 I checked: * all developer tests pass (test, it:test) * all ibm compatibility tests pass for all known schemas * includes all the portable ones at github DFDLSchemas, and a few other non-public schemas * all known schemas pass daffodil tests - excepting vcard - which is a

Re: [VOTE] Release Apache Daffodil 3.1.0-rc1

2021-05-14 Thread Beckerle, Mike
Agree that we should go to an rc2. We are going to have one IBM compatibility regression in this release, on vcard. But there should be no other surprises. From: Adams, Joshua Sent: Friday, May 14, 2021 12:23 PM To: dev@daffodil.apache.org Subject: Re: [VOTE]

Re: release 3.1.0 critical bugs still outstanding

2021-05-12 Thread Beckerle, Mike
ache key server, > build a release candidate, and start a vote before I go out of town on > Thursday. Steve, perhaps I should wait for the following release unless you > think I'd be able to do all these steps quickly within a few hours. > > John > > -Original Mes

sbt testOnly command line for running exactly one integration test?

2021-05-11 Thread Beckerle, Mike
I am wasting a bunch of time because just two integration tests are failing in my current work. I can't get 'sbt it:testOnly ... ' to work. I've used sbt testOnly before with regular tests. Can it be made to work for integration tests? I've asked questions about sbt testOnly before. This time

Re: release 3.1.0 critical bugs still outstanding

2021-05-10 Thread Beckerle, Mike
depending on availability. By this point, the workflow is pretty well documented here: https://cwiki.apache.org/confluence/display/DAFFODIL/Release+Workflow On 5/3/21 5:25 PM, Beckerle, Mike wrote: > Of the 4 remaining "critical bugs or improvements" I think we should po

Re: Daffodil DAP debugger modules and repos

2021-05-07 Thread Beckerle, Mike
daffodil-vscode repo is now setup and working. From: Beckerle, Mike Sent: Tuesday, May 4, 2021 6:07 PM To: dev@daffodil.apache.org Subject: Re: Daffodil DAP debugger modules and repos Grrr. I can't write to it however. INFRA says it may just be an hour b

Re: Escape character parsing bug?

2021-05-06 Thread Beckerle, Mike
On May 4, 2021 12:15 PM, "Beckerle, Mike" wrote: I asked Steve Hanson of IBM - other co-chair on DFDL workgroup, and one of the primaries on one of IBM's DFDL implementations, said that when he tries this situation with the escape character "/" matching the start of the s

Re: Daffodil DAP debugger modules and repos

2021-05-04 Thread Beckerle, Mike
ot;allowed". From: Beckerle, Mike Sent: Tuesday, May 4, 2021 5:46 PM To: dev@daffodil.apache.org Subject: Re: Daffodil DAP debugger modules and repos Well I'd like to see this be in an Apache Daffodil repo. In fact, I just created one. You can find it at https

Re: Daffodil DAP debugger modules and repos

2021-05-04 Thread Beckerle, Mike
Well I'd like to see this be in an Apache Daffodil repo. In fact, I just created one. You can find it at https://github.com/apache/daffodil-vscode The DFDLSchemas is not directly analogous, as there are other DFDL implementations and numerous schemas there are created by others for use with th

Re: Escape character parsing bug?

2021-05-04 Thread Beckerle, Mike
ug? Thanks for running this up the chain so to speak. I agree that an SDE would probably be best for situations like this as I wouldn't think any sort of sane data format would use a combination of separators/escape characters like this. Josh ________ From: Beckerle, Mike

release 3.1.0 critical bugs still outstanding

2021-05-03 Thread Beckerle, Mike
Of the 4 remaining "critical bugs or improvements" I think we should postpone and release note these first two: * * Improvement: https://issues.apache.org/jira/browse/DAFFODIL-2400 - New SAX API causes performance degradations. *It is a mystery why the SAX API is slower. The whol

draft may board report - due on 12th.

2021-05-03 Thread Beckerle, Mike
Here's what I have planned for the may board report. Your feedback is welcome. ## Description: Implementation of Data Format Description Language (DFDL) used to convert data from native formats into more easily processed forms such as XML, JSON, or the structures carried by data-processing fabrics

Re: Escape character parsing bug?

2021-05-03 Thread Beckerle, Mike
So you have a separator the first char of which is the escape character. Yikes. I think the DFDL spec should, ideally, make this an SDE. Feels entirely ambiguous to me. The part of the spec you quote is quite problematic, but was updated by one word in the final DFDL Spec version. Occurrences

Re: flakey windows CI build? Or real issue?

2021-04-29 Thread Beckerle, Mike
On 4/29/21 3:31 PM, Beckerle, Mike wrote: > I have no problem using someone else's logging infrastructure. > > The only sort-of-requirement is I've always hated the overhead of logging > because to create a good log message you end up doing a bunch of work and > then you pa

Re: flakey windows CI build? Or real issue?

2021-04-29 Thread Beckerle, Mike
e put a lot more time and thought into logging than we have. And I don't think Daffodil has any special logging requirements that other loggers don't already have. Thoughts? On 4/27/21 7:28 PM, Beckerle, Mike wrote: > Logging is highly suspicious for race conditions to me. > >

need 2nd reviewer on PR

2021-04-29 Thread Beckerle, Mike
https://github.com/apache/daffodil/pull/539 Needs a second reviewer. I added some "Highlights" comments to the files diffs to help you surf the deltas more effectively. This fixes an issue a user was having doing streaming reads of messages. Mike Beckerle | Principal Engineer [cid:2f6f0715-6c

Re: flakey windows CI build? Or real issue?

2021-04-27 Thread Beckerle, Mike
for this issue. From: Beckerle, Mike Sent: Tuesday, April 27, 2021 3:28 PM To: dev@daffodil.apache.org Subject: Re: flakey windows CI build? Or real issue? This one line: [error] Test org.apache.daffodil.example.TestScalaAPI.testScalaAPI2 failed: expected:<0&

Re: codecov - annotation to suppress false positives?

2021-04-27 Thread Beckerle, Mike
Nevermind. I was missing the trailing $ on my annotations. They're supposed to be // $COVERAGE-OFF$ and // $COVERAGE-ON$ From: Beckerle, Mike Sent: Tuesday, April 27, 2021 5:07 PM To: dev@daffodil.apache.org Subject: Re: codecov - annotation to suppress

Re: codecov - annotation to suppress false positives?

2021-04-27 Thread Beckerle, Mike
;only_pulls" setting: https://docs.codecov.io/docs/commit-status#only_pulls This way PR codecov checks can still fail the check if not sufficiently covered, but if we decide that's fine and merge it then it won't cause the merged commit to fail the check. On 4/27/21 1:2

Re: flakey windows CI build? Or real issue?

2021-04-27 Thread Beckerle, Mike
e isAtEnd changes have introduced a race condition, or made an existing race condition more likely to get hit? On 4/27/21 2:13 PM, Beckerle, Mike wrote: > My PR keeps failing to build on Windows e.g., This failed the windows > java8 build: > https://github.com/mbeckerle/daffodil/actions

flakey windows CI build? Or real issue?

2021-04-27 Thread Beckerle, Mike
My PR keeps failing to build on Windows e.g., This failed the windows java8 build: https://github.com/mbeckerle/daffodil/actions/runs/789865909 Previously today it failed the windows java 11 build. The errors were different. Earlier today it was in daffodil-io, the linked checks above it's in d

Re: codecov - annotation to suppress false positives?

2021-04-27 Thread Beckerle, Mike
On 4/27/21 10:29 AM, Beckerle, Mike wrote: > We have assertions like: > > foo match { > ... real cases > case thingy => Assert.invariantFailed(".msg...") > } > > The same thing can happen with if-then-else logic obviously where you make a &g

Recent push to PR did not run CI tests

2021-04-27 Thread Beckerle, Mike
Any ideas why susmita's latest updated did not cause CI to run? https://github.com/apache/daffodil/pull/490/checks Mike Beckerle | Principal Engineer [cid:dc68b4f3-1fa0-4ad3-8b90-e4adfab7b800] mbecke...@owlcyberdefense.com P +1-781-330-0412

codecov - annotation to suppress false positives?

2021-04-27 Thread Beckerle, Mike
We have assertions like: foo match { ... real cases case thingy => Assert.invariantFailed(".msg...") } The same thing can happen with if-then-else logic obviously where you make a decision, and some paths through the logic can't occur. These always get marked as non-covered, because b

Re: Forgot to squash commits

2021-04-21 Thread Beckerle, Mike
, 2021 4:26 PM To: dev@daffodil.apache.org Subject: Re: Forgot to squash commits I'd let them be. On Wed, Apr 21, 2021 at 4:13 PM Beckerle, Mike < mbecke...@owlcyberdefense.com> wrote: > I ended up committing 3 tiny commits to master, forgot to squash them. > > Should I fi

Forgot to squash commits

2021-04-21 Thread Beckerle, Mike
I ended up committing 3 tiny commits to master, forgot to squash them. Should I fix this by force push? Mike Beckerle | Principal Engineer [cid:7cdf72d7-2aa7-4d28-b9d3-bc7fa7c525a1] mbecke...@owlcyberdefense.com P +1-781-330-0412 Connect with us! [cid:30d2

New JIRA component "Back End C-Generator". Also Issue Types.

2021-04-21 Thread Beckerle, Mike
I added this component as we're going to be merging this stuff onto master soon enough. JIRA tickets associated with this new back end should use this component. I also wanted to mention that JIRA offers us a huge list of issue types. I'd like to recommend we stick with exactly 3: Bug, Improvem

Re: editconfig

2021-04-21 Thread Beckerle, Mike
t; >> one or more directories/files in a repository manually. I think > > >> using > > one > > >> of these tools such as eclint would be essential for writing a > > >> proper .editorconfig that narrows its scope as much as possible > > >> (e

Re: all this github spam ?

2021-04-21 Thread Beckerle, Mike
archive issue, we could maybe ask infra to remove archives that are clearly spam (all of them so far say "Demo titles Add files...", so unique and consistent). But it doesn't solve the underlying issue. On 4/21/21 8:59 AM, Beckerle, Mike wrote: > We seem to be fending off maybe

all this github spam ?

2021-04-21 Thread Beckerle, Mike
We seem to be fending off maybe 10 a day github spam attacks where people open/close pull requests. Is there something systematic we can do to avoid this? This pollutes our mailing lists. I know we can manually purge the PRs from github, but these things will live forever in the mail archives,

Re: [Discuss] creating Release 3.1.0 and 96 JIRA tickets marked "Major" or higher

2021-04-20 Thread Beckerle, Mike
Besides those 2 bugs, I think we should also merge https://github.com/apache/daffodil/pull/490 which adds a new charset (EBCDIC). We should roll this forward if susmita can't take it up. From: Beckerle, Mike Sent: Tuesday, April 20, 2021 3:49 PM To

Give a virtual talk at APACHECON about Daffodil?

2021-04-20 Thread Beckerle, Mike
ApacheCon @ Home 2021 is Sept 21-23. https://www.apachecon.com/acah2021/index.html Consider giving a presentation related to Apache Daffodil ! The call for presentations is open until May 2nd Midnight EDT.US (= 05:00 UTC). You need only formulate th

Re: [Discuss] creating Release 3.1.0 and 96 JIRA tickets marked "Major" or higher

2021-04-20 Thread Beckerle, Mike
n be fixed by 3.2.0--I've seen that issue a few times and it's very confusing. - Steve On 4/12/21 1:01 PM, John Wass wrote: >> I believe we need to do a release very soon regardless of these 96 >> issues > > I would like DAFFODIL- 2482 to get into it; > https://gi

Re: The future of the daffodil DFDL schema debugger?

2021-04-20 Thread Beckerle, Mike
Welcome Adam, Here's the link to Adam's book, which looks very useful. (Not shameless self promotion if someone else sends the link 🙂) https://essentialeffects.dev/ -mikeb From: Adam Rosien Sent: Monday, April 19, 2021 11:21 AM To: dev@daffodil.apache.org Su

editconfig

2021-04-19 Thread Beckerle, Mike
https://editorconfig.org/ This is interesting and we should consider adding these files to the root of daffodil both as a declaration of the code-style, and a way that auto-configures many IDEs and tools (like github). This does not appear to be sophisticated enough to really cover code-style

Re: The future of the daffodil DFDL schema debugger?

2021-04-16 Thread Beckerle, Mike
;> >> The only reason I mention a debug protcol is that would allow this GUI >> to be more easily written in something other that Java/Scala to take >> advantage of other GUI toolkits. It's been a long while since I've done >> anything with Java guis, but they seems

[Discuss] creating Release 3.1.0 and 96 JIRA tickets marked "Major" or higher

2021-04-12 Thread Beckerle, Mike
I'd like to discuss our need to create a new release of Daffodil, which would be 3.1.0. We have added enough new functionality certainly to justify a release. There are important features already complete, there is the new Runtime2 backend, etc. The challenge is that we have 96 JIRA tickets spe

Re: Output SVRL from Schematron Validator

2021-04-05 Thread Beckerle, Mike
I looked at the PR for this feature. I think it's fine to have the CLI provide an option with a file to write it to, and API-wise, if we decide we have to expose this, then a parseResult.validationResult.raw member, or like that, is fine with me. Do we need API-level access to this? E.g. in SAP

Re: XML String in Binary Data Question

2021-04-05 Thread Beckerle, Mike
know what really happens (and we also can run the same JSON/XML test cases through IBM's Daffodil processor to get more data points), we can start to discuss what's the best solution to handle this kind of situation for both JSON and XML infoset representations automatically. John -

XML String in Binary Data Question

2021-04-02 Thread Beckerle, Mike
I've started running into binary data containing XML strings. If Daffodil is unparsing a piece of XML Like this: of arbitrary xml Suppose the DFDL schema for bodyString is: So the notion here is that the data contains a string, which is a well-formed piece of XML. For example, the overall fo

Re: Acceptance criteria for merging DFDL-to-C backend (runtime2-2202)?

2021-03-11 Thread Beckerle, Mike
dil do not break the C backend inadvertently without knowing it. Note that this makes it even more mandatory that Daffodil developers setup both Java/Scala and C toolchains. What do you all think? -Original Message- From: Beckerle, Mike Sent: Thursday, March 11, 2021 9:27 AM To: dev@daf

Re: Acceptance criteria for merging DFDL-to-C backend (runtime2-2202)?

2021-03-11 Thread Beckerle, Mike
Acceptance criteria to me: 1) Sufficient functionality to describe at least one example, of sufficient message complexity to indicate that other similar "real" examples should be possible 2) contains built-in tests for one or several such examples, showing each supported aspect working. 3) th

Re: incompatible change in 3.1.0-SNAPSHOT

2021-03-05 Thread Beckerle, Mike
ly 1 production schema I have seen. From: Beckerle, Mike Sent: Friday, March 5, 2021 5:37 PM To: dev@daffodil.apache.org Subject: incompatible change in 3.1.0-SNAPSHOT Does anyone know why TDML negative tests have to specify root now? Did we change something so t

incompatible change in 3.1.0-SNAPSHOT

2021-03-05 Thread Beckerle, Mike
Does anyone know why TDML negative tests have to specify root now? Did we change something so that this is now required? There are test suites for schemas that depend on the fact that the root is the first element of the first schema file, so need not be specified by the TDML file. These tests

Re: Scala Steward for dependency updates?

2021-03-04 Thread Beckerle, Mike
There's been this increase of software supply chain hacks these days. Since this bot is on our ongoing development branch, and so long as we watch these changes and verify the dependencies it chooses before merging these PRs, then this makes this version updating an incremental effort done as th

Press release: Apache Daffodil graduating to TLP and also DFDL v1.0 Spec finalized

2021-03-04 Thread Beckerle, Mike
It's official and announced! Apache Daffodil is now TLP. Read more, including nice user testimonials at this link. - GlobeNewswire http://www.globenewswire.com/news-release/2021/03/04/2187212/0/en/The-Apache-Software-Foundation-Announces-Apache-Daffodil-as-a-Top-Level-Project.html Or same but

Fw: new PCAP without the self-defined variables

2021-03-03 Thread Beckerle, Mike
This discussion should be on dev@daffodil list. Or it is now for posterity. From: Beckerle, Mike Sent: Wednesday, March 3, 2021 10:25 AM To: Lawrence, Stephen ; Adams, Joshua Subject: Re: new PCAP without the self-defined variables I don't think an S

Re: Maven Central broken source code links for all versions of Daffodil

2021-03-01 Thread Beckerle, Mike
l things are expected to be good from a legal point of view, while incubating releases might not be as perfect. Chris Von: Beckerle, Mike Gesendet: Montag, 1. März 2021 22:41 An: dev@daffodil.apache.org Betreff: Maven Central broken source code links for all versions of Daffodil So since we

Maven Central broken source code links for all versions of Daffodil

2021-03-01 Thread Beckerle, Mike
So since we are now a TLP, URLs like those on Maven Central that say where our source is, they're all broken now, since our repository no longer has "incubator-" in its name. (e.g., https://gitbox.apache.org/repos/asf/incubator-daffodil.git is used on Maven central for our 3.0.0 artifacts, and

Re: New Repository for Daffodil Schema Template?

2021-02-25 Thread Beckerle, Mike
lso like to give a chance for others to provide input before we bother infra with this in case a better name is determined, or if there's a valid objection. On 2/25/21 12:58 PM, Beckerle, Mike wrote: > I have an INFRA ticket requesting this. We'll see if they can do this for us. >

Re: New Repository for Daffodil Schema Template?

2021-02-25 Thread Beckerle, Mike
I have an INFRA ticket requesting this. We'll see if they can do this for us. https://issues.apache.org/jira/browse/INFRA-21478 From: Beckerle, Mike Sent: Thursday, February 25, 2021 12:54 PM To: dev@daffodil.apache.org Subject: Re: New Repository for Daf

Re: New Repository for Daffodil Schema Template?

2021-02-25 Thread Beckerle, Mike
To get a repository created with this ".g8" extension will require an INFRA ticket. The GUI for creating a new Apache repo just takes a name like "schema" and creates a repo named "daffodil-schema.git" from it. From: Steve Lawrence Sent: Thursday, February 25, 20

Infrastructure cutover to non-incubator - please verify

2021-02-19 Thread Beckerle, Mike
This cutover looks complete to me. I've just finished removing "incubating-" prefixes from a few last places on the wiki. You can now rename forks and change the git remotes on your local clones of daffodil and daffodil-site. Please email this list if anything is amiss. Mike Beckerle | Princi

re: TLP graduation - official announcement will be forthcoming

2021-02-18 Thread Beckerle, Mike
Note that the ASF will issue a press release about our graduating to a TLP, so you may want to wait until that comes out before sending notifications about this or posting it to your linked in, or whatever. It's not like this is a secret or anything, it's just that we want to the announcement to

Infrastructure Transition from incubator to TLP

2021-02-18 Thread Beckerle, Mike
The infra ticket for migrating our project infrastructure from incubator to TLP is https://issues.apache.org/jira/browse/INFRA-21438 Which you may want to watch. (Don't have to. I'm watching it.) They will do these things supposedly for us: DNS entry, Unix/LDAP group creation, PMC Chair karma,

avoiding redundant comment and commit messages

2021-02-03 Thread Beckerle, Mike
I seem to get two of everything. I get one message from "GitBox" sent to commits@daffodil I get one from "notificati...@github.com" to incubator-daffo...@noreply.github.com I cannot guarantee that every message always shows up to both of these. If I unsubscribe from the latter, will I miss some

Re: Suspensions and NewVariableInstance

2021-02-02 Thread Beckerle, Mike
Well, to sanity check ideas, here's my thoughts on how unparsers and variable instances and suspensions/expressions ought to interact. There may be naive assumptions in here. If so let's find them. So unparsers call each other in a recursive walk, and variable instances go in/out of scope as th

Re: [RESULT] [VOTE] Contributors - Graduate Apache Daffodil (Incubating) to a top-level project

2021-01-29 Thread Beckerle, Mike
Ok. Will wait until Tuesday 5pm UTC-5 I do have a +1 from John Wass already on the thread. From: Steve Lawrence Sent: Friday, January 29, 2021 10:46 AM To: dev@daffodil.apache.org Subject: Re: [RESULT] [VOTE] Contributors - Graduate Apache Daffodil (Incubating)

  1   2   3   4   >