Hi all, for about 7 full days have I been cleaning up the new branch in order to port all the other drivers besides the S7 to the new API … This forced me to go through about all modules we have.
One module that however causes me to worry is the scraper. It’s a core module we use in the calcite-integration, kafka-connect and the logstash module. The last two ones are some that are gaining pretty much traction. However I feel very uncomfortable having dug into the current scraper … so I would propose to completely rewrite it. I tried refactoring it for 1,5 days and just recently simply reverted my changes … currently I’m just trying to get things to build again. As Julian told me he and his company have sort of moved away from the scraper to something new … I would like to discuss the alternatives with you. Right now for me it feels impossible to provide support if anything goes wrong in the scraper. Chris