There have been some consistency problems with this service, probably from usage of direct CSS url links and/or my stupid brute-force script, so my simple-minded approach is to have my crawler run the login(which has changed several times), then resolve the href-tagged links, then go from there to each notification page. Could be done manually, but all hail the power of beautifulsoup.
Have not used for very long time, but so far does seem to be a decent source of global regulatory information. Brian -----Original Message----- From: Kortas, Jamison [mailto:jamison.kor...@ecolab.com] Sent: Tuesday, September 27, 2016 4:23 PM To: EMC-PSTC@LISTSERV.IEEE.ORG Subject: Re: [PSES] Counterfeit tracking Hopefully - I am doing this right - this is my first post. I recently found Notify U.S. https://tsapps.nist.gov/notifyus/data/home/home.cfm which is run by the NIST in the Dept. Of Commerce and it notifies me of anything published by the WTO an others. You can filter it by field of interest and country. It is quite informative and free. Here are the "fields of interest": 65 Agriculture 49 Aircraft and Space Vehicle Engineering 71 Chemical Technology 93 Civil Engineering 61 Clothing Industry CA Conformity Assessment Procedures 91 Construction Materials and Building 97 Domestic and Commercial Equipment. Entertainment. Sports 29 Electrical Engineering 31 Electronics 27 Energy and Heat Transfer Engineering 13 Environment. Health Protection. Safety 23 Fluid Systems and Components for General Use Measurement of fluid flow, see 17.120 67 Food Technology 01 Generalities. Terminology. Standardization. Documentation 81 Glass and Ceramics Industries 11 Health Care Technology 37 Image Technology 35 Information Technology. Office Machines 25 Manufacturing Engineering This field includes standards for general use 53 Materials Handling Equipment 07 Mathematics. Natural Sciences 21 Mechanical Systems and Components for General Use 77 Metallurgy 95 Military Engineering 73 Mining and Minerals 55 Packaging and Distribution of Goods 87 Paint and Colour Industries 85 Paper Technology 75 Petroleum and Related Technologies 17 Physical Metrology and Measurement. Physical Phenomena 39 Precision Mechanics. Jewellery 45 Railway Engineering 43 Road Vehicle Engineering 83 Rubber and Plastics Industries 47 Shipbuilding and Marine Structures 03 Sociology. Services. Company Organization and Management. Administration. Transport 33 Telecommunications. Audio and Video Engineering 19 Testing This field includes standards for general use only Analytical chemistry, see 71.040 59 Textile and Leather Technology 79 Wood Technology Thanks, -Jamison -----Original Message----- From: Doug Powell [mailto:doug...@gmail.com] Sent: Tuesday, September 27, 2016 2:53 PM To: EMC-PSTC@LISTSERV.IEEE.ORG Subject: Re: [PSES] Counterfeit tracking Thanks, I'll check out DuckDuckGo, it sounds like it may have possibilities. I have looked at rss aggregators in the past. It's kind of hard to find one that consolidates similar postings in multiple locations. This also may be worth another look. All the best. Doug. Original Message From: oconne...@tamuracorp.com Sent: September 27, 2016 1:39 PM To: EMC-PSTC@LISTSERV.IEEE.ORG Reply-to: oconne...@tamuracorp.com Subject: Re: [PSES] Counterfeit tracking Distill will monitor selected pages, but is not very selective. And indiscrete browser plugins are not good for a corporate computer. You still need something to traverse the web and find new/alternate regulatory information. Related - there are commercial aggregation services for compliance engineers for $$$. And as for 'keywords' much of the SEO gaming will not allow a simplistic parsing for words or phrases to return reliable data sets. Prefer the API for DuckDuckGo (duckduckgo.com/api) for search and url traversals, and if you wanna play code monkey, relatively easy to write 'focused' crawlers that feed into parsers. My stuff is based on the common Python libs BeautifulSoup and scrapy. But this type of solution is useless to those not having a basic understanding of the insanity buried in a site's html/css/xml stuff. The most common 'off-the-shelf' solutions, where there is no desire to code monkey, are to simply set up your mail client to suck on selected RSS feeds, or use some other feed aggregator. Many sites used the recently discontinued Yahoo Pipes, so there may be blinky data streams for some pages for a few more weeks. Make life easier? As my gunny used to say, "life is supposed to be hard, and then you die..." Brian From: Doug Powell [mailto:doug...@gmail.com] Sent: Tuesday, September 27, 2016 10:43 AM To: EMC-PSTC@LISTSERV.IEEE.ORG Subject: [PSES] Counterfeit tracking Hi all, I suspect there are many compliance engineers that do what I do. Once in a while I skim the various public notices web pages for the major certifying agencies to see if there is anything i should be aware of, although I am not very diligent about this. I did find a collection of public notice pages and setup my web browser do the checking with the Distil app (https://urldefense.proofpoint.com/v2/url?u=https-3A__distill.io_&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=sWEdW2ZS04aEuGoUxN2Npy5aUuh8R3jyR_oMV_YwIfM&e= ). Alternatively if something suspicious shows up, a quick Google search with a few well conditioned keywords will sometimes bear fruit. I was wondering if there are any resources available that provide a keyword searchable digest of all these diverse sources. It would make life easier. Thanks, Doug -- Douglas E Powell doug...@gmail.com https://urldefense.proofpoint.com/v2/url?u=http-3A__www.linkedin.com_in_dougp01&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=S4BPqIwfzliH0msPf_fUTY-brxaTi-Ur0Ief1_enJY0&e= - ---------------------------------------------------------------- This message is from the IEEE Product Safety Engineering Society emc-pstc discussion list. To post a message to the list, send your e-mail to <emc-p...@ieee.org> All emc-pstc postings are archived and searchable on the web at: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ieee-2Dpses.org_emc-2Dpstc.html&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=eiT-81Oj9m5HBExDhnFOkQd86bXqrMrQnvWQDl-q--g&e= Attachments are not permitted but the IEEE PSES Online Communities site at https://urldefense.proofpoint.com/v2/url?u=http-3A__product-2Dcompliance.oc.ieee.org_&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=rdHRlcTR92bLDb0YKjSSvrqSkV3ojJIu_WbPrukBRT4&e= can be used for graphics (in well-used formats), large files, etc. Website: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ieee-2Dpses.org_&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=ZV_NYesUFJvmUmHUsehxnJbkyy2g7HD-TDn4s9JK0k0&e= Instructions: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ieee-2Dpses.org_list.html&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=RgACKKyjWCC9Eo7dlc6TXQAhoE5026Pxsq5NqJACvn4&e= (including how to unsubscribe) List rules: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ieee-2Dpses.org_listrules.html&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=z5bPFm2GqZX5cFD5ClB-8HAoYn7I1ONn9mdOplSJBVw&e= For help, send mail to the list administrators: Scott Douglas <sdoug...@ieee.org> Mike Cantwell <mcantw...@ieee.org> For policy questions, send mail to: Jim Bacher: <j.bac...@ieee.org> David Heald: <dhe...@gmail.com> - ---------------------------------------------------------------- This message is from the IEEE Product Safety Engineering Society emc-pstc discussion list. To post a message to the list, send your e-mail to <emc-p...@ieee.org> All emc-pstc postings are archived and searchable on the web at: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ieee-2Dpses.org_emc-2Dpstc.html&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=eiT-81Oj9m5HBExDhnFOkQd86bXqrMrQnvWQDl-q--g&e= Attachments are not permitted but the IEEE PSES Online Communities site at https://urldefense.proofpoint.com/v2/url?u=http-3A__product-2Dcompliance.oc.ieee.org_&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=rdHRlcTR92bLDb0YKjSSvrqSkV3ojJIu_WbPrukBRT4&e= can be used for graphics (in well-used formats), large files, etc. Website: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ieee-2Dpses.org_&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=ZV_NYesUFJvmUmHUsehxnJbkyy2g7HD-TDn4s9JK0k0&e= Instructions: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ieee-2Dpses.org_list.html&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=RgACKKyjWCC9Eo7dlc6TXQAhoE5026Pxsq5NqJACvn4&e= (including how to unsubscribe) List rules: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ieee-2Dpses.org_listrules.html&d=DQIDaQ&c=clRTYxLjfWTYQkksq4Trqw&r=SuXR4v_cWDGps50Ob7OgG3eGvjdtolb5h84QBM8NxmY&m=7QAVK8sQSuPDqZwUcSTjAhEEXqD8m4YKi7S5zSYVhac&s=z5bPFm2GqZX5cFD5ClB-8HAoYn7I1ONn9mdOplSJBVw&e= For help, send mail to the list administrators: Scott Douglas <sdoug...@ieee.org> Mike Cantwell <mcantw...@ieee.org> For policy questions, send mail to: Jim Bacher: <j.bac...@ieee.org> David Heald: <dhe...@gmail.com> - ---------------------------------------------------------------- This message is from the IEEE Product Safety Engineering Society emc-pstc discussion list. To post a message to the list, send your e-mail to <emc-p...@ieee.org> All emc-pstc postings are archived and searchable on the web at: http://www.ieee-pses.org/emc-pstc.html Attachments are not permitted but the IEEE PSES Online Communities site at http://product-compliance.oc.ieee.org/ can be used for graphics (in well-used formats), large files, etc. Website: http://www.ieee-pses.org/ Instructions: http://www.ieee-pses.org/list.html (including how to unsubscribe) List rules: http://www.ieee-pses.org/listrules.html For help, send mail to the list administrators: Scott Douglas <sdoug...@ieee.org> Mike Cantwell <mcantw...@ieee.org> For policy questions, send mail to: Jim Bacher: <j.bac...@ieee.org> David Heald: <dhe...@gmail.com> - ---------------------------------------------------------------- This message is from the IEEE Product Safety Engineering Society emc-pstc discussion list. To post a message to the list, send your e-mail to <emc-p...@ieee.org> All emc-pstc postings are archived and searchable on the web at: http://www.ieee-pses.org/emc-pstc.html Attachments are not permitted but the IEEE PSES Online Communities site at http://product-compliance.oc.ieee.org/ can be used for graphics (in well-used formats), large files, etc. Website: http://www.ieee-pses.org/ Instructions: http://www.ieee-pses.org/list.html (including how to unsubscribe) List rules: http://www.ieee-pses.org/listrules.html For help, send mail to the list administrators: Scott Douglas <sdoug...@ieee.org> Mike Cantwell <mcantw...@ieee.org> For policy questions, send mail to: Jim Bacher: <j.bac...@ieee.org> David Heald: <dhe...@gmail.com>