Hello Yan,

it mean that it worked, the importation can be long, there is 5M
combinations in the database.

Regards

Fabrice



Le 2017-10-18 ?? 22:17, Yan via PacketFence-users a ??crit?0?2:
> Oh 2 more tables, "dhcp_vendor" and "user_agent" appeared lately. And
> there is corresponding data in these table. Does that mean the
> importation is working ? Should I just ignore the warning ?
>
> ------------------ Original ------------------
> *From:* Yan <1136723...@qq.com>
> *Date:* ????,10?? 19,2017 10:12
> *To:* packetfence-users <packetfence-users@lists.sourceforge.net>
> *Subject:* Re: [PacketFence-users] Can't download and update fingerbank DB
>
> Hi Durand
> After I issue "Initialize MySQL database" under ACTION menu, I found
> the fingerbank DB in mysql only has one table--"combination" table
> left. The others are all missing. Is that Okay ? In the mean time
> fingerbank.log is filling with below warnings. How could I make sure
> the upstream DB is successfully imported to mariadb ?
>
> Oct 19 10:07:34 PacketFence-ZEN fingerbank: pfqueue(21315) WARN:
> [mac:xx:3a:xx:cb:xx:f0] An error occured while interrogating upstream
> Fingerbank project: 403 Forbidden (fingerbank::Source::API::__ANON__)
> Oct 19 10:07:34 PacketFence-ZEN fingerbank: pfqueue(21315) INFO:
> [mac:xx:3a:xx:cb:xx:f0] Fingerbank API has returned an invalid result,
> will not cache it. (fingerbank::Source::API::match)
> Oct 19 10:07:35 PacketFence-ZEN fingerbank: pfqueue(21339) WARN:
> [mac:xx:bd:xx:c4:xx:b6] Cannot find any combination ID in any schemas
> (fingerbank::Source::LocalDB::_getCombinationID)
> Oct 19 10:07:35 PacketFence-ZEN fingerbank: pfqueue(21339) INFO:
> [mac:xx:bd:xx:c4:xx:b6] Upstream is configured and unable to fullfil
> an exact match locally. Will ignore result from local database
> (fingerbank::Source::LocalDB::match)
> Oct 19 10:07:36 PacketFence-ZEN fingerbank: pfqueue(21317) INFO:
> [mac:xx:bd:xx:cb:xx:0a] Found combination ID '405014' in schema
> 'Upstream' but combination does not contain a device ID
> (fingerbank::Source::LocalDB::_getCombinationID)
> Oct 19 10:07:36 PacketFence-ZEN fingerbank: pfqueue(21317) INFO:
> [mac:xx:bd:xx:cb:xx:0a] Upstream is configured and unable to fullfil
> an exact match locally. Will ignore result from local database
> (fingerbank::Source::LocalDB::match)
>
>
> ------------------ Original ------------------
> *From:* packetfence-users <packetfence-users@lists.sourceforge.net>
> *Date:* ????,10?? 19,2017 01:11
> *To:* packetfence-users <packetfence-users@lists.sourceforge.net>
> *Cc:* Fabrice Durand <fdur...@inverse.ca>
> *Subject:* Re: [PacketFence-users] Can't download and update fingerbank DB
>
> Hi Yan,
>
> once you have the file, go in the admin gui,?0?2 Configuration ->
> Compliance -> General settings, verify that the mysql credentials and
> database name is correct then "Action -> Initialize MySQL database"
>
> If the access to the db is ok then you should be able to see a process
> "python" running that import the db from the sqlite file.
>
> It can take a long time.
>
> Regards
>
> Fabrice
>
>
>
> Le 2017-10-18 ?? 12:19, Yan via PacketFence-users a ??crit?0?2:
>> Hi Durand,
>> After running "yum reinstall fingerbank --enablerepo=packetfence", I
>> can find fingerbank_Upstream.db located in /usr/local/fingerbank/db
>> now. But I'm not so familiar with DB operation. How to integrate it
>> into mysql ? Is it something like "mysql -u username -p fingerbank <
>> fingerbank_Upstream.db" ?
>>
>>
>> ------------------ Original ------------------
>> *From:* packetfence-users <packetfence-users@lists.sourceforge.net>
>> *Date:* ????,10?? 18,2017 23:16
>> *To:* packetfence-users <packetfence-users@lists.sourceforge.net>
>> *Cc:* Fabrice Durand <fdur...@inverse.ca>
>> *Subject:* Re: [PacketFence-users] Can't download and update
>> fingerbank DB
>>
>> Hi Yan,
>>
>> there is a database who is coming with the fingerbank package, so you
>> can probably found it in /usr/local/fingerbank/db. (yum reinstall
>> fingerbank if needed)
>>
>> If you have it (fingerbank_Upstream.db) then you can integrate it
>> into mysql then the futur update will be just some interim update and
>> not the whole database.
>>
>> Regards
>>
>> Fabrice
>>
>>
>> Le 2017-10-18 ?? 10:38, Yan via PacketFence-users a ??crit?0?2:
>>>
>>> Hi Durand,
>>>
>>> I don't have any proxy configured in my server. The cert expire
>>> error not shows up every time. I just tried to execute wget 3 times,
>>> no certificate expire error any more, but 1 connection refused and 2
>>> connection closed during downloading. Is Fingerbank has a timeout
>>> setting for http connecting ? Is there any other way to download and
>>> update fingerbank DB ? Or how to initialize this component ?
>>>
>>> The first try:
>>> [root@PacketFence-ZEN ~]# wget
>>> https://fingerbank.inverse.ca/api/v1/download?key=<my-key>
>>> --2017-10-18 22:08:35--
>>> ?0?2https://fingerbank.inverse.ca/api/v1/download?key=<my-key>
>>> Resolving fingerbank.inverse.ca (fingerbank.inverse.ca)...
>>> 167.114.150.85
>>> Connecting to fingerbank.inverse.ca
>>> (fingerbank.inverse.ca)|167.114.150.85|:443... failed: Connection
>>> refused.
>>>
>>> The second try:
>>> [root@PacketFence-ZEN ~]# wget
>>> https://fingerbank.inverse.ca/api/v1/download?key=<my-key>
>>> --2017-10-18 22:12:56--
>>> ?0?2https://fingerbank.inverse.ca/api/v1/download?key=<my-key>
>>> Resolving fingerbank.inverse.ca (fingerbank.inverse.ca)...
>>> 167.114.150.85
>>> Connecting to fingerbank.inverse.ca
>>> (fingerbank.inverse.ca)|167.114.150.85|:443... connected.
>>> HTTP request sent, awaiting response... 200 OK
>>> Length: 2020635648 (1.9G) [application/x-sqlite3]
>>> Saving to: ??download?key=<my-key>??
>>>
>>> ?0?23% [=> ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 
>>> ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 
>>> ?0?2 ?0?2
>>> ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ] 70,840,939 ?0?252.1KB/s ?0?2 in 
>>> 6m 55s
>>>
>>> 2017-10-18 22:19:53 (167 KB/s) - Connection closed at byte 70840939.
>>> Retrying.
>>>
>>> --2017-10-18 22:19:54-- ?0?2(try: 2)
>>> ?0?2https://fingerbank.inverse.ca/api/v1/download?key=<my-key>
>>> Connecting to fingerbank.inverse.ca
>>> (fingerbank.inverse.ca)|167.114.150.85|:443... connected.
>>> HTTP request sent, awaiting response... 200 OK
>>> Length: 2020635648 (1.9G) [application/x-sqlite3]
>>> Saving to: ??download?key=<my-key>??
>>>
>>> ?0?20% [ ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 
>>> ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 
>>> ?0?2 ?0?2 ?0?2
>>> ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ] 0 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 
>>> --.-K/s ?0?2 in 0.003s
>>>
>>>
>>> Cannot write to ??download?key=<my-key>?? (Success).
>>>
>>> The third time is similar to the second time.
>>>
>>>
>>>
>>> ------------------ Original ------------------
>>> *From:* packetfence-users <packetfence-users@lists.sourceforge.net>
>>> *Date:* ????,10?? 18,2017 21:18
>>> *To:* packetfence-users <packetfence-users@lists.sourceforge.net>
>>> *Cc:* Fabrice Durand <fdur...@inverse.ca>
>>> *Subject:* Re: [PacketFence-users] Can't download and update
>>> fingerbank DB
>>>
>>> Hello Yan,
>>>
>>> do you have a proxy between PacketFence and internet ?
>>>
>>> When i see your wget command, i can see that :?0?2 "Issued certificate
>>> has expired" and the fingerbank.inverse.ca certificate is not yet
>>> expired so there is probably something that block/filter the request.
>>>
>>> Regards
>>>
>>> Fabrice
>>>
>>>
>>>
>>> Le 2017-10-17 ?? 22:16, Yan via PacketFence-users a ??crit?0?2:
>>>>
>>>> Hi Durand,
>>>>
>>>> After "Initialize MYSQL database" the error missing, but now
>>>> packetfence.log keeps filling with "pfqueue: pfqueue(10132) WARN:
>>>> [mac:xx:bd:27:xx:xx:xx] Unable to perform a Fingerbank lookup for
>>>> device with MAC address 'xx:bd:27:xx:xx:xx'
>>>> (pf::fingerbank::__ANON__)". ?0?2And fingerbank.log is filling with
>>>> "fingerbank: pfqueue(10133) WARN: [mac:xx:xx:0e:cb:xx:xx] An error
>>>> occured while interrogating upstream Fingerbank project: 500 Can't
>>>> connect to fingerbank.inverse.ca:443
>>>> (fingerbank::Source::API::__ANON__)
>>>> Oct 18 09:59:59 PacketFence-ZEN fingerbank: pfqueue(10133) INFO:
>>>> [mac:xx:xx:0e:cb:xx:xx] Fingerbank API has returned an invalid
>>>> result, will not cache it. (fingerbank::Source::API::match)".?0?2
>>>>
>>>> And I found I can't update fingerbank DB. When I initialize "Update
>>>> Fingerbank DB" in Configuration--Compliance--Fingerbank
>>>> Profiling--General Settings--ACTION, I found the error message
>>>> "pfqueue: pfqueue(10324) ERROR: [mac:unknown] Couldn't update
>>>> Upstream database, code : 500, msg : An error occurred while
>>>> updating file
>>>> '/usr/local/fingerbank/db/fingerbank_Upstream.db'(pf::fingerbank::_update_fingerbank_component)"
>>>> in packetfence.log. I can manually execute wget cmd to download. Is
>>>> this meant I have to buy any fingerbank license ? As I noticed
>>>> fingerbank official website said free license has a 300 times'
>>>> limit every hour. We can buy it if necessary.
>>>>
>>>> [root@PacketFence-ZEN logs]# wget --no-check-certificate
>>>> https://fingerbank.inverse.ca/api/v1/download?key=<my-key>
>>>> --2017-10-18 10:09:18--
>>>> ?0?2https://fingerbank.inverse.ca/api/v1/download?key=<my-key>
>>>> Resolving fingerbank.inverse.ca (fingerbank.inverse.ca)...
>>>> 167.114.150.85
>>>> Connecting to fingerbank.inverse.ca
>>>> (fingerbank.inverse.ca)|167.114.150.85|:443... connected.
>>>> WARNING: cannot verify fingerbank.inverse.ca's certificate, issued
>>>> by ??/C=GB/ST=Greater Manchester/L=Salford/O=COMODO CA
>>>> Limited/CN=COMODO RSA Domain Validation Secure Server CA??:
>>>> ?0?2 Issued certificate has expired.
>>>> HTTP request sent, awaiting response... 200 OK
>>>> Length: 2020635648 (1.9G) [application/x-sqlite3]
>>>> Saving to: ??download?key=8c7619e51115bd21f186822f19320edfa528681b??
>>>>
>>>> ?0?20% [ ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 
>>>> ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 
>>>> ?0?2 ?0?2 ?0?2
>>>> ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2 ?0?2] 12,525,568 ?0?21.77MB/s 
>>>> ?0?2eta 21m 37s
>>>>
>>>> ------------------ Original ------------------
>>>> *From:* packetfence-users <packetfence-users@lists.sourceforge.net>
>>>> *Date:* ????,10?? 17,2017 20:29
>>>> *To:* packetfence-users <packetfence-users@lists.sourceforge.net>
>>>> *Cc:* Fabrice Durand <fdur...@inverse.ca>
>>>> *Subject:* Re: [PacketFence-users] Can't download and update
>>>> fingerbank DB
>>>>
>>>> Hello Yan,
>>>>
>>>> it looks that you didn't imported fingerbank into mysql.
>>>>
>>>> Go in Configuration -> Compliance -> Fingerbank Profiling ->
>>>> General settings then in Action "Initialize MySQL database".
>>>>
>>>>
>>>> Regards
>>>>
>>>> Fabrice
>>>>
>>>>
>>>>
>>>> Le 2017-10-17 ?? 03:19, Yan via PacketFence-users a ??crit?0?2:
>>>>> Hi dear users,
>>>>>
>>>>> We are using PF V7.2 in our office. We want to use PF to recognize
>>>>> mobile devices from computers when connecting wireless ssid. It
>>>>> seems PF define device's type via DHCP fingerprint. Our
>>>>> packetfence.log keeps logging "pfqueue: pfqueue(1341) WARN:
>>>>> [mac:ff:ee:dd:cc:bb:aa] Unable to perform a Fingerbank lookup for
>>>>> device with MAC address 'ff:ee:dd:cc:bb:aa'
>>>>> (pf::fingerbank::__ANON__)".
>>>>>
>>>>> And after I ran the "Update Fingerbank DB" button and restart pf
>>>>> services, the packetfence.log is now filling with "pfqueue(6013)
>>>>> ERROR: [mac:04:xx:xx:cb:0f:74]
>>>>> DBIx::Class::Storage::DBI::_dbh_execute(): Table
>>>>> 'pf_fingerbank.dhcp_vendor' doesn't exist at
>>>>> /usr/local/pf/lib/fingerbank/Base/CRUD.pm line
>>>>> 416?0?2(pf::api::can_fork::notify)"
>>>>>
>>>>> How to reinstall and update fingerbank ??0?2Anyone could help ??0?2Thank
>>>>> you very much.
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------Check
>>>>>  out the vibrant tech community on one of the world's mostengaging tech 
>>>>> sites, Slashdot.org! http://sdm.link/slashdot
>>>>>
>>>>>
>>>>> _______________________________________________PacketFence-users mailing 
>>>>> listPacketFence-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/packetfence-users
>>>>
>>>> -- Fabrice durandfdur...@inverse.ca ::  +1.514.447.4918 (x135) ::  
>>>> www.inverse.caInverse inc. :: Leaders behind SOGo (http://www.sogo.nu) and 
>>>> PacketFence (http://packetfence.org) 
>>>>
>>>>
>>>> ------------------------------------------------------------------------------Check
>>>>  out the vibrant tech community on one of the world's mostengaging tech 
>>>> sites, Slashdot.org! http://sdm.link/slashdot
>>>>
>>>>
>>>> _______________________________________________PacketFence-users mailing 
>>>> listPacketFence-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/packetfence-users
>>>
>>> -- Fabrice durandfdur...@inverse.ca ::  +1.514.447.4918 (x135) ::  
>>> www.inverse.caInverse inc. :: Leaders behind SOGo (http://www.sogo.nu) and 
>>> PacketFence (http://packetfence.org) 
>>>
>>>
>>> ------------------------------------------------------------------------------Check
>>>  out the vibrant tech community on one of the world's mostengaging tech 
>>> sites, Slashdot.org! http://sdm.link/slashdot
>>>
>>>
>>> _______________________________________________PacketFence-users mailing 
>>> listPacketFence-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/packetfence-users
>>
>> -- Fabrice durandfdur...@inverse.ca ::  +1.514.447.4918 (x135) ::  
>> www.inverse.caInverse inc. :: Leaders behind SOGo (http://www.sogo.nu) and 
>> PacketFence (http://packetfence.org) 
>>
>>
>> ------------------------------------------------------------------------------Check
>>  out the vibrant tech community on one of the world's mostengaging tech 
>> sites, Slashdot.org! http://sdm.link/slashdot
>>
>>
>> _______________________________________________PacketFence-users mailing 
>> listPacketFence-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/packetfence-users
>
> -- Fabrice durandfdur...@inverse.ca ::  +1.514.447.4918 (x135) ::  
> www.inverse.caInverse inc. :: Leaders behind SOGo (http://www.sogo.nu) and 
> PacketFence (http://packetfence.org) 
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>
>
> _______________________________________________
> PacketFence-users mailing list
> PacketFence-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/packetfence-users

-- 
Fabrice Durand
fdur...@inverse.ca ::  +1.514.447.4918 (x135) ::  www.inverse.ca
Inverse inc. :: Leaders behind SOGo (http://www.sogo.nu) and PacketFence 
(http://packetfence.org) 

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
PacketFence-users mailing list
PacketFence-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/packetfence-users

Reply via email to