need curl help with a link
Hi All,
In Firefox, when I click on
http://www.fosshub.com/FreeFileSync.html#clickToStartDownload
Cliget tells me:
curl --header 'Host: files.fosshub.com' --header 'User-Agent:
Mozilla/5.0 (X11; Linux x86_64; rv:39.0) Gecko/20100101 Firefox/39.0'
--header 'Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'
--header 'Accept-Language: en-US,en;q=0.5' --header 'Referer:
http://www.fosshub.com/FreeFileSync.html' --header 'Cookie:
__cfduid=d6f1281949af85b5b300ff7184c0d87881435987093' --header
'Connection: keep-alive'
'http://files.fosshub.com/Protected/expiretime=1435994622;badurl=aHR0cDovL3d3dy5mb3NzaHViLmNvbS9GcmVlRmlsZVN5bmMuaHRtbA==/6bf907c940a74164cc927ddf3fd0719bee03c53d5c0916955c287ba0d40d1676/FreeFileSync/FreeFileSync_7.2_Win_Setup.exe'
-o 'FreeFileSync_7.2_Win_Setup.exe' -L
How do I figure out the above from the command line?
Many thanks,
-T
The closest I have come is:
curl --header 'Host: files.fosshub.com' --header 'User-Agent:
Mozilla/5.0 (X11; Linux x86_64; rv:39.0) Gecko/20100101 Firefox/39.0'
--header 'Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'
--header 'Accept-Language: en-US,en;q=0.5' --header 'Referer:
http://www.fosshub.com/FreeFileSync.html' --header 'Connection:
keep-alive' --header 'Host: files.fosshub.com' --header 'Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'
--header 'Accept-Language: en-US,en;q=0.5' --header 'Referer:
http://www.fosshub.com/FreeFileSync.html' --header 'Connection:
keep-alive' --header 'Cookie: $(curl --silent -I
http://www.fosshub.com/FreeFileSync.html#clickToStartDownload | grep
Set-Cookie | awk -F : '{print $2}' | awk -F ; '{print $1}')' $(wget
${ConnectTimeout} --quiet --header=Referer:
http://www.fosshub.com/FreeFileSync.html;
http://www.fosshub.com/genLink/FreeFileSync/FreeFileSync_${LatestRev}_Windows_Setup.exe;
-O /dev/stdout) --output ${NewFileName} -L
Which tells me The page is temporarily unavailable
Re: need curl help with a link
On 07/04/2015 12:23 AM, ToddAndMargo wrote:
Hi All,
In Firefox, when I click on
http://www.fosshub.com/FreeFileSync.html#clickToStartDownload
Cliget tells me:
curl --header 'Host: files.fosshub.com' --header 'User-Agent:
Mozilla/5.0 (X11; Linux x86_64; rv:39.0) Gecko/20100101 Firefox/39.0'
--header 'Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'
--header 'Accept-Language: en-US,en;q=0.5' --header 'Referer:
http://www.fosshub.com/FreeFileSync.html' --header 'Cookie:
__cfduid=d6f1281949af85b5b300ff7184c0d87881435987093' --header
'Connection: keep-alive'
'http://files.fosshub.com/Protected/expiretime=1435994622;badurl=aHR0cDovL3d3dy5mb3NzaHViLmNvbS9GcmVlRmlsZVN5bmMuaHRtbA==/6bf907c940a74164cc927ddf3fd0719bee03c53d5c0916955c287ba0d40d1676/FreeFileSync/FreeFileSync_7.2_Win_Setup.exe'
-o 'FreeFileSync_7.2_Win_Setup.exe' -L
How do I figure out the above from the command line?
Many thanks,
-T
The closest I have come is:
curl --header 'Host: files.fosshub.com' --header 'User-Agent:
Mozilla/5.0 (X11; Linux x86_64; rv:39.0) Gecko/20100101 Firefox/39.0'
--header 'Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'
--header 'Accept-Language: en-US,en;q=0.5' --header 'Referer:
http://www.fosshub.com/FreeFileSync.html' --header 'Connection:
keep-alive' --header 'Host: files.fosshub.com' --header 'Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'
--header 'Accept-Language: en-US,en;q=0.5' --header 'Referer:
http://www.fosshub.com/FreeFileSync.html' --header 'Connection:
keep-alive' --header 'Cookie: $(curl --silent -I
http://www.fosshub.com/FreeFileSync.html#clickToStartDownload | grep
Set-Cookie | awk -F : '{print $2}' | awk -F ; '{print $1}')' $(wget
${ConnectTimeout} --quiet --header=Referer:
http://www.fosshub.com/FreeFileSync.html;
http://www.fosshub.com/genLink/FreeFileSync/FreeFileSync_${LatestRev}_Windows_Setup.exe;
-O /dev/stdout) --output ${NewFileName} -L
Which tells me The page is temporarily unavailable
Follow up:
Figured it out
Cmd=curl ${MaxTime2} '$(wget --header=Referer:
http://www.fosshub.com/FreeFileSync.html; ${LatestPath} -O
/dev/stdout)' --output ${NewFileName}
eval {Cmd}
Which looks like this when it expands:
curl --max-time 720
'http://files.fosshub.com/Protected/expiretime=1436041727;badurl=aHR0cDovL3d3dy5mb3NzaHViLmNvbS9GcmVlRmlsZVN5bmMuaHRtbA==/3ff68b9534495fe4fc47083c3ee381d6584fb0e095bc5f96bb691c0f1fcf9cb7/FreeFileSync/FreeFileSync_7.2_Win_Setup.exe'
--output
/home/CDs/Windows/FileSystem/FreeFileSync/FreeFileSync_7.2_Win_Setup.exe
Re: need curl help with a link
Why are you trying to use curl for some site that is re-inventing
software downloads and is entirely dependent on clickthroughs to
actually find the content? Part of the whole point of such a site is
to prevent direct, URL accessible downloads? They don't publish direct
download URL's. I'd discard the site immediately as someone who's
revisiting the DotCom business model and doomed to failure.
If you need a content change monitor like the FreeFileSync tool,
why not just put the relevant content in git source control?
On Sat, Jul 4, 2015 at 3:23 AM, ToddAndMargo toddandma...@zoho.com wrote:
Hi All,
In Firefox, when I click on
http://www.fosshub.com/FreeFileSync.html#clickToStartDownload
Cliget tells me:
curl --header 'Host: files.fosshub.com' --header 'User-Agent: Mozilla/5.0
(X11; Linux x86_64; rv:39.0) Gecko/20100101 Firefox/39.0' --header 'Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8' --header
'Accept-Language: en-US,en;q=0.5' --header 'Referer:
http://www.fosshub.com/FreeFileSync.html' --header 'Cookie:
__cfduid=d6f1281949af85b5b300ff7184c0d87881435987093' --header 'Connection:
keep-alive'
'http://files.fosshub.com/Protected/expiretime=1435994622;badurl=aHR0cDovL3d3dy5mb3NzaHViLmNvbS9GcmVlRmlsZVN5bmMuaHRtbA==/6bf907c940a74164cc927ddf3fd0719bee03c53d5c0916955c287ba0d40d1676/FreeFileSync/FreeFileSync_7.2_Win_Setup.exe'
-o 'FreeFileSync_7.2_Win_Setup.exe' -L
How do I figure out the above from the command line?
Many thanks,
-T
The closest I have come is:
curl --header 'Host: files.fosshub.com' --header 'User-Agent: Mozilla/5.0
(X11; Linux x86_64; rv:39.0) Gecko/20100101 Firefox/39.0' --header 'Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8' --header
'Accept-Language: en-US,en;q=0.5' --header 'Referer:
http://www.fosshub.com/FreeFileSync.html' --header 'Connection: keep-alive'
--header 'Host: files.fosshub.com' --header 'Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8' --header
'Accept-Language: en-US,en;q=0.5' --header 'Referer:
http://www.fosshub.com/FreeFileSync.html' --header 'Connection: keep-alive'
--header 'Cookie: $(curl --silent -I
http://www.fosshub.com/FreeFileSync.html#clickToStartDownload | grep
Set-Cookie | awk -F : '{print $2}' | awk -F ; '{print $1}')' $(wget
${ConnectTimeout} --quiet --header=Referer:
http://www.fosshub.com/FreeFileSync.html;
http://www.fosshub.com/genLink/FreeFileSync/FreeFileSync_${LatestRev}_Windows_Setup.exe;
-O /dev/stdout) --output ${NewFileName} -L
Which tells me The page is temporarily unavailable
Re: need curl help with a link
On 07/04/2015 08:17 AM, Nico Kadel-Garcia wrote: Why are you trying to use curl for some site that is re-inventing software downloads and is entirely dependent on clickthroughs to actually find the content? Part of the whole point of such a site is to prevent direct, URL accessible downloads? They don't publish direct download URL's. I'd discard the site immediately as someone who's revisiting the DotCom business model and doomed to failure. If you need a content change monitor like the FreeFileSync tool, why not just put the relevant content in git source control? Don't really have a choice were they decide to put there stuff
