Python Forum
I wan't to Download all .zip Files From A Website (Project AI)
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
I wan't to Download all .zip Files From A Website (Project AI)
#58
(Sep-01-2018, 07:41 PM)eddywinch82 Wrote: The Company I have paid to help me with this code, have sorted the Login Problem they say.
You have to use session in rest code after log in,is not used now.
Can show how to do test.
import sys
import getpass
import hashlib
import requests
import os, time
from bs4 import BeautifulSoup

BASE_URL = 'https://www.flightsim.com/'
LOGIN_PAGE = 'https://www.flightsim.com/vbfs/login.php?do=login'

def do_login(credentials):
    session = requests.Session()
    session.get(BASE_URL)
    req = session.post(LOGIN_PAGE, params={'do': 'login'}, data=credentials)
    if req.status_code != 200:
        print('Login not successful')
        sys.exit(1)
    # session is now logged in
    return session

def get_credentials():
    username = 'aaaa'
    password = 'xxxxxx'
    password_md5 = hashlib.md5(password.encode()).hexdigest()
    return {
        'cookieuser': 1,
        'do': 'login',
        's': '',
        'securitytoken': 'guest',
        'vb_login_md5_password': password_md5,
        'vb_login_md5_password_utf': password_md5,
        'vb_login_password': '',
        'vb_login_password_hint': 'Password',
        'vb_login_username': username,
    }

credentials = get_credentials()
session = do_login(credentials)

# Check that logged in
time.sleep(3)
url_in = 'https://www.flightsim.com/vbfs/forum.php'
resonse = session.get(url_in)
print(resonse)
soup = BeautifulSoup(resonse.content, 'lxml')
welcome = soup.find('h2', class_="forumtitle")
print(welcome.text)
Output:
<Response [200]> Newcomer Services
So example in line 54 it most be session.get(url)

If you paid they should help you to get started and have some working code that download some zip files.
Reply


Messages In This Thread
RE: I wan't to Download all .zip Files From A Website (Project AI) - by snippsat - Sep-01-2018, 10:50 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Website scrapping and download santoshrane 3 4,494 Apr-14-2021, 07:22 AM
Last Post: kashcode
  Login and download an exported csv file within a ribbon/button in a website Alekhya 0 2,764 Feb-26-2021, 04:15 PM
Last Post: Alekhya
  Cant Download Images from Unsplash Website firaki12345 1 2,385 Feb-08-2021, 04:15 PM
Last Post: buran
  Download some JPG files and make it a single PDF & share it rompdeck 5 5,856 Jul-31-2020, 01:15 AM
Last Post: Larz60+
  download pdf file from website m_annur2001 1 3,096 Jun-21-2019, 05:03 AM
Last Post: j.crater
  Access my webpage and download files from Python Pedroski55 7 5,869 May-26-2019, 12:08 PM
Last Post: snippsat
  Download all secret links from a map design website fyec 0 2,937 Jul-24-2018, 09:08 PM
Last Post: fyec
  I Want To Download Many Files Of Same File Extension With Either Wget Or Python, eddywinch82 15 14,947 May-20-2018, 06:05 PM
Last Post: eddywinch82

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020