YCombinator-Scraper Package¶
Usage¶
The YCombinator-Scraper
package provides a simple and convenient Python interface for scraping data from the Workatastartup website.
1. Initialization¶
from ycombinator_scraper import Scraper
# Initialize the scraper with optional headless mode (default: True)
scraper = Scraper()
2. Logging In¶
# Log in to Workatastartup
scraper.login(username="your_username", password="your_password")
3. Loading and Saving Cookies¶
# Load saved cookies
scraper.load_cookies()
# Save cookies for later use
scraper.save_cookies()
4. Scraping Job Data¶
# Scrape job data
job_data = scraper.scrape_job_data(job_url="https://www.workatastartup.com/joba/1234")
# Print job data
print(job_data)
Example Output:
JobData(job_url='https://www.workatastartup.com/job/1234', job_title='Software Engineer', job_salary_range='$120k - $150k', job_tags=['Python', 'JavaScript', 'React'], job_description='Exciting opportunity for a skilled software engineer...')
5. Scraping Company Data¶
# Scrape company data
company_data = scraper.scrape_company_data(company_url="https://www.workatastartup.com/companies/example-inc")
# Print company data
print(company_data)
Example Output:
CompanyData(
company_name='Tech Innovators Inc.',
company_url='https://www.workatastartup.com/company/5678',
company_description='Tech Innovators is a leading tech company focused on innovation and cutting-edge solutions...',
company_tags=['Technology', 'Innovation', 'Startup'],
company_image='https://www.workatastartup.com/images/logo.png',
company_social_links=['https://twitter.com/techinnovators', 'https://linkedin.com/company/techinnovators']
)
6. Scraping Founders Data¶
# Scrape founders data
founders_data = scraper.scrape_founders_data(company_url="https://www.workatastartup.com/companies/example-inc")
# Print founders data
for i, founder in enumerate(founders_data):
print(f"Founder {i + 1}:", founder)
Example Output:
Founder 1: FounderData(
founder_name='John Doe',
founder_image_url='https://www.workatastartup.com/images/founder1.png',
founder_description='Experienced entrepreneur with a passion for technology...',
founder_linkedin_url='https://www.linkedin.com/in/johndoe',
founder_emails=None
)
Note: Replace "your_username"
and "your_password"
with your actual Workatastartup username and password. Ensure you handle sensitive information securely.