Indeed — Job Search

keyword + location + country → structured job listing data (title, company, salary, description, benefits, apply link)

Language

Objective

Prerequisites

• Target page is already open in the browser: https://www.indeed.com/jobs?q={keyword}&l={location}
• For pagination beyond page 1: user must be logged into Indeed (login/sign-in button is NOT visible, user avatar or account menu IS visible)

Pre-execution Checks

1. Tool Readiness

2. Login Verification (for pagination beyond page 1)

• Sign out entry, user avatar, or account menu exists → logged in, continue execution
• Sign in/Register entry exists with no sign out entry → not logged in, inform the user that login is needed for pagination beyond page 1, assist the user in completing the login flow

Capability Components

This Skill's operational boundary = what the user can manually do in their browser. It only reads data already displayed to the user on the page, never bypassing authentication or access controls. Its role is equivalent to copy-pasting on the user's behalf — the data is already on screen, automation merely saves time. JS code is encapsulated in Python files under the scripts/ directory, invoked via eval "$(python scripts/xxx.py {params})". $(...) is bash syntax; it is recommended to use the bash tool for execution.

API: Extract job list from search results page

• --max-items: Maximum number of items to return from current page, 0 for all (default: 0)

1. navigate https://www.indeed.com/jobs?q={keyword}&l={location} (add &start={offset} for pagination)
2. wait stable
3. If page title contains "Security Check" → solve-captcha → wait stable

{
  "pageNumber": 1,
  "totalResults": 24,
  "results": [
    {
      "id": "8c06afbaf73fc880",
      "positionName": "Software Engineer",
      "company": "Google",
      "location": "San Francisco, CA",
      "postedAt": "3 days ago",
      "salary": "\$120,000 - \$180,000 a year",
      "salaryMin": 120000,
      "salaryMax": 180000,
      "salaryCurrency": "USD",
      "salaryType": "YEARLY",
      "jobType": ["Full-time"],
      "rating": 4.3,
      "reviewsCount": 15000,
      "companyLogo": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/256x256/...",
      "snippet": "<ul>...<b>software</b>...</ul>",
      "sponsored": false,
      "expired": false,
      "newJob": true,
      "url": "https://www.indeed.com/viewjob?jk=8c06afbaf73fc880",
      "externalApplyLink": null
    }
  ]
}

API: Fetch full job detail by job key

• jobkey: Indeed job key (the id field from search results)

{
  "id": "a39828c8395d5dfe",
  "positionName": "Sr. Application Developer",
  "company": "University of California San Francisco",
  "location": "San Francisco, CA 94158",
  "rating": 4,
  "reviewsCount": 709,
  "companyLogo": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/256x256/...",
  "salary": "\$101,300 - \$190,000 a year",
  "salaryMin": 101300,
  "salaryMax": 190000,
  "salaryCurrency": "USD",
  "salaryType": "YEARLY",
  "jobType": "Full-time",
  "description": "<p><b>Job Description:</b></p><p>...(full HTML)...</p>",
  "benefits": ["Health insurance", "401(k)", "Dental insurance"],
  "postedAt": "13 days ago",
  "isExpired": false, "url": "https://www.indeed.com/viewjob?jk=a39828c8395d5dfe"
}

Composite: Full job search with descriptions

1. navigate https://www.indeed.com/jobs?q={keyword}&l={location} → wait stable
2. If title contains "Security Check" → solve-captcha → wait stable
3. eval "$(python scripts/search-jobs.py)" → get job list with IDs
4. For each job id from step 3:
   • eval "$(python scripts/fetch-job-detail.py '{id}')" → get full description
5. Merge: search results provide base data, detail fetch adds description, benefits, enriched salary/rating

• Repeat steps 1-4 with &start=10, &start=20, &start=30, etc.
• Termination: when search-jobs.py returns fewer results than expected or error: true

Enum Parameters

Pagination

Success Criteria

• result count >= 1 from search-jobs.py
• Core fields non-null: id, positionName, company, location present for all results
• description field from fetch-job-detail.py is non-null HTML string with length > 100
• Data matches page content (job titles correspond to visible listings)

Known Limitations

• Pagination beyond page 1 requires Indeed login (unauthenticated access limited to first page, ~24 results)
• Indeed may trigger captcha/security check on first visit; solve-captcha resolves this
• Job detail fetch (fetch-job-detail.py) must execute from within the search results page context (same-origin requirement)
• Indeed's anti-bot detection may block access after excessive requests; use appropriate intervals (2-5 seconds between detail fetches)
• Some fields (salary, jobType, benefits) may be null when not provided by the employer

Execution Efficiency

• Batch orchestration: Write a bash script to loop through the command templates serially within a single session; do not parallelize within one browser (prone to triggering anti-scraping restrictions). Add 2-3 second intervals between detail fetches. To increase throughput, open multiple stealth browser sessions and distribute work across them — each session has an independent fingerprint so rate limits apply per session
• Test before batch execution: After writing a batch script, you must first test with 1-2 items to verify the script runs correctly; only then run the full batch. Never skip testing and execute in batch directly
• Reduce redundant pre-operations: Extract all job IDs from the search page first (one eval), then batch-fetch details — avoid re-navigating to the search page between fetches
• Error resumption: Save results item by item during batch processing; on failure, resume from the breakpoint rather than starting over

Experience Notes