PBI Commercial, a fast-moving construction and restoration company, is seeking an experienced AI Agent Developer to build and maintain an intelligent web-scraping solution that scans up to 80 targeted websites for Construction, RAM, and Restoration bid opportunities.
This AI Agent should be able to:
-Visit and navigate diverse websites (government portals, university procurement sites, GC bid boards, etc.)
-Identify relevant bid opportunities in our target service categories
-Extract key details such as project name, location, due dates, and requirements
-Feed this information into a structured database or trigger alerts (email/CRM)
Responsibilities:
-Build and train an AI Agent or intelligent scraping bot for structured/unstructured sites
-Create rules to prioritize and filter opportunities relevant to our services
-Design workflows for frequent updates or scheduled scrapes
-Ensure resilience against website changes and anti-bot measures
-Provide export or API-compatible formats (CSV, Zoho CRM sync, or similar)
Requirements:
-Proven experience with AI or automated web scraping tools (BeautifulSoup, Playwright, Selenium, LangChain, GPT-4 with function calling, etc.)
-Ability to extract data from both structured and unstructured HTML sources
-Experience handling login-based portals or CAPTCHA workarounds
-Strong skills in Python, JavaScript, or other scraping frameworks
-Familiarity with construction bidding/procurement sites is a plus
Deliverables:
-One AI Agent or tool that can handle up to 80 URLs (starting small and scaling up)
-Dashboard or report of collected data
-Documentation and knowledge transfer