Web Data Engineer (Python, Playwright / Selenium)

**Company Description** Companies House Insights specializes in maintaining reliable and comprehensive private company databases across multiple markets, including Indonesia, Vietnam, the Philippines, Thailand, Singapore, and Malaysia. The company enables businesses and organizations to access government\-verified data on private companies with ease. Known for its integrity and accuracy, Companies House Insights serves as a trusted source for corporate information. Its datasets help empower decision\-making, business growth, and market understanding. **Role Description** This is a full\-time, on\-site role for a Web Data Engineer (Python, Playwright / Selenium), based in Multan. The Web Data Engineer will be responsible for developing, maintaining, and optimizing data pipelines, ensuring efficient data collection and processing. Responsibilities include building reliable scraping infrastructure, implementing data validation and normalization pipelines, and maintaining high data quality standards. The role includes applying modern scraping techniques and AI\-assisted extraction methods to improve coverage and reliability. **Key Responsibilities** : * Develop and maintain web scrapers to collect data from various websites. * Handle anti\-bot measures and ensure scraping best practices. * Build ETL pipelines to clean, normalize, and store data. * Implement AI\-assisted data extraction in data parsing * Work with large datasets and maintain data integrity. * Monitor and maintain scraper performance. * Collaborate with our engineering team to integrate scraped data into production systems. **Required Skills \& Experience** : * Strong Python skills (Scrapy, BeautifulSoup, Selenium, Playwright). * Database management (PostgreSQL, MySQL, NoSQL databases). * Knowledge of data cleaning, deduplication, and validation. * ETL \& data transformation. * Familiarity with proxies, rotating user agents, and rate\-limiting strategies. * Ability to write clean, maintainable, and well\-documented code.