I have extensive experience in web data extraction, including handling static, dynamic, JavaScript-rendered pages, and APIs. I utilize modern Python libraries such as Playwright (with Chromium plugins) to perform efficient and scalable data scraping. Sample implementations showcasing these techniques are available on my GitHub repository: github.com/sandeepsatpal/WebScraping.
My current interest in freelancing stems from a desire to work independently and stay at the forefront of emerging technologies. I am highly adaptable to customer requirements and committed to delivering comprehensive, end-to-end solutions tailored to specific business needs.
I hold an M.Tech in Data Science and Engineering from IIT Bombay and have previously worked as a Data Scientist at Yahoo, where I led engineering initiatives that integrated data science with software development.
I bring over 15 years of experience at Microsoft, where I have worked on diverse projects including contributions to the Bing search engine and the development of AI analytics solutions using Azure technologies. My role at Bing involved extracting structured and unstructured data from a wide variety of web pages and transforming it into structured formats such as TSV.