Challenge
A startup wanted to automate their data entry each time they had a new client who had info available on their website or somewhere public. At multiple occasions, they were faced with entering more than 100 products which included different sub-categories. The tasks could take 3-4 hours to manually setup the profile of their new clients. The goal was to automate the majority of those manual tasks.
Solution
I needed to combine web scrapping, completing input forms, evaluating available data on the custom database to finally uploading the product live. I opted for Puppeeteer which is a Node library that provides a high-level API to perform all the manual things one perform in a browser. Consequently, I decided to have a simple UI built with Javascript-Tailwind and for database I went with MongoDB. I ran the logic and performed the whole task manually in order to understand each steps that the bots would have to performed then the rest was translating those steps into algorithm.