Job Responsibilities:

• Develop and maintain web scraping scripts using Python and Selenium to extract data from websites and APIs
• Understanding requirement of customer needs, identify source and scrape/collect data and integrate the data crawled and scraped into our databases.
• Writing efficient, reusable, testable, and testing scalable code.
• Build code that is easily readable, properly documented, and follows key coding standards.
• Use Beautiful Soup and other scraping tools to clean and process data for analysis
• Research and learn new technologies to design code reviews and application enhancements/ upgrades
• Performance tuning and automation of application.
• Maintain communication with corporate clients, Coordination with team and management.
• Coordinating with development teams to determine application requirements.
• Prioritized daily workflows, including all projects and task

Experience:

• Proficiency with Selenium and Beautiful Soup
• Depth knowledge of Data Structures, Operators, Datatypes, Casting, Methods, Conditions, Loops, Functions, Arrays, OOPS concept, iterators, Modules and MySQL integration with Python
• Strong understanding of web scraping techniques and best practices
• HTML, CSS, XPATH, Regex and HTML DOM.
• Knowledge of Libraries like Selenium, Requests, Scrappy, BeautifulSoup, NumPy, Pandas, Matplotlib, SciPy, TensorFlow, Keras, PyTorch, Plotly and Tableau.
• Good hands-on experience in Python languages and debugging with GDB
• Database & File Format: SQL, MySQL, Mongo dB, JSON, XML, Excel, CSV
• Development Tools: Microsoft Visual Studio, Visual Code, PyCharm, Power bi
• Knowledge of Rest API will be added as plus point