Data Engineer (Python)

Job description for a Python Developer with web scraping expertise:

• Design, develop, and maintain web scraping scripts using Python.
• Use web scraping libraries like Beautiful Soup, Scrapy, Selenium and other scraping tools to extract data from websites.
• Write reusable, testable, and efficient code to extract structured and unstructured data.
• Develop and maintain software documentation for web scraping scripts.
• Collaborate with other software developers, data scientists, and other stakeholders to plan, design, develop, and launch new web scraping projects.
• Troubleshoot, debug, and optimize web scraping scripts.
• Stay up-to-date with the latest industry trends and technologies in automated data collection and cleaning
• Help maintain code quality and organization of projects
• Participate in code reviews and ensure that all solutions are aligned with standards.
• Create automated test cases to ensure the functionality and performance of the code
• Integration of data storage solutions like SQL/NoSQL databases, message brokers, and data streams for storing and analyzing the scraped data.

Requires a bachelor's degree in Computer Science, Software Engineering or a related field from a good Institute

Experience with Python development and web scraping techniques.

Familiarity with web frameworks such as Django and Flask, as well as other technologies like SQL, Git, and Linux, is also required.

Strong analytical and problem-solving skills, as well as good communication and teamwork abilities, are also important for the role.

Minimum Python Experience : 3-4 years of deep coding exp in python

. Job Location: Gurgaon

Work Model: Hybrid