Experienced Web Scraping Engineer - Python

🚀 About Us 🚀

We're a team of 500+ professionals dedicated to developing cutting-edge proxy and web data scraping solutions. Our work empowers thousands of the world's leading businesses, including Fortune 500 companies.

✨ What Awaits You ✨

You'll tackle complex challenges and maintain our robust infrastructure, which handles over 60PB of monthly data traffic. Here's a glimpse of its scale and maturity:

• 6PB+ Ceph storage
• 60PB+ monthly data traffic
• 300k+ service requests/sec processed
• 500k+ Kafka messages/sec streamed

🗣️ A Word From The Team 🗣️

We operate one of the most advanced and largest scraping and parsing products globally, serving thousands of requests per second with exceptional success rates. Our solutions are utilized by leading players in e-commerce, market intelligence, and AI, making our work challenging and truly international. Our team is a vibrant mix of diverse personalities, backgrounds, and nationalities, with shared passions ranging from gaming and guitar to cycling and beyond. We're committed to supporting your growth, sharing our expertise in building scrapers, and ensuring you're up to speed in no time.

📅 Your Day-to-Day 📅

• Develop scalable scrapers.
• Define resilient scraping strategies and unblock websites for scraping.
• Enhance system observability.
• Create back-end solutions for scraping and parsing challenges of all sizes.
• Maintain the existing system and introduce new features for scraping and parsing.

💡 Your Skills & Experience 💡

• Proficiency in Python.
• Solid understanding of computer science fundamentals, including data structures, algorithms, computability, and complexity.
• Version control expertise with Git.
• Knowledge of website unblocking techniques for scraping.
• Ability to utilize various scraping techniques and open-source tools to build scrapers.
• Comfort with using Dev Tools.
• Familiarity with network protocols (TLS/SSL).
• Experience with browser automation.
• A strong grasp of asynchronous programming.

🌟 Nice to Have 🌟

• Web development knowledge.
• Proficiency in using CSS Selectors / XPaths for parsing.
• Experience with Go & C++.
• Work on browser source code.
• Knowledge of any front-end framework.
• Experience with Pydantic, FastAPI, SQLAlchemy.
• Hands-on experience with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, and monitoring tools like Grafana, Prometheus.
• Experience with machine learning in the scraping domain.
• Proven experience in building scalable systems.

💰 Salary 💰

• Gross salary: starting from 20,000 PLN/month. We are open to discussing a different salary based on your unique skills and experience.

🔥 Up for the Challenge? Let’s Talk! 🔥