. Net Developer (Web Crawling)

  • The Hague, Netherlands
  • Full-time

Company Description

Arηs is a fully independent group of companies specialized in managing complex IT projects and systems for large organisations, focusing on state-of-the-art software development, business intelligence and infrastructure services.

We are composed of 13 entities across 6 countries that are unified by the Arηs Group, with more than 1750 consultants.

This corporate structure enables us to respond quickly to market changes and customer requests, and to communicate and make decisions without layers of bureaucracy.

Our success can be attributed to the synergy among our nine complementary entities, combined with our methodologies, which are based on the Rational Unified Process (RUP) and the Scrum agile software development framework.

Established in 2016, the Greek entity Arηs Developments Hellas aims to extend Arηs Group activities dedicated to the European market providing high-quality services in Software Development, covering the entire application development lifecycle: starting with user requirements, business process redesign and specifications, to continue with development, testing and application maintenance.

Job Description

We are currently looking for a .Net Developer with experience in Web Crawling to join our growing team in one of the biggest European organizations.


  • Implement a set of HTTP services or functions (in .NET), following a defined contract/interface specification, to crawl internet sites and download internet content in a reliable, fast, scalable, and secure way, satisfying the defined service level agreements. Having knowledge of a web scraping technology is a plus.
  • Establish OAUTH validation mechanisms within the specified services.
  • Implement validation mechanisms on those services to verify the crawlers on a time basis. Write unit and integration test.
  • Assistance with deployment and configuration of the system. Assist the DevOps team on setting up CI/CD pipelines within Azure DevOps platform. Familiarity with Kubernetes/Docker, cloud environments and platforms is a plus.
  • Writing helm charts and integrate services on Kubernetes environments is a plus.
  • Work comfortably within a team. Follow Scrum procedures and disciplines. Estimate the work to be done upon request.
  • Write technical documentation. Account for secure coding practices, as well as logging and auditing features.
  • Communicate in a clean, concise way, not only to peers but also to upper layers when needed.



Who you are:


  • Bachelor plus minimum of 6 years of Software Development Experience
  • A minimum of 2 years of experience in .NET Software Development
  • Capable to be part of an Agile Team implementing Scrum (team worker, easy going, good communication capabilities)
  • Good knowledge of  application development environments
  • Good knowledge of the design and development of web components
  • Good knowledge of the design and development of back-end components (REST APIs, integrations, micro-services)
  • Knowledge of CD/CI systems (e.g. TFS)
  • Ability to participate in multi-lingual meetings, ease of communication
  • Capability of integration in an international/multi-cultural environment.
  • In-depth knowledge of Microsoft .NET (C#), ASP.NET Core.
  • Good knowledge of OOP paradigms and SOLID principles
  • Capable to be part of an Agile Team implementing Scrum (team worker, easy going, good communication capabilities)


  • Participation in projects involving  crawler practice
  • Experience with at least one of these: Selenium, Playwright, Scrapy, Kofax / Kapow. Other web-crawling technologies would also be acceptable.
  • Experience with highly scalable systems
  • Knowledge about responsive, multi-device development (e.g. desktop, laptop, tablet, smartphone)
  • Knowledge of software development methodologies  (e.g. AGILE)
  • Knowledge of relational databases
  • Knowledge of no-sql and graph databases
  • Ability to cope with fast changing technologies used in application developments
Privacy Policy