The things you care about:

Within the compliance technology of our platform we do large-scale directed web crawling, analysis and storage, and presentation. We want to crawl relevant pages without crawling the entire web, which involves interpreting signals to determine whether following a link will lead to something interesting, along with the usual spectrum of web crawling concerns. We analyze large volumes of crawled web content using heuristic-based rules and store relevant data in various data stores for reporting and automated tools with plans to increasingly apply machine learning and natural language processing.

The primary technologies we use include Python, Django, React, MySQL, PostgreSQL, S3, DynamoDB, Redis, ELK, and Jenkins. Most of our heavy lifting happens within AWS with Chef and role-based autoscaling. We are constantly evolving our platform and tools to take advantage of the ever-changing tech landscape.

In this role, you will

• Work in a cross-functional, delivery-focused team of engineers and product managers in a highly autonomous and collaborative Agile environment
• Develop complex software in a cloud-native, distributed system with many opportunities to explore a broad spectrum of problems and technologies
• Write clean, well-tested code emphasizing quality, maintainability, and performance
• Be engaged in software delivery from discovery to deployment and maintenance
• Master a complex business domain

Essential knowledge, skills, and experience

• 3+ years of professional software development experience
• Strong communication, problem-solving, and analytical abilities
• Object-oriented application development experience using Python
• Basic understanding of common design patterns and engineering trade-offs
• Comfortable in cloud-native, distributed systems (AWS, GCP, Azure)
• Experience with modern engineering practices like TDD and Continuous Integration

Desirable knowledge, skills, and experience

• Familiarity with Agile and Lean software delivery principles
• Experience creating, documenting, and consuming REST APIs
• Experience with SQL and NoSQL (MySQL, PostgreSQL, DynamoDB, Redis)
• Experience in web development with MVC frameworks such as Django
• Experience with web crawling tools and techniques
• Experience using headless browsers (Puppeteer, Selenium, Qt WebEngine)
• Experience building or working with ReactJS frontends
• Understanding of data mining, text analysis, or natural language processing