We are looking for a highly skilled Senior Test Automation Engineer to ensure the quality, reliability, and safety of next-generation agentic AI systems for the logistics industry.
In this role, you will own test automation, reliability validation, scenario simulation, and AI-specific evaluation pipelines. You will work with complex, non-deterministic systems involving LLMs, agent workflows, and real-world logistics constraints such as routing, time windows, and geospatial data.
This is not a traditional QA role. You are expected to define what to test and how to test it, build intelligent testing systems, and proactively identify risks in AI-driven behavior.
Design and build automated testing frameworks for backend services, APIs, and AI-driven logistics systems
Develop evaluation pipelines for LLM systems (quality, safety, regression detection)
Create scenario simulations covering routing constraints, time windows, capacities, and geospatial edge cases
Define testing strategies for non-deterministic systems using statistical and tolerance-based validation
Validate geospatial data, routing logic, and integrations with HERE and external APIs
Build tools for synthetic data generation and large-scale test scenario creation
Integrate testing and evaluation into CI/CD for continuous validation
Collaborate with engineers and domain experts to identify failure modes and improve system quality
Experience in test automation/SDET with strong programming skills (Python preferred)
Experience testing logistics, routing, or geospatial systems (required)
Strong understanding of distributed systems, APIs, and data-intensive applications
Experience with AI/ML systems and evaluating non-deterministic outputs (e.g., LLMs)
Solid grasp of data science concepts (metrics, statistical validation, sampling)
Ability to design test strategies independently for complex and ambiguous systems
Experience working with geospatial APIs/data (e.g., HERE, OSM, or similar)
Familiarity with CI/CD, observability, and AI-assisted development tools
What We Offer:
Change is HERE. Apply Now!
#LI-AK8 #LI-HYBRID
Life at HERE in Poland comes with a competitive total rewards package designed to support your health, wellbeing, and performance. This includes a base salary, a Short-Term Incentive (STI) bonus (percentage based on role), a creative tax advantage for eligible positions, private medical care (including dental), life insurance, a meal allowance, vision reimbursement, a remote work allowance (if applicable), access to MyBenefit and Multisport programs, and various wellbeing initiatives. Paid time off, sick leave, and parental leave are provided in accordance with the Polish Labor Code.
As part of HERE Technologies employment process, candidates will be required to successfully complete a pre-employment screening process. This offer and any related claims are subject to the successful completion of a pre-employment screening. This will involve employment, education, and criminal verification if applicable.
HERE is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, age, gender identity, sexual orientation, marital status, parental status, religion, sex, national origin, disability, veteran status, and other legally protected characteristics.
HERE Technologies is a location data and technology platform company. We empower our customers to achieve better outcomes – from helping a city manage its infrastructure or a business optimize its assets to guiding drivers to their destination safely.
At HERE we take it upon ourselves to be the change we wish to see. We create solutions that fuel innovation, provide opportunity and foster inclusion to improve people’s lives. If you are inspired by an open world and driven to create positive change, join us. Learn more about us on our YouTube Channel.
Software Powered by iCIMS
www.icims.com