Python QA Automation Engineer - Banking

**About Qualysoft** · 25 years of experience in software engineering, established in Vienna, Austria · Active in Romania since 2007, with office in central Bucharest (Bd. Iancu de Hunedoara 54B) · Delivering End to End IT Consulting Services - From Team Augmentation and Dedicated Teams to Custom Software Development · We deliver scalable enterprise systems, intelligent automation frameworks, and digital transformation platforms · Cross-industry experience by sustaining global players in BSFI (Banking, financial services and insurance), Telecom,Retail & E-commerce, Energy and Utilities, Automotive, Manufacturing, Logitics, High Tech · Global Presence: Switzerland, Germany, Austria, Sweden, Hungary, Slovakia, Serbia, Romania, and Indonesia · International team of 500+ software engineers · Strategic partnerships: Microsoft Cloud Certified Partner, Tricentis Solutions Partner in Test Automation and Test Management, Creatio Exclusive Partner, Doxee Implementation Partner · Powered by cutting-edge technologies: AI, Data & Analytics, Cloud, DevOps, IoT, and Test Automation. · Project beneficiaries ranging from large-scale enterprises to startups · Stable growth and revenue increase year over year, a resilient organisation in volatile IT market conditions · Quality-first mindset, culture of innovation, and long-term client partnerships · Global and local reach – trusted by key industry players in Europe and the US ### Responsibilities: • Establish and maintain automated frontend testing. • Build API and integration test coverage for routers and database flows. • Design and implement E2E tests with Playwright for critical user flows. • Create stable mocking and fixture strategies (MSW, pytest fixtures, predefined test data). • Configure quality gates in CI for linting, unit/integration/E2E tests, code coverage, and reporting. • Extend coverage into non-test UI and workflow areas and prevent regressions. • Build an LLM evaluation discipline with golden datasets and measurable quality gates. • Track reliability of model outputs, detect drift, and condition releases on quality/stability thresholds. • Improve test maintainability, eliminate flakiness, and optimize runtimes. ### Qualifications: 3+ years in QA automation on production systems. • Strong Python testing skills with pytest. • Strong frontend testing skills. • Experience building and maintaining E2E suites with Playwright/Selenium. • Experience in API testing (REST, schema validation, authentication/error scenarios). • Experience with SQL/PostgreSQL testing and test data management. • Experience with CI/CD pipelines (GitHub Actions, Azure Pipelines or Jenkins). • Practical understanding of testing non-deterministic outputs of LLM models. • A plus • Experience in performance and benchmark testing. • Experience in WebSocket testing. • Knowledge of security and dependency scanning. • Experience in legal-tech, fintech or other regulated domains. • Familiarity with LLM quality metrics (schema validity, hallucination tracking, consistency). • Tech Stack • Backend Testing: pytest, pytest-asyncio, coverage.py • E2E: Playwright • CI/CD: GitHub Actions • Data: PostgreSQL, pgvector • Application Stack Tested: FastAPI, React, TypeScript, Keycloak, Azure OpenAI **What We Offer** · Premium medical package · Lunch Tickets & Pluxee Card · Bookster subscription · 13th salary/yearly bonuses · Enterprise job security with a startup mentality (diverse & engaging environment, international exposure, flat hierarchy) under the stability of a secure multinational · A supportive culture (we value ownership, autonomy, and healthy work-life balance) with great colleagues, team events and activities · Flexible working program and openness to remote work · Collaborative mindset – employees shape their own benefits, tools, team events and internal practices · Diverse opportunities in Software Development with international exposure · Flexibility to choose projects aligned with your career path and technical…